Scheduling-aware data prefetching for data processing services in cloud

Chien Hung Chen; Ting Yuan Hsia; Yennun Huang; Sy Yen Kuo

doi:10.1109/AINA.2017.54

Scheduling-aware data prefetching for data processing services in cloud

Chien Hung Chen, Ting Yuan Hsia, Yennun Huang, Sy Yen Kuo

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Scopus citations

Abstract

Cloud computing services provide flexible computing and storage resources to process large amount of datasets. In-memory techniques keep the frequently used data into faster and more expensive storage media for improving performance of data processing services. Data prefetching aims to move data to low-latency storage media to meet requirements of performance. However, existing mechanisms do not consider how to benefit the data processing applications which do not frequently access the same datasets. Another problem is how to reclaim memory resources without affecting other running applications. In this paper, we provide a Scheduling-Aware Data Prefetching (SADP) mechanism for data processing services in a cloud data center. The SADP includes data prefetching and data eviction mechanisms. It firstly evicts the data from memory to release resources for hosting other data blocks, and then it caches the data that will be used in near future. Finally, real-testbed experiments are performed to show the effectiveness of the proposed SADP.

Original language	English
Title of host publication	Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017
Editors	Tomoya Enokido, Hui-Huang Hsu, Chi-Yi Lin, Makoto Takizawa, Leonard Barolli
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	835-842
Number of pages	8
ISBN (Electronic)	9781509060283
DOIs	https://doi.org/10.1109/AINA.2017.54
State	Published - 05 05 2017
Externally published	Yes
Event	31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017 - Taipei, Taiwan Duration: 27 03 2017 → 29 03 2017

Publication series

Name	Proceedings - International Conference on Advanced Information Networking and Applications, AINA
ISSN (Print)	1550-445X

Conference

Conference	31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017
Country/Territory	Taiwan
City	Taipei
Period	27/03/17 → 29/03/17

Bibliographical note

Publisher Copyright:
© 2017 IEEE.

Keywords

Alluxio
Data prefetching
Scheduling
Spark

Access to Document

10.1109/AINA.2017.54

Cite this

Chen, C. H., Hsia, T. Y., Huang, Y., & Kuo, S. Y. (2017). Scheduling-aware data prefetching for data processing services in cloud. In T. Enokido, H.-H. Hsu, C.-Y. Lin, M. Takizawa, & L. Barolli (Eds.), Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017 (pp. 835-842). Article 7920994 (Proceedings - International Conference on Advanced Information Networking and Applications, AINA). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/AINA.2017.54

Chen, Chien Hung ; Hsia, Ting Yuan ; Huang, Yennun et al. / Scheduling-aware data prefetching for data processing services in cloud. Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017. editor / Tomoya Enokido ; Hui-Huang Hsu ; Chi-Yi Lin ; Makoto Takizawa ; Leonard Barolli. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 835-842 (Proceedings - International Conference on Advanced Information Networking and Applications, AINA).

@inproceedings{74f02e28685d48b3b5463e94e0c86f3e,

title = "Scheduling-aware data prefetching for data processing services in cloud",

abstract = "Cloud computing services provide flexible computing and storage resources to process large amount of datasets. In-memory techniques keep the frequently used data into faster and more expensive storage media for improving performance of data processing services. Data prefetching aims to move data to low-latency storage media to meet requirements of performance. However, existing mechanisms do not consider how to benefit the data processing applications which do not frequently access the same datasets. Another problem is how to reclaim memory resources without affecting other running applications. In this paper, we provide a Scheduling-Aware Data Prefetching (SADP) mechanism for data processing services in a cloud data center. The SADP includes data prefetching and data eviction mechanisms. It firstly evicts the data from memory to release resources for hosting other data blocks, and then it caches the data that will be used in near future. Finally, real-testbed experiments are performed to show the effectiveness of the proposed SADP.",

keywords = "Alluxio, Data prefetching, Scheduling, Spark",

author = "Chen, \{Chien Hung\} and Hsia, \{Ting Yuan\} and Yennun Huang and Kuo, \{Sy Yen\}",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017 ; Conference date: 27-03-2017 Through 29-03-2017",

year = "2017",

month = may,

day = "5",

doi = "10.1109/AINA.2017.54",

language = "英语",

series = "Proceedings - International Conference on Advanced Information Networking and Applications, AINA",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "835--842",

editor = "Tomoya Enokido and Hui-Huang Hsu and Chi-Yi Lin and Makoto Takizawa and Leonard Barolli",

booktitle = "Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017",

address = "美国",

}

Chen, CH, Hsia, TY, Huang, Y & Kuo, SY 2017, Scheduling-aware data prefetching for data processing services in cloud. in T Enokido, H-H Hsu, C-Y Lin, M Takizawa & L Barolli (eds), Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017., 7920994, Proceedings - International Conference on Advanced Information Networking and Applications, AINA, Institute of Electrical and Electronics Engineers Inc., pp. 835-842, 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017, Taipei, Taiwan, 27/03/17. https://doi.org/10.1109/AINA.2017.54

Scheduling-aware data prefetching for data processing services in cloud. / Chen, Chien Hung; Hsia, Ting Yuan; Huang, Yennun et al.
Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017. ed. / Tomoya Enokido; Hui-Huang Hsu; Chi-Yi Lin; Makoto Takizawa; Leonard Barolli. Institute of Electrical and Electronics Engineers Inc., 2017. p. 835-842 7920994 (Proceedings - International Conference on Advanced Information Networking and Applications, AINA).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Scheduling-aware data prefetching for data processing services in cloud

AU - Chen, Chien Hung

AU - Hsia, Ting Yuan

AU - Huang, Yennun

AU - Kuo, Sy Yen

PY - 2017/5/5

Y1 - 2017/5/5

N2 - Cloud computing services provide flexible computing and storage resources to process large amount of datasets. In-memory techniques keep the frequently used data into faster and more expensive storage media for improving performance of data processing services. Data prefetching aims to move data to low-latency storage media to meet requirements of performance. However, existing mechanisms do not consider how to benefit the data processing applications which do not frequently access the same datasets. Another problem is how to reclaim memory resources without affecting other running applications. In this paper, we provide a Scheduling-Aware Data Prefetching (SADP) mechanism for data processing services in a cloud data center. The SADP includes data prefetching and data eviction mechanisms. It firstly evicts the data from memory to release resources for hosting other data blocks, and then it caches the data that will be used in near future. Finally, real-testbed experiments are performed to show the effectiveness of the proposed SADP.

AB - Cloud computing services provide flexible computing and storage resources to process large amount of datasets. In-memory techniques keep the frequently used data into faster and more expensive storage media for improving performance of data processing services. Data prefetching aims to move data to low-latency storage media to meet requirements of performance. However, existing mechanisms do not consider how to benefit the data processing applications which do not frequently access the same datasets. Another problem is how to reclaim memory resources without affecting other running applications. In this paper, we provide a Scheduling-Aware Data Prefetching (SADP) mechanism for data processing services in a cloud data center. The SADP includes data prefetching and data eviction mechanisms. It firstly evicts the data from memory to release resources for hosting other data blocks, and then it caches the data that will be used in near future. Finally, real-testbed experiments are performed to show the effectiveness of the proposed SADP.

KW - Alluxio

KW - Data prefetching

KW - Scheduling

KW - Spark

UR - https://www.scopus.com/pages/publications/85019711806

U2 - 10.1109/AINA.2017.54

DO - 10.1109/AINA.2017.54

M3 - 会议稿件

AN - SCOPUS:85019711806

T3 - Proceedings - International Conference on Advanced Information Networking and Applications, AINA

SP - 835

EP - 842

BT - Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017

A2 - Enokido, Tomoya

A2 - Hsu, Hui-Huang

A2 - Lin, Chi-Yi

A2 - Takizawa, Makoto

A2 - Barolli, Leonard

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017

Y2 - 27 March 2017 through 29 March 2017

ER -

Chen CH, Hsia TY, Huang Y, Kuo SY. Scheduling-aware data prefetching for data processing services in cloud. In Enokido T, Hsu HH, Lin CY, Takizawa M, Barolli L, editors, Proceedings - 31st IEEE International Conference on Advanced Information Networking and Applications, AINA 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 835-842. 7920994. (Proceedings - International Conference on Advanced Information Networking and Applications, AINA). doi: 10.1109/AINA.2017.54

Scheduling-aware data prefetching for data processing services in cloud

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this