A Pretreatment Workflow Scheduling Approach for Big Data Applications in Multi-cloud Environments

Lin, BingCollege of Mathematics and Computer Sciences, Fuzhou University (författare)

Validerad; 2016; Nivå 2; 2016-11-07 (andbra)
The rapid development of the latest distributed computing paradigm, i.e., cloud computing, generates a highly fragmented cloud market composed of numerous cloud providers and offers tremendous parallel computing ability to handle Big Data problems. One of the biggest challenges in Multi-clouds is efficient workflow scheduling. Although the workflow scheduling problem has been studied extensively, there are still very few primal works tailored for Multi-cloud environments. Moreover, the existing research works either fail to satisfy the Quality of Service (QoS) requirements, or do not consider some fundamental features of cloud computing such as heterogeneity and elasticity of computing resources. In this paper, a scheduling algorithm which is called Multi-Clouds Partial Critical Paths with Pretreatment (MCPCPP) for Big Data workflows in Multi-clouds is presented. This algorithm incorporates the concept of Partial Critical Paths, and aims to minimize the execution cost of workflow while satisfying the defined deadline constraint. Our approach takes into considerations the essential characteristics of Multi-clouds such as the charge per time interval, various instance types from different cloud providers as well as homogeneous intra-bandwidth vs. heterogeneous inter-bandwidth. Various types of workflows are used for evaluation purpose and our experimental results show that the MCPCPP is promising.

Guo, WenzhongCollege of Mathematics and Computer Sciences, Fuzhou University (författare)
Xiong, NaixueSchool of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology (författare)
Chen, GuolongCollege of Mathematics and Computer Sciences, Fuzhou University (författare)
Vasilakos, AthanasiosLuleå tekniska universitet,Datavetenskap(Swepub:ltu)thanos (författare)
Zhang, HongCollege of Mathematics and Computer Sciences, Fuzhou University (författare)
College of Mathematics and Computer Sciences, Fuzhou UniversitySchool of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology (creator_code:org_t)

Ingår i:IEEE Transactions on Network and Service Management13:3, s. 581-5941932-4537

Av författaren/redakt...: Lin, Bing; Guo, Wenzhong; Xiong, Naixue; Chen, Guolong; Vasilakos, Athan ...; Zhang, Hong

Om ämnet

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.