A Service Framework for Scientific Workflow Management in the Cloud

doi:10.1109/TSC.2014.2341235

	A Service Framework for Scientific Workflow Management in the Cloud
	Zhao, Yong 1; Li, Youfu 1; Raicu, Ioan 2; Lu, Shiyong 3; Lin, Cui 4; Zhang, Yanzhe 5; Tian, Wenhong 1; Xue, Ruini 1
	2015-11-01
发表期刊	IEEE TRANSACTIONS ON SERVICES COMPUTING
ISSN	1939-1374
卷号	8 期号:6 页码:930-944
摘要	Cloud computing is an emerging computing paradigm that can offer unprecedented scalability and resources on demand, and is getting more and more adoption in the science community, while scientific workflow management systems provide essential support such as management of data and task dependencies, job scheduling and execution, provenance tracking, etc., to scientific computing. As we are entering into a "big data" era, it is imperative to migrate scientific workflow management systems into the cloud to manage the ever increasing data scale and analysis complexity. We propose a reference service framework for integrating scientific workflow management systems into various cloud platforms, which consists of eight major components, including Cloud Workflow Management Service, Cloud Resource Manager, etc., and six interfaces between them. We also present a reference framework for the implementation of Cloud Resource Manager, which is responsible for the provisioning and management of virtual resources in the cloud. We discuss our implementation of the framework by integrating the Swift scientific workflow management system with the OpenNebula and Eucalyptus cloud platforms, and demonstrate the capability of the solution using a NASA MODIS image processing workflow and a production deployment on the Science@Guoshi network with support for the Montage image mosaic workflow.
关键词	Cloud workflow cloud resource management reference service framework swift virtual cluster provisioning workflow-as-a-service
DOI	10.1109/TSC.2014.2341235
收录类别	SCI
语种	英语
资助项目	National Science Foundation of China[61272528] ; National Science Foundation of China[61034005] ; Central University Fund[ID-ZYGX2013J073]
WOS研究方向	Computer Science
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering
WOS记录号	WOS:000367007100010
出版者	IEEE COMPUTER SOC
引用统计	被引频次：24[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/9060
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhao, Yong
作者单位	1.Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China 2.IIT, Dept Comp Sci, Chicago, IL 60616 USA 3.Wayne State Univ, Dept Comp Sci, Detroit, MI 48202 USA 4.Calif State Univ Fresno, Dept Comp Sci, Sunnyvale, CA 94086 USA 5.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Zhao, Yong,Li, Youfu,Raicu, Ioan,et al. A Service Framework for Scientific Workflow Management in the Cloud[J]. IEEE TRANSACTIONS ON SERVICES COMPUTING,2015,8(6):930-944.
APA	Zhao, Yong.,Li, Youfu.,Raicu, Ioan.,Lu, Shiyong.,Lin, Cui.,...&Xue, Ruini.(2015).A Service Framework for Scientific Workflow Management in the Cloud.IEEE TRANSACTIONS ON SERVICES COMPUTING,8(6),930-944.
MLA	Zhao, Yong,et al."A Service Framework for Scientific Workflow Management in the Cloud".IEEE TRANSACTIONS ON SERVICES COMPUTING 8.6(2015):930-944.