Institute of Computing Technology, Chinese Academy IR
A Service Framework for Scientific Workflow Management in the Cloud | |
Zhao, Yong1; Li, Youfu1; Raicu, Ioan2; Lu, Shiyong3; Lin, Cui4; Zhang, Yanzhe5; Tian, Wenhong1; Xue, Ruini1 | |
2015-11-01 | |
发表期刊 | IEEE TRANSACTIONS ON SERVICES COMPUTING |
ISSN | 1939-1374 |
卷号 | 8期号:6页码:930-944 |
摘要 | Cloud computing is an emerging computing paradigm that can offer unprecedented scalability and resources on demand, and is getting more and more adoption in the science community, while scientific workflow management systems provide essential support such as management of data and task dependencies, job scheduling and execution, provenance tracking, etc., to scientific computing. As we are entering into a "big data" era, it is imperative to migrate scientific workflow management systems into the cloud to manage the ever increasing data scale and analysis complexity. We propose a reference service framework for integrating scientific workflow management systems into various cloud platforms, which consists of eight major components, including Cloud Workflow Management Service, Cloud Resource Manager, etc., and six interfaces between them. We also present a reference framework for the implementation of Cloud Resource Manager, which is responsible for the provisioning and management of virtual resources in the cloud. We discuss our implementation of the framework by integrating the Swift scientific workflow management system with the OpenNebula and Eucalyptus cloud platforms, and demonstrate the capability of the solution using a NASA MODIS image processing workflow and a production deployment on the Science@Guoshi network with support for the Montage image mosaic workflow. |
关键词 | Cloud workflow cloud resource management reference service framework swift virtual cluster provisioning workflow-as-a-service |
DOI | 10.1109/TSC.2014.2341235 |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Science Foundation of China[61272528] ; National Science Foundation of China[61034005] ; Central University Fund[ID-ZYGX2013J073] |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Information Systems ; Computer Science, Software Engineering |
WOS记录号 | WOS:000367007100010 |
出版者 | IEEE COMPUTER SOC |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://119.78.100.204/handle/2XEOYT63/9060 |
专题 | 中国科学院计算技术研究所期刊论文_英文 |
通讯作者 | Zhao, Yong |
作者单位 | 1.Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China 2.IIT, Dept Comp Sci, Chicago, IL 60616 USA 3.Wayne State Univ, Dept Comp Sci, Detroit, MI 48202 USA 4.Calif State Univ Fresno, Dept Comp Sci, Sunnyvale, CA 94086 USA 5.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China |
推荐引用方式 GB/T 7714 | Zhao, Yong,Li, Youfu,Raicu, Ioan,et al. A Service Framework for Scientific Workflow Management in the Cloud[J]. IEEE TRANSACTIONS ON SERVICES COMPUTING,2015,8(6):930-944. |
APA | Zhao, Yong.,Li, Youfu.,Raicu, Ioan.,Lu, Shiyong.,Lin, Cui.,...&Xue, Ruini.(2015).A Service Framework for Scientific Workflow Management in the Cloud.IEEE TRANSACTIONS ON SERVICES COMPUTING,8(6),930-944. |
MLA | Zhao, Yong,et al."A Service Framework for Scientific Workflow Management in the Cloud".IEEE TRANSACTIONS ON SERVICES COMPUTING 8.6(2015):930-944. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论