Institute of Computing Technology, Chinese Academy IR
Distributed data mining in grid computing environments | |
Luo, Ping; Lu, Kevin; Shi, Zhongzhi; He, Qing | |
2007 | |
发表期刊 | FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF GRID COMPUTING THEORY METHODS AND APPLICATIONS |
ISSN | 0167-739X |
卷号 | 23期号:1页码:84-91 |
摘要 | The computing-intensive data mining for inherently Internet-wide distributed data, referred to as Distributed Data Mining (DDM), calls for the support of a powerful Grid with an effective scheduling framework. DDM often shares the computing paradigm of local processing and global synthesizing. It involves every phase of Data Mining (DM) processes, which makes the workflow of DDM very complex and can be modelled only by a Directed Acyclic Graph (DAG) with multiple data entries. Motivated by the need for a practical solution of the Grid scheduling problem for the DDM workflow, this paper proposes a novel two-phase scheduling framework, including External Scheduling and Internal Scheduling, on a two-level Grid architecture (InterGrid, IntraGrid). Currently a DM IntraGrid, named DMGCE (Data Mining Grid Computing Environment), has been developed with a dynamic scheduling framework for competitive DAGs in a heterogeneous computing environment. This system is implemented in an established Multi-Agent System (MAS) environment, in which the reuse of existing DM algorithms is achieved by encapsulating them into agents. Practical classification problems from oil well logging analysis are used to measure the system performance. The detailed experiment procedure and result analysis are also discussed in this paper. (C) 2006 Elsevier B.V. All rights reserved. |
关键词 | distributed data mining directed acyclic graph InterGrid IntraGrid multi-agent system environment |
DOI | 10.1016/j.future.2006.04.010 |
收录类别 | SCI |
语种 | 英语 |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Theory & Methods |
WOS记录号 | WOS:000241144800011 |
出版者 | ELSEVIER SCIENCE BV |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://119.78.100.204/handle/2XEOYT63/10934 |
专题 | 中国科学院计算技术研究所期刊论文_英文 |
通讯作者 | Lu, Kevin |
作者单位 | 1.Brunel Univ, Uxbridge UB8 3PH, Middx, England 2.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100080, Peoples R China 3.Chinese Acad Sci, Grad Sch, Beijing 100080, Peoples R China |
推荐引用方式 GB/T 7714 | Luo, Ping,Lu, Kevin,Shi, Zhongzhi,et al. Distributed data mining in grid computing environments[J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF GRID COMPUTING THEORY METHODS AND APPLICATIONS,2007,23(1):84-91. |
APA | Luo, Ping,Lu, Kevin,Shi, Zhongzhi,&He, Qing.(2007).Distributed data mining in grid computing environments.FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF GRID COMPUTING THEORY METHODS AND APPLICATIONS,23(1),84-91. |
MLA | Luo, Ping,et al."Distributed data mining in grid computing environments".FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF GRID COMPUTING THEORY METHODS AND APPLICATIONS 23.1(2007):84-91. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论