Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing

doi:10.1109/TII.2020.3002239

	Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing
	Yang, Bo 1; Zhang, Jialin 2; Shi, Huaguang 2
	2021-05-01
发表期刊	IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
ISSN	1551-3203
卷号	17 期号:5 页码:3599-3608
摘要	Concordant operations among automatic industrial devices (i.e., agents) play a significant role in achieving efficient smart manufacturing. Existing multiagent cooperation methods focus on centralized training with decentralized execution, which is unsuitable for the edge-based distributed industrial scenarios. To harmonize distributed devices' actions and enhance the production efficiency, in this article, we propose an Interactive-Imitation-based Distributed Coordination (IIDC) algorithm. Specifically, we leverage the generative adversarial imitation learning (GAIL) model to direct one agent's actions by following external professional demonstrations. We also adopt the self-imitation learning (SIL) model to direct one agent's potential actions by following its own previous good experiences. As the imperfect demonstrations in the GAIL-based interagent imitation process may degrade the imitation accuracy, we present a confidence-based matching method to reduce the gap between the professional and imitative behaviors. Furthermore, during the SIL-based intra-agent imitation process, the rewardless explorations also lead to nonoptimal imitation policy. We then present a Stein variational policy gradient based self-imitation method to learn an expected optimal policy. We validate the IIDC algorithm's effectiveness via the sequential assembly task. Evaluation results demonstrate that the IIDC algorithm can enhance the production efficiency evidently.
关键词	Task analysis Manufacturing Heuristic algorithms Training Image edge detection Computer architecture Coordinated manufacturing industrial cyber– physical systems multiagent imitation learning
DOI	10.1109/TII.2020.3002239
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62002346] ; National Natural Science Foundation of China[TII-20-0469]
WOS研究方向	Automation & Control Systems ; Computer Science ; Engineering
WOS类目	Automation & Control Systems ; Computer Science, Interdisciplinary Applications ; Engineering, Industrial
WOS记录号	WOS:000622100800060
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：5[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/16888
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Yang, Bo
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Shenyang Inst Automat, Shenyang 110016, Peoples R China
推荐引用方式 GB/T 7714	Yang, Bo,Zhang, Jialin,Shi, Huaguang. Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing[J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,2021,17(5):3599-3608.
APA	Yang, Bo,Zhang, Jialin,&Shi, Huaguang.(2021).Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing.IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,17(5),3599-3608.
MLA	Yang, Bo,et al."Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing".IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS 17.5(2021):3599-3608.