An Intelligent Shadow Play System With Multi-dimensional Interactive Perception

doi:10.1080/10447318.2022.2062839

	An Intelligent Shadow Play System With Multi-dimensional Interactive Perception
	Tang, Zhichuan 1,2; Hu, Yidan 1; Weng, Weining 3; Zhang, Lekai 1; Zhang, Lingtao 1; Ying, Jichen 1
	2022-04-25
发表期刊	INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
ISSN	1044-7318
页码	13
摘要	We developed an intelligent shadow play system (ShadowTouch) based on multi-dimensional interactive perception technologies to let user interact with the shadow play figure naturally. ShadowTouch included a shadow play hardware subsystem and a multi-dimensional interactive software subsystem. In shadow play hardware subsystem, each joint of the shadow play figure was actuated by the connecting rod which was rotated through one steering gear. In multi-dimensional interactive software subsystem, a somatosensory interaction module synchronized motions between shadow play figure and human body based on skeleton point detection, and an automatic choreography module generated the motions automatically for the shadow play figure based on musical emotion recognition. The proposed system improved the immersive interaction experience and let users feel involved during the performance of shadow play, and the motions of shadow play figure (steering gear motion angles) could be saved digitally to further be applied for the reactivation and inheritance of traditional culture.
DOI	10.1080/10447318.2022.2062839
收录类别	SCI
语种	英语
资助项目	Philosophy and Social Science Planning Fund Project of Zhejiang Province[22NDJC007Z] ; Philosophy and Social Science Planning Fund Project of Zhejiang Province[20NDQN260YB] ; Natural Science Foundation of Zhejiang Province[LY20F020028] ; Key Research and Development Program of Zhejiang Province[2022C03148] ; Fundamental Research Funds for the Provincial Universities of Zhejiang[GB201901006]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Cybernetics ; Ergonomics
WOS记录号	WOS:000788321700001
出版者	TAYLOR & FRANCIS INC
引用统计	被引频次：3[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/18871
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhang, Lekai
作者单位	1.Zhejiang Univ Technol, Hanzghou, Peoples R China 2.Zhejiang Univ, Hangzhou, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Tang, Zhichuan,Hu, Yidan,Weng, Weining,et al. An Intelligent Shadow Play System With Multi-dimensional Interactive Perception[J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION,2022:13.
APA	Tang, Zhichuan,Hu, Yidan,Weng, Weining,Zhang, Lekai,Zhang, Lingtao,&Ying, Jichen.(2022).An Intelligent Shadow Play System With Multi-dimensional Interactive Perception.INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION,13.
MLA	Tang, Zhichuan,et al."An Intelligent Shadow Play System With Multi-dimensional Interactive Perception".INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2022):13.