Motion-Inspired Real-Time Garment Synthesis with Temporal-Consistency

doi:10.1007/s11390-022-1887-1

	Motion-Inspired Real-Time Garment Synthesis with Temporal-Consistency
	Wei, Yu-Kun 1; Shi, Min 1; Feng, Wen-Ke 1; Zhu, Deng-Ming 2; Mao, Tian-Lu 2
	2023-12-01
发表期刊	JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
ISSN	1000-9000
卷号	38 期号:6 页码:1356-1368
摘要	Synthesizing garment dynamics according to body motions is a vital technique in computer graphics. Physics-based simulation depends on an accurate model of the law of kinetics of cloth, which is time-consuming, hard to implement, and complex to control. Existing data-driven approaches either lack temporal consistency, or fail to handle garments that are different from body topology. In this paper, we present a motion-inspired real-time garment synthesis workflow that enables high-level control of garment shape. Given a sequence of body motions, our workflow is able to generate corresponding garment dynamics with both spatial and temporal coherence. To that end, we develop a transformerbased garment synthesis network to learn the mapping from body motions to garment dynamics. Frame-level attention is employed to capture the dependency of garments and body motions. Moreover, a post-processing procedure is further taken to perform penetration removal and auto-texturing. Then, textured clothing animation that is collision-free and temporally-consistent is generated. We quantitatively and qualitatively evaluated our proposed workflow from different aspects. Extensive experiments demonstrate that our network is able to deliver clothing dynamics which retain the wrinkles from the physics-based simulation, while running 1 000 times faster. Besides, our workflow achieved superior synthesis performance compared with alternative approaches. To stimulate further research in this direction, our code will be publicly available soon.
关键词	clothing animation computer graphics transformer temporal consistency
DOI	10.1007/s11390-022-1887-1
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61972379]
WOS研究方向	Computer Science
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Software Engineering
WOS记录号	WOS:001154653300007
出版者	SPRINGER SINGAPORE PTE LTD
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/38366
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Shi, Min
作者单位	1.North China Elect Power Univ, Sch Control & Comp Engn, Beijing 102206, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Wei, Yu-Kun,Shi, Min,Feng, Wen-Ke,et al. Motion-Inspired Real-Time Garment Synthesis with Temporal-Consistency[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,2023,38(6):1356-1368.
APA	Wei, Yu-Kun,Shi, Min,Feng, Wen-Ke,Zhu, Deng-Ming,&Mao, Tian-Lu.(2023).Motion-Inspired Real-Time Garment Synthesis with Temporal-Consistency.JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,38(6),1356-1368.
MLA	Wei, Yu-Kun,et al."Motion-Inspired Real-Time Garment Synthesis with Temporal-Consistency".JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 38.6(2023):1356-1368.