Automatic and real-time green screen keying

doi:10.1007/s00371-022-02542-x

	Automatic and real-time green screen keying
	Jin, Yue 1; Li, Zhaoxin 1; Zhu, Dengming 1; Shi, Min 2; Wang, Zhaoqi 1
	2022-06-20
发表期刊	VISUAL COMPUTER
ISSN	0178-2789
页码	13
摘要	Green screen keying has always been an essential and fundamental part of film and television special effects. In the actual shooting process, captured green screen images vary significantly due to the comprehensive influence of lighting, shooting angle, green cloth material, characters, etc. In order to obtain visually pleasing effects, traditional methods usually require professionals to adjust the corresponding parameters with lots of workload for different images, which is inefficient. Meanwhile, there are tedious steps in dealing with the green spill problem. In this paper, we propose a deep learning-based green screen keying method which is automatic, effective, and real-time. Firstly, we create a green screen dataset that contains not only alpha and foreground maps but also samples with green spill phenomenon and a large number of distinct green screen backgrounds. Secondly, we propose an end-to-end network that can automatically tackle green screen keying and green spill removal problems. Our method only takes a single image as input without user interaction and estimates alpha and foreground simultaneously. Extensive experiments clearly demonstrate the superiority of our proposed method. Moreover, our method achieves approximately 75fps on 720P videos (1280 x 720) and 25fps on 1080P videos (1920 x 1080), which can be considered real-time for many applications.
关键词	Green screen keying Green spill removal Green screen dataset Real-time
DOI	10.1007/s00371-022-02542-x
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Program of China[2020YFB1710400] ; National Natural Science Foundation of China[62172392] ; National Natural Science Foundation of China[61702482] ; Scientic Research Instrument and Equipment Development Project of Chinese Academy of Sciences[YJKYYQ20190055]
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:000813592000002
出版者	SPRINGER
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/19517
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Li, Zhaoxin
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 2.North China Elect Power Univ, Sch Control & Comp Engn, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Jin, Yue,Li, Zhaoxin,Zhu, Dengming,et al. Automatic and real-time green screen keying[J]. VISUAL COMPUTER,2022:13.
APA	Jin, Yue,Li, Zhaoxin,Zhu, Dengming,Shi, Min,&Wang, Zhaoqi.(2022).Automatic and real-time green screen keying.VISUAL COMPUTER,13.
MLA	Jin, Yue,et al."Automatic and real-time green screen keying".VISUAL COMPUTER (2022):13.