A shared augmented virtual environment for real-time mixed reality applications

doi:10.1002/cav.1805

	A shared augmented virtual environment for real-time mixed reality applications
	Zhu, Yu 1,2,3; Li, Shiying 2; Luo, Xi 2; Zhu, Kang 1,2; Fu, Qiang 2; Chen, Xilin 4; Gong, Huixing 5; Yu, Jingyi 2
	2018-09-01
发表期刊	COMPUTER ANIMATION AND VIRTUAL WORLDS
ISSN	1546-4261
卷号	29 期号:5 页码:14
摘要	Headsets for virtual reality such as head-mounted displays have become ubiquitous and bring immersive experiences to individual users. People who stand outside the virtual world may want to share the same scenes that are shown on the screen of the headset. It is therefore of great importance to merge real and virtual worlds into the same environment, where physical and virtual objects exist simultaneously and interact in real time. We propose shared augmented virtual environment (SAVE), a mixed reality (MR) system that overlays the virtual world with real objects captured by a Kinect depth camera. We refine the depth map and exploit a Graphics Processing Unit (GPU) based natural image matting method to obtain the real objects from cluttered scenes. In the synthetic MR world, we can render real and virtual objects in real time and handle the depth from both worlds properly. The advantage of our system is that we connect the virtual and real worlds with a bridge controller mounted on the Kinect and need to calibrate the whole system only once before use. Our results demonstrate that the proposed SAVE system is able to create high-quality 1080p live MR footage, enabling realistic virtual experiences to be shared among a number of people in potential applications such as education, design, and entertainment.
关键词	calibration Kinect mixed reality natural image matting real time
DOI	10.1002/cav.1805
收录类别	SCI
语种	英语
资助项目	Science and Technology Commission of Shanghai Municipality[17XD1402900] ; Science and Technology Commission of Shanghai Municipality[17JC1403800]
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:000446555300001
出版者	WILEY
引用统计	被引频次：3[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/4848
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Yu, Jingyi
作者单位	1.Chinese Acad Sci, Shanghai Inst Microsyst & Informat, Beijing, Peoples R China 2.ShanghaiTech Univ, Shanghai, Peoples R China 3.Univ Chinese Acad Sci, Beijing, Peoples R China 4.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 5.Chinese Acad Sci, Shanghai Inst Tech Phys, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Zhu, Yu,Li, Shiying,Luo, Xi,et al. A shared augmented virtual environment for real-time mixed reality applications[J]. COMPUTER ANIMATION AND VIRTUAL WORLDS,2018,29(5):14.
APA	Zhu, Yu.,Li, Shiying.,Luo, Xi.,Zhu, Kang.,Fu, Qiang.,...&Yu, Jingyi.(2018).A shared augmented virtual environment for real-time mixed reality applications.COMPUTER ANIMATION AND VIRTUAL WORLDS,29(5),14.
MLA	Zhu, Yu,et al."A shared augmented virtual environment for real-time mixed reality applications".COMPUTER ANIMATION AND VIRTUAL WORLDS 29.5(2018):14.