A Chinese sign language recognition system based on SOFM/SRN/HMM

doi:10.1016/j.patcog.2004.04.008

	A Chinese sign language recognition system based on SOFM/SRN/HMM
	Gao, W ; Fang, GL ; Zhao, DB ; Chen, YQ
	2004-12-01
发表期刊	PATTERN RECOGNITION
ISSN	0031-3203
卷号	37 期号:12 页码:2389-2402
摘要	In sign language recognition (SLR), the major challenges now are developing methods that solve signer-independent continuous sign problems. In this paper, SOFM/HMM is first presented for modeling signer-independent isolated signs. The proposed method uses the self-organizing feature maps (SOFM) as different signers' feature extractor for continuous hidden Markov models (HMM) so as to transform input signs into significant and low-dimensional representations that can be well modeled by the emission probabilities of HMM. Based on these isolated sign models, a SOFM/SRN/HMM model is then proposed for signer-independent continuous SLR. This model applies the improved simple recurrent network (SRN) to segment continuous sign language in terms of transformed SOFM representations, and the outputs of SRN are taken as the HMM states in which the lattice Viterbi algorithm is employed to search the best matched word sequence. Experimental results demonstrate that the proposed system has better performance compared with conventional HMM system and obtains a word recognition rate of 82.9% over a 5113-sign vocabulary and an accuracy of 86.3% for signer-independent continuous SLR. (C) 2004 Pattern Recognition Society. Published by Elsevier Ltd. All rights reserved.
关键词	sign language recognition Chinese sign language hidden Markov model self-organizing feature map simple recurrent network
DOI	10.1016/j.patcog.2004.04.008
收录类别	SCI
语种	英语
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000223991800010
出版者	PERGAMON-ELSEVIER SCIENCE LTD
引用统计	被引频次：97[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/13785
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Fang, GL
作者单位	1.Harbin Inst Technol, Dept Comp Sci & Engn, Harbin 150001, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China
推荐引用方式 GB/T 7714	Gao, W,Fang, GL,Zhao, DB,et al. A Chinese sign language recognition system based on SOFM/SRN/HMM[J]. PATTERN RECOGNITION,2004,37(12):2389-2402.
APA	Gao, W,Fang, GL,Zhao, DB,&Chen, YQ.(2004).A Chinese sign language recognition system based on SOFM/SRN/HMM.PATTERN RECOGNITION,37(12),2389-2402.
MLA	Gao, W,et al."A Chinese sign language recognition system based on SOFM/SRN/HMM".PATTERN RECOGNITION 37.12(2004):2389-2402.