A Visual-Cortex-Mimetic Tiny Neuromorphic Vision Processor Based on Reconfigurable Cortical Neuron Unit

doi:10.1109/TCSII.2025.3571598

	A Visual-Cortex-Mimetic Tiny Neuromorphic Vision Processor Based on Reconfigurable Cortical Neuron Unit
	Chen, Mingju 1; He, Junxian 2; Wang, Haibing 2; Wang, Tengxiao 2; Gao, Haoran 2; Liu, Liyuan 3; Wang, Ying 4; Shi, Cong 2
	2025-07-01
发表期刊	IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS
ISSN	1549-7747
卷号	72 期号:7 页码:943-947
摘要	Edge visual systems demand high energy-efficiency vision processors like neuromorphic hardware leveraging spike-based computations. But their disability of directly interacting with non-spike information in the real world requests additional components to execute image pre-processing, spike encoding and decoding, severely increasing overall system cost, energy and latency. To overcome such drawback, this brief proposes a tiny neuromorphic vision processor which emulates functional regions along the ventral pathway in the visual cortex. It performs image pre-processing, spike encoding, spike-based feature extraction and classification, spike decoding as well as decision making on a single chip. To reduce hardware resources, our processor builds on a reconfigurable cortical neuron (RCN) unit, which runs different neuron models for different visual cortex regions in a time-multiplexing fashion. It also embeds biological learning circuits to better adapt the processor to dynamic edge scenarios. Our neuromorphic processor was prototyped on a very-low-cost Xilinx Zynq-7010 device. On the MNIST dataset, it exhibited a real-time inference speed of 696 frame/s covering image pre-processing to final decision and a high on-chip learning accuracy of 97.12%, while only delivering a power consumption as low as 118 mW.
关键词	Neurons Neuromorphics Visualization Feature extraction Data models Image edge detection Brain modeling Retina Costs Synapses Neuromorphic processor spiking neural network visual cortex on-chip learning STDP
DOI	10.1109/TCSII.2025.3571598
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62334008] ; National Natural Science Foundation of China[92464103] ; Opening Fund of Artificial Intelligence Key Laboratory of Sichuan Province[2023RYY07]
WOS研究方向	Engineering
WOS类目	Engineering, Electrical & Electronic
WOS记录号	WOS:001522054500015
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/42017
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Shi, Cong
作者单位	1.Sichuan Univ Sci & Engn, Artificial Intelligence Key Lab Sichuan Prov, Yibin 643000, Sichuan, Peoples R China 2.Chongqing Univ, Sch Microelect & Commun Engn, Chongqing 400044, Peoples R China 3.Chinese Acad Sci, Inst Semicond, State Key Lab Superlatt & Microstruct, Beijing 100083, Peoples R China 4.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Chen, Mingju,He, Junxian,Wang, Haibing,et al. A Visual-Cortex-Mimetic Tiny Neuromorphic Vision Processor Based on Reconfigurable Cortical Neuron Unit[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS,2025,72(7):943-947.
APA	Chen, Mingju.,He, Junxian.,Wang, Haibing.,Wang, Tengxiao.,Gao, Haoran.,...&Shi, Cong.(2025).A Visual-Cortex-Mimetic Tiny Neuromorphic Vision Processor Based on Reconfigurable Cortical Neuron Unit.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS,72(7),943-947.
MLA	Chen, Mingju,et al."A Visual-Cortex-Mimetic Tiny Neuromorphic Vision Processor Based on Reconfigurable Cortical Neuron Unit".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS 72.7(2025):943-947.