Fast and High-Accuracy Approximate MAC Unit Design for CNN Computing

doi:10.1109/LES.2021.3137335

	Fast and High-Accuracy Approximate MAC Unit Design for CNN Computing
	Xiao, Hang 1,2; Xu, Haobo 1,2; Chen, Xiaoming 1,2; Wang, Yujie 1,2; Han, Yinhe 1,2
	2022-09-01
发表期刊	IEEE EMBEDDED SYSTEMS LETTERS
ISSN	1943-0663
卷号	14 期号:3 页码:155-158
摘要	Multiply and accumulate (MAC) composed of a set of multipliers and one reduction dominates the latency and power of convolutional neural network (CNN) accelerators. Existing approximate multipliers reduce latency and power at a tolerable drop in accuracy, without considering the data distribution (implicitly assuming that data are uniformly distributed). This letter discloses that practical CNNs' activations and weights are usually Gaussian-like distributed, and the bits of quantized activations and weights are typically not with a probability of 0.5. Thus, we propose an approximate MAC unit design by taking into account the statistical features of input data, to achieve a balanced tradeoff among latency, power, and accuracy. The extensive experiments show that our proposed MAC unit design provides much higher accuracy than state-of-the-art approximate circuits, while the latency, area, and power are similar.
关键词	Approximate computing convolution neural network multiply and accumulate (MAC)
DOI	10.1109/LES.2021.3137335
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China (NSFC)[61834006] ; National Natural Science Foundation of China (NSFC)[62025404] ; National Natural Science Foundation of China (NSFC)[62122076] ; National Natural Science Foundation of China (NSFC)[62104229]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Software Engineering ; Engineering, Electrical & Electronic
WOS记录号	WOS:000848227900014
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：8[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/19443
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Chen, Xiaoming; Han, Yinhe
作者单位	1.Chinese Acad Sci, Res Ctr Intelligent Comp Syst, Inst Comp Technol, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
推荐引用方式 GB/T 7714	Xiao, Hang,Xu, Haobo,Chen, Xiaoming,et al. Fast and High-Accuracy Approximate MAC Unit Design for CNN Computing[J]. IEEE EMBEDDED SYSTEMS LETTERS,2022,14(3):155-158.
APA	Xiao, Hang,Xu, Haobo,Chen, Xiaoming,Wang, Yujie,&Han, Yinhe.(2022).Fast and High-Accuracy Approximate MAC Unit Design for CNN Computing.IEEE EMBEDDED SYSTEMS LETTERS,14(3),155-158.
MLA	Xiao, Hang,et al."Fast and High-Accuracy Approximate MAC Unit Design for CNN Computing".IEEE EMBEDDED SYSTEMS LETTERS 14.3(2022):155-158.