Residential Collegefalse
Status已發表Published
FLEX-CIM: A Flexible Kernel Size 1-GHz 181.6-TOPS/W 25.63-TOPS/mm2 Analog Compute-in-Memory Macro
Fu, Yuzhao1; Yu, Wei Han1; Un, Ka Fai1; Chan, Chi Hang1; Zhu, Yan1; Zhang, Minglei1; Martins, Rui P.1; Mak, Pui In1,2
2024-04-15
Source PublicationIEEE Journal of Solid-State Circuits
ISSN0018-9200
Abstract

Compute-in-memory (CIM) is a promising approach for realizing energy-efficient convolutional neural network (CNN) accelerators. Previous CIM works demonstrated a high peak energy efficiency of over 100 TOPS/W, with larger fabrics of 1000+ channels. Yet, they typically suffer from low utilization for small CNN layers (e.g., ∼9% for ResNet-32). It penalizes their average energy efficiency, throughput density, and effective memory size by the utilization rate. In addition, the analog-to-digital converter (ADC) occupies most of their computing time (∼90%), further hindering the CIM’s throughput. This work presents an FLEX-CIM fabricated under 28-nm CMOS featuring: 1) an analog partial sum (APS) circuit to enable a flexible CIM Kernel size; 2) an overclocked fast multiply–accumulate array (FMA) to boost the throughput; and 3) an adaptive-resolution ADC to enhance the throughput and energy efficiency. The achieved utilization is 99.2% on ResNet-32. Under 4-bit MAC precision, the peak energy efficiency is 181.6 TOPS/W, and the peak throughput density is 25.63 TOPS/mm2 .

KeywordAnalog Partial Sum (Aps) Compute-in-memory (Cim) Convolutional Neural Network (Cnn) Flexible Kernel Size Utilization
DOI10.1109/JSSC.2024.3386192
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering
WOS SubjectEngineering, Electrical & Electronic
WOS IDWOS:001205844900001
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85190730674
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionTHE STATE KEY LABORATORY OF ANALOG AND MIXED-SIGNAL VLSI (UNIVERSITY OF MACAU)
Faculty of Science and Technology
INSTITUTE OF MICROELECTRONICS
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING
Corresponding AuthorYu, Wei Han
Affiliation1.the Faculty of Science and Technology, and the Department of Electrical and Computer Engineering, State Key Laboratory of Analog and Mixed-Signal VLSI, the Institute of Microelectronics, University of Macau, Macau, China
2.Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal
First Author AffilicationFaculty of Science and Technology
Corresponding Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Fu, Yuzhao,Yu, Wei Han,Un, Ka Fai,et al. FLEX-CIM: A Flexible Kernel Size 1-GHz 181.6-TOPS/W 25.63-TOPS/mm2 Analog Compute-in-Memory Macro[J]. IEEE Journal of Solid-State Circuits, 2024.
APA Fu, Yuzhao., Yu, Wei Han., Un, Ka Fai., Chan, Chi Hang., Zhu, Yan., Zhang, Minglei., Martins, Rui P.., & Mak, Pui In (2024). FLEX-CIM: A Flexible Kernel Size 1-GHz 181.6-TOPS/W 25.63-TOPS/mm2 Analog Compute-in-Memory Macro. IEEE Journal of Solid-State Circuits.
MLA Fu, Yuzhao,et al."FLEX-CIM: A Flexible Kernel Size 1-GHz 181.6-TOPS/W 25.63-TOPS/mm2 Analog Compute-in-Memory Macro".IEEE Journal of Solid-State Circuits (2024).
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Fu, Yuzhao]'s Articles
[Yu, Wei Han]'s Articles
[Un, Ka Fai]'s Articles
Baidu academic
Similar articles in Baidu academic
[Fu, Yuzhao]'s Articles
[Yu, Wei Han]'s Articles
[Un, Ka Fai]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Fu, Yuzhao]'s Articles
[Yu, Wei Han]'s Articles
[Un, Ka Fai]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.