结合峰度正则化优化存算一体化芯片性能的方法
Co-optimize the Performance of Computing-in-Memory Chips with the Kurtosis Regularization
-
摘要: 存算一体化架构通过采用模拟计算,能够极大地提升深度神经网络推理的计算能效。然而,模拟计算的有限精度和神经网络训练平台的高精度之间存在一定的差异,限制了算法在存算一体化芯片的部署。通过在神经网络训练中采用峰度正则化的方式进行算法-电路联合优化,可以增大神经网络权重数据的信息熵,从而充分利用忆阻器单元的模拟特性。在基于可编程线性忆阻器(Programmable linear RAM, PLRAM)的存算一体片上系统中,针对关键词识别任务(6个分类),引入这一方法最终达到约97%的识别准确度,提升识别准确度约4%。Abstract: The computing-in-memory architecture can greatly improve the computational energy efficiency of deep neural network by analog computation. However, there is a difference between the limited precision of analog computation and the high precision of neural network training platform, which limits the deployment of the algorithm in the computing-in-memory chips. By using the algorithm-chip joint optimization of kurtosis regularization, the information entropy of neural network weight data can be increased. In this way, the memristor accuracy can be fully exploit. The computing-in-memory chips system is based on programmable linear memristor(PLRAM). In this system, the introduction of kurtosis regularization can improve the recognition accuracy by about 4%, and achieve about 97% recognition accuracy for keyword recognition tasks(6 categories).