Ultra-low Precision Multiplication-free Training for Deep Neural Networks

Abstract

Figure 1. Energy-Accuracy joint comparison. "Accuracy" refers to the accuracy results of training ResNet50 on ImageNet from scratch. "Energy Consumption" refers to the energy consumption of MACs for training ResNet50 on ImageNet at one iteration. Note that INQ and ShiftCNN apply their method to the pre-train models, so their training consumption is the same as full-precision training.