상세 보기
초록
As the DNN model becomes more complex, the number of parameters constituting the model increases and requires a large amount of computation. Recently, a quantization technique that reduces the memory of the model and enables efficient computation has been studied. In this paper, we propose Fake Single Precision Training (FST) to increase accuracy by using a high bit range for weight and a low bit range for activation output with a certain probability. FST improved the accuracy of the model by applying the features of Google's Quantization Aware Training and FaceBook's Quant Noise method.
키워드
Fake Single Precision Training; Qaunt Noise; Quantization Aware Training; Bit-Width; Efficient computation; Facebook; Fake single precision training; Google+; Large amounts; Qaunt noise; Quantisation; Quantization aware training; Single precision
- 제목
- Quantization training with two-level bit width
- 저자
- Kang, Hansung; Lee, Yongjoo; Cho, Dongbin; Lee, Jaeyoung; Kang, Mincheal; Kim, Younghoon; Seo, Jiwon
- 발행일
- 2022-02
- 유형
- Proceedings Paper
- 저널명
- 2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC)
- 페이지
- 1 ~ 4