Specific Emitter Identification (SEI) distinguishes radiation sources by extracting unique signal features. However, when deploying such models, the large number of parameters often leads to excessive memory usage, hindering practical application. To address this issue, we propose a dynamic adaptive quadratic quantization scaling algorithm, which treats the scaling factor as a trainable parameter and dynamically optimizes quantization boundaries during training. Additionally, we employ a quantile Huber loss function to reduce the sensitivity of quantized weights to quantization errors, enhancing model robustness. A regularization term is also introduced to facilitate optimizer convergence. Experimental results demonstrate that our approach achieves low-bit-width model compression with an accuracy loss of less than 2%, closely matching the performance of the original model. This method significantly reduces memory consumption, compresses model size, and maintains recognition accuracy, enabling efficient inference on resource-constrained devices.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Q-LOQ: Quantile-Optimized Loss for Low-bit Quantization

  • Yanan Liu,
  • Zheng Dou,
  • Boyang Song,
  • Sicheng Zhang,
  • Qiao Tian

摘要

Specific Emitter Identification (SEI) distinguishes radiation sources by extracting unique signal features. However, when deploying such models, the large number of parameters often leads to excessive memory usage, hindering practical application. To address this issue, we propose a dynamic adaptive quadratic quantization scaling algorithm, which treats the scaling factor as a trainable parameter and dynamically optimizes quantization boundaries during training. Additionally, we employ a quantile Huber loss function to reduce the sensitivity of quantized weights to quantization errors, enhancing model robustness. A regularization term is also introduced to facilitate optimizer convergence. Experimental results demonstrate that our approach achieves low-bit-width model compression with an accuracy loss of less than 2%, closely matching the performance of the original model. This method significantly reduces memory consumption, compresses model size, and maintains recognition accuracy, enabling efficient inference on resource-constrained devices.