Due to the limited memory and computing resources in low performance edge computing, traditional large models are difficult to meet the high demand for latency in computational tasks. This paper builds upon the Pose ResNet18 Body model for human pose estimation, and analyses the hardware limitations of the low performance embedded device Jetson Orin Nano 4G, including limited memory and processing capability, as well as strict requirements for energy consumption and power. Then two model compression methods are proposed to address these limitations: compression based on INT8 quantization and compression based on weight sparsity pruning. Finally, the compressed models are validated on the Jetson Orin Nano 4G platform, and experimental results demonstrate significant advantages in inference time, storage space, power consumption, while maintaining the required prediction accuracy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Model Compression in Low Performance Edge Computing

  • Jingxuan Zhang,
  • Yue Li,
  • Jiaxun Wen,
  • Kun Tian,
  • Mingze Zhao

摘要

Due to the limited memory and computing resources in low performance edge computing, traditional large models are difficult to meet the high demand for latency in computational tasks. This paper builds upon the Pose ResNet18 Body model for human pose estimation, and analyses the hardware limitations of the low performance embedded device Jetson Orin Nano 4G, including limited memory and processing capability, as well as strict requirements for energy consumption and power. Then two model compression methods are proposed to address these limitations: compression based on INT8 quantization and compression based on weight sparsity pruning. Finally, the compressed models are validated on the Jetson Orin Nano 4G platform, and experimental results demonstrate significant advantages in inference time, storage space, power consumption, while maintaining the required prediction accuracy.