Model compression plays a crucial role in enabling the efficient and scalable deployment of deep learning models within environments constrained by latency and energy limits. This survey presents a unified taxonomy and introduces a deployment-aware framework that systematically organizes key compression strategies, including pruning, quantization, knowledge distillation, and low-rank decomposition, across the various stages of the training-to-deployment process. By combining both algorithmic and hardware perspectives, it addresses real-world deployment challenges such as latency variability across accelerators, restricted memory capacity, and irregular execution patterns, helping to achieve balanced trade-offs among compression ratio, accuracy, and runtime efficiency. Furthermore, by consolidating reproducible methodologies, standardized evaluation protocols, and benchmarking practices, this work provides a clear foundation and practical roadmap for researchers and practitioners to design, assess, and deploy compression methods effectively across diverse neural architectures in vision, language, speech, and multimodal domains. It emphasizes actionable guidance supported by theoretical understanding, aiming to bridge the gap between experimental efficiency improvements and the practical constraints of real-world deployment.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Neural Network Compression: Methods, Metrics, Applications and Challenges

  • B. B. Vivek,
  • Rajashree Shettar

摘要

Model compression plays a crucial role in enabling the efficient and scalable deployment of deep learning models within environments constrained by latency and energy limits. This survey presents a unified taxonomy and introduces a deployment-aware framework that systematically organizes key compression strategies, including pruning, quantization, knowledge distillation, and low-rank decomposition, across the various stages of the training-to-deployment process. By combining both algorithmic and hardware perspectives, it addresses real-world deployment challenges such as latency variability across accelerators, restricted memory capacity, and irregular execution patterns, helping to achieve balanced trade-offs among compression ratio, accuracy, and runtime efficiency. Furthermore, by consolidating reproducible methodologies, standardized evaluation protocols, and benchmarking practices, this work provides a clear foundation and practical roadmap for researchers and practitioners to design, assess, and deploy compression methods effectively across diverse neural architectures in vision, language, speech, and multimodal domains. It emphasizes actionable guidance supported by theoretical understanding, aiming to bridge the gap between experimental efficiency improvements and the practical constraints of real-world deployment.