Small Language Models in the Edge Network
摘要
This chapter focuses on SLMs in edge environments and explains how compression, distillation, quantization, and efficient decoding enable resource-aware models suitable for mobile and embedded platforms. It discusses how SLMs can inherit reasoning capability from larger teacher models while operating under strict constraints on memory, latency, and energy at the network edge. The chapter further examines enhancement strategies and parameter-efficient adaptation methods that allow SLMs to support personalized and privacy-preserving services on devices and edge nodes.