Edge Intelligence via Model Inference
摘要
Chapters 2 – 5 focus on efficient training of EI models. Needless to say, real-time inference at the edge can be equally critical for enabling high-quality edge intelligence service deployment. In this chapter, we discuss the DNN model inference at the edge, including the architectures, key performance indicators, enabling techniques and existing systems and frameworks.