Chapters 2 – 5 focus on efficient training of EI models. Needless to say, real-time inference at the edge can be equally critical for enabling high-quality edge intelligence service deployment. In this chapter, we discuss the DNN model inference at the edge, including the architectures, key performance indicators, enabling techniques and existing systems and frameworks.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Edge Intelligence via Model Inference

  • Sen Lin,
  • Zhi Zhou,
  • Zhaofeng Zhang,
  • Xu Chen,
  • Junshan Zhang

摘要

Chapters 2 – 5 focus on efficient training of EI models. Needless to say, real-time inference at the edge can be equally critical for enabling high-quality edge intelligence service deployment. In this chapter, we discuss the DNN model inference at the edge, including the architectures, key performance indicators, enabling techniques and existing systems and frameworks.