Cooperative Edge Model Inference over Heterogeneous Edge Devices
摘要
In this chapter, we present CoEdge (Cooperative Edge), a runtime system that orchestrates cooperative DNN inference over multiple heterogeneous edge devices. CoEdge does not apply any structural modifications or tuning requirements to the given DNN model, and does not sacrifice model accuracy as it reserves input data and model parameters of the given DNN model. CoEdge employs parallel workflow in which the input is split initially and the execution is parallelized on multiple devices at runtime.