This paper presents a hybrid architecture neural network accelerator based on FPGA and ASIC. The proposed accelerator is employed to expedite the inference process for CNN and MHA modules, accommodating data of varying accuracy. Its application extends to image-to-sequence models. The paper also puts forward a controller with an appropriate instruction set to drive the data flow, and discusses how to configure the accelerator in coordination with a particular model. The efficacy of the proposed accelerator is demonstrated through experimental evaluations, which yield acceleration ratios of at least 3.0x for a single layer and approximately 1.5x for an entire network.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Hybrid Architecture Accelerator Co-design for DNN on FPGA and ASIC

  • Honghao Zhang,
  • Ruidong Li,
  • Ji Zhong,
  • Meizhou Gao,
  • Xinyi Le

摘要

This paper presents a hybrid architecture neural network accelerator based on FPGA and ASIC. The proposed accelerator is employed to expedite the inference process for CNN and MHA modules, accommodating data of varying accuracy. Its application extends to image-to-sequence models. The paper also puts forward a controller with an appropriate instruction set to drive the data flow, and discusses how to configure the accelerator in coordination with a particular model. The efficacy of the proposed accelerator is demonstrated through experimental evaluations, which yield acceleration ratios of at least 3.0x for a single layer and approximately 1.5x for an entire network.