Neural Architecture Search (NAS) and extreme quantization tackle TinyML efficiency from complementary angles: NAS targets accuracy, full binarization aims at lowering the computational load of deep architectures. The recently introduced NAS‑BNN framework combines NAS with binarization to automate the discovery of high‑accuracy and low‑compute Binary Neural Networks (BNNs). Targeting person‑presence detection, we train a five‑stage supernet on 414 k images from the new WakeVision (WV) benchmark and perform an evolutionary search over 250 sub‑architectures. The resulting Pareto front spans 3–8 million operations (OPs). Our top model achieves 86.69% Top‑1 accuracy at 6.03 M OPs, surpassing the MobileNetV2 0.25 and MCU‑Net‑320 kB benchmarks while requiring 12–18 × less compute. Even the smallest network discovered (only 3.84 M OPs) achieves 79% accuracy. These findings demonstrate that NAS‑discovered BNNs can match or exceed state‑of‑the‑art accuracy while keeping a very low amount of operations, and establish WV as a realistic large‑scale benchmark for TinyML research.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Exploring Neural Architecture Search (NAS) for Binary Neural Networks (BNNs) in the New WakeVision

  • Alessandro Pighetti,
  • Francesco Bellotti,
  • Sepehr Mohammady,
  • Luca Lazzaroni,
  • Hadi Ballout,
  • Riccardo Berta

摘要

Neural Architecture Search (NAS) and extreme quantization tackle TinyML efficiency from complementary angles: NAS targets accuracy, full binarization aims at lowering the computational load of deep architectures. The recently introduced NAS‑BNN framework combines NAS with binarization to automate the discovery of high‑accuracy and low‑compute Binary Neural Networks (BNNs). Targeting person‑presence detection, we train a five‑stage supernet on 414 k images from the new WakeVision (WV) benchmark and perform an evolutionary search over 250 sub‑architectures. The resulting Pareto front spans 3–8 million operations (OPs). Our top model achieves 86.69% Top‑1 accuracy at 6.03 M OPs, surpassing the MobileNetV2 0.25 and MCU‑Net‑320 kB benchmarks while requiring 12–18 × less compute. Even the smallest network discovered (only 3.84 M OPs) achieves 79% accuracy. These findings demonstrate that NAS‑discovered BNNs can match or exceed state‑of‑the‑art accuracy while keeping a very low amount of operations, and establish WV as a realistic large‑scale benchmark for TinyML research.