Neural Architecture Search (NAS) allows the user to design the most appropriate network architecture for specific assignments automatically. Outsourced NAS, as one of the applications in the Deep-Learning-as-a-Service paradigm, provides APIs for the resource-limited clients to delegate the architecture design task to a remote server. Despite its merits, the outsourced NAS poses significant concerns about the computation integrity and privacy. In this work, we propose \(\textsf{zkNAS}\) , a secure and efficient zero-knowledge NAS scheme for the outsourced NAS. Unlike prior works, \(\textsf{zkNAS}\)  enables the server to prove the integrity of the NAS computation while preserving the privacy of the NAS strategies and hyperparameters. \(\textsf{zkNAS}\)  is established on zero-knowledge proof (ZKP) protocols and a ZK-friendly NAS algorithm. The core idea is to utilize the information contained in the feature maps during forward propagation as zero-cost proxies, thus significantly reducing computation overhead. Specifically, we adopt three indicators based on feature maps and establish the ZKP-friendly NAS algorithm. Based on the system design, we design concrete ways to efficiently transform NAS computation into arithmetic circuits. We fully implement the design, which is significantly more efficient than the baselines on all evaluation metrics.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

zkNAS: Secure and Efficient Outsourced-NAS with Zero-Cost Proxies

  • Haodi Wang,
  • Danyang Zhang,
  • Tangyu Jiang,
  • Danyang Wang,
  • Fangda Guo,
  • Jing Wang,
  • Yu Guo

摘要

Neural Architecture Search (NAS) allows the user to design the most appropriate network architecture for specific assignments automatically. Outsourced NAS, as one of the applications in the Deep-Learning-as-a-Service paradigm, provides APIs for the resource-limited clients to delegate the architecture design task to a remote server. Despite its merits, the outsourced NAS poses significant concerns about the computation integrity and privacy. In this work, we propose \(\textsf{zkNAS}\) , a secure and efficient zero-knowledge NAS scheme for the outsourced NAS. Unlike prior works, \(\textsf{zkNAS}\)  enables the server to prove the integrity of the NAS computation while preserving the privacy of the NAS strategies and hyperparameters. \(\textsf{zkNAS}\)  is established on zero-knowledge proof (ZKP) protocols and a ZK-friendly NAS algorithm. The core idea is to utilize the information contained in the feature maps during forward propagation as zero-cost proxies, thus significantly reducing computation overhead. Specifically, we adopt three indicators based on feature maps and establish the ZKP-friendly NAS algorithm. Based on the system design, we design concrete ways to efficiently transform NAS computation into arithmetic circuits. We fully implement the design, which is significantly more efficient than the baselines on all evaluation metrics.