Neural Architecture Search (NAS) methods have become essential for automating the design of deep neural networks. However, their high computational cost, particularly when training architectures from scratch, remains a significant limitation. This paper proposes an enhancement to the Quantum-Inspired Neural Architecture Search (Q-NAS) algorithm by integrating a dynamically adjustable pre-trained backbone into the search process. The proportion of backbone depth used is jointly optimized with the design of additional building blocks selected from a flexible set of operators. Experiments conducted on four MedMNIST datasets show that the proposed method improves search efficiency, reducing GPU time by up to 66% compared to the baseline. Furthermore, it achieves competitive or superior classification accuracy. Notably, on the PathMNIST dataset, the enhanced QNAS achieved a 3.45% improvement in accuracy over the baseline. These findings demonstrate the effectiveness of combining partial backbone utilization with evolutionary NAS techniques for efficient medical image classification.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhanced Quantum-Inspired Neural Architecture Search with Adaptive Pre-trained Backbone Integration

  • Diego Páez Ardila,
  • Thiago Medeiros Carvalho,
  • Santiago Vasquez,
  • Fabio Cardoso,
  • Karla Figueiredo,
  • Marley Vellasco

摘要

Neural Architecture Search (NAS) methods have become essential for automating the design of deep neural networks. However, their high computational cost, particularly when training architectures from scratch, remains a significant limitation. This paper proposes an enhancement to the Quantum-Inspired Neural Architecture Search (Q-NAS) algorithm by integrating a dynamically adjustable pre-trained backbone into the search process. The proportion of backbone depth used is jointly optimized with the design of additional building blocks selected from a flexible set of operators. Experiments conducted on four MedMNIST datasets show that the proposed method improves search efficiency, reducing GPU time by up to 66% compared to the baseline. Furthermore, it achieves competitive or superior classification accuracy. Notably, on the PathMNIST dataset, the enhanced QNAS achieved a 3.45% improvement in accuracy over the baseline. These findings demonstrate the effectiveness of combining partial backbone utilization with evolutionary NAS techniques for efficient medical image classification.