<p>The use of optimization algorithms is essential to train neural networks effectively. The usage of a combination of two different optimizers is proposed in this method that, used together, can perform single optimizers in various problems. The objective of this study is to develop a comprehensive framework that combines meta-optimization techniques with traditional optimization methods to enhance performance metrics such as convergence speed, solution quality, and robustness against local minima. The researcher presents ATMO (Adaptive Meta Optimizers), recent deep neural network (DNN) models that are combined with a new optimizer that combines two different optimizers simultaneously. Meta-optimizer considers all of their contributions at once, rather than trying to enhance each one separately. Using a wide range of techniques, DNNs have been the subject of numerous investigations on text and image categorization. Results from these tests demonstrated that the suggested Adaptive Meta Optimizer outperforms individual optimizers. These experiments show that adequate training is achieved by considering a variety of factors such as Keras standard learning rate and convergence, and degradation on the CIFAR-100, CIFAR-10, and MNIST datasets, and the results are obtained using Python.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Meta-optimization for improved efficiency: an integrated methodology

  • Anjani Kumar Singha,
  • Gaurav Yadav,
  • Vijay Hasanpuri,
  • Rajiv Ranjan Patel

摘要

The use of optimization algorithms is essential to train neural networks effectively. The usage of a combination of two different optimizers is proposed in this method that, used together, can perform single optimizers in various problems. The objective of this study is to develop a comprehensive framework that combines meta-optimization techniques with traditional optimization methods to enhance performance metrics such as convergence speed, solution quality, and robustness against local minima. The researcher presents ATMO (Adaptive Meta Optimizers), recent deep neural network (DNN) models that are combined with a new optimizer that combines two different optimizers simultaneously. Meta-optimizer considers all of their contributions at once, rather than trying to enhance each one separately. Using a wide range of techniques, DNNs have been the subject of numerous investigations on text and image categorization. Results from these tests demonstrated that the suggested Adaptive Meta Optimizer outperforms individual optimizers. These experiments show that adequate training is achieved by considering a variety of factors such as Keras standard learning rate and convergence, and degradation on the CIFAR-100, CIFAR-10, and MNIST datasets, and the results are obtained using Python.