Deep learning (DL) algorithms attain exceptional outcomes in several fields but face two principal challenges: generalization and explainability. Generalization and explainability are fundamental principles for effective and reliable DL models. Generalization denotes a model’s capacity to excel on unfamiliar data, whereas inadequate generalization, sometimes resulting from overfitting, might impede the model’s practical use. Generalization and explainability are crucial for implementing deep learning models in practical applications where the test distribution may differ from the training distribution. Explainability pertains to the necessity for transparent and interpretable models, which is essential for trust and accountability, particularly in sensitive domains such as healthcare and finance. The opacity of decision-making processes in deep learning models constrains their use in critical applications. This chapter presents the issues of generalization and explainability in deep learning, emphasizing the key factors that affect them, the challenges involved, techniques to enhance both, and the current progress in the field.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Problem of Generalization and Explainability in Deep Learning Algorithms

  • Rafiya Jan,
  • Ahsan Hussain

摘要

Deep learning (DL) algorithms attain exceptional outcomes in several fields but face two principal challenges: generalization and explainability. Generalization and explainability are fundamental principles for effective and reliable DL models. Generalization denotes a model’s capacity to excel on unfamiliar data, whereas inadequate generalization, sometimes resulting from overfitting, might impede the model’s practical use. Generalization and explainability are crucial for implementing deep learning models in practical applications where the test distribution may differ from the training distribution. Explainability pertains to the necessity for transparent and interpretable models, which is essential for trust and accountability, particularly in sensitive domains such as healthcare and finance. The opacity of decision-making processes in deep learning models constrains their use in critical applications. This chapter presents the issues of generalization and explainability in deep learning, emphasizing the key factors that affect them, the challenges involved, techniques to enhance both, and the current progress in the field.