Unveil the Black-Box Model for Healthcare Explainable AI

Deep neural networks are nowadays widely applied in mission-critical systems such as medical devices, healthcare, medical imaging segmentation, self-driving cars, and military applications that have a direct influence on human beings. Despite their massive success, many of these techniques are subject to the “black box” issue. To overcome the issues of the black-box method, eXplainable AI (XAI) is introduced. XAI can provide detailed information about the model and decision-making. In this chapter, we conduct a survey of the recent trends in medical, healthcare, and other applications using XAI. We discuss the explanation from the user, then evaluation and measurement are conducted. A lot of attention is also paid to the use of different techniques of AI and XAI in the healthcare domain. We further discuss the issues and challenges. Because of this, the research suggests that XAI in healthcare is still a novel topic that needs to be researched further in the future.