A deep neural network for operator learning enhanced by attention and gating mechanisms for long-time forecasting of tumor growth
摘要
Forecasting tumor progression and assessing the uncertainty of predictions play a crucial role in clinical settings, especially for determining disease outlook and making informed decisions about treatment approaches. In this work, we propose TGM-ONets, a deep neural operator learning (PI-DeepONet) based computational framework, which combines bioimaging and tumor growth modeling (TGM) for enhanced prediction of tumor growth. Deep neural operators have recently emerged as a powerful tool for learning the solution maps between the function spaces, and they have demonstrated their generalization capability in making predictions based on unseen input instances once trained. Incorporating the physics laws into the loss function of the deep neural operator can significantly reduce the amount of the training data. The novelties of the design of TGM-ONets include the employment of a convolutional block attention module (CBAM) and a gating mechanism (i.e., mixture of experts (MoE)) to extract the features of the input images. Our results show that the TGM-ONets not only can capture the detailed morphological characteristics of the mild and aggressive tumors within and outside the training domain but also can be used to predict the long-term dynamics of both mild and aggressive tumor growth for up to 6 months with a maximum error of less than 6.7