Base on Voice Signal Multimodal Deep Learning to Establish an Auto-Pulmonary Function Assessment Model for Post-Thoracic Surgery Patient
摘要
Lung cancer remains the number one cancer in Taiwan, and thoracoscopic lung surgery is the main treatment method. However, this surgery severely impairs respiratory function, resulting in a high incidence of pulmonary complications (19% – 59%). Preventive measures include deep breathing exercises, coughing, and close monitoring of respiratory function, which are critical to reducing complications and ensuring a smooth recovery. The study conducted in collaboration with Hsinchu MacKay Memorial Hospital, involved 70 participants and collected 223 sound samples using an iPhone microphone to assess lung function before and after training. Using STFT, MFCC and CNN/VGG19 models, the STFT-VGG19 model achieved the highest accuracy (96.3%) in identifying postoperative lung function status. The goal of the study is to develop an automated assessment system to increase the effectiveness of postoperative pulmonary rehabilitation and improve patient outcomes.