Multimodal Machine Learning Analysis of fNIRS Signals Using LSTM and KNN Models for Cognitive States and Brain Activation Patterns Prediction
摘要
In this study, the authors focused on analyzing fNIRS (functional near-infrared spectroscopy) signals with the use of a multimodal machine learning scheme to predict cognitive states and brain activation patterns. The data set consists of fNIRS recordings from 10 selected channels over a period of 1000 s, with a focus on the parameter HbO (oxygenated hemoglobin). Two machine learning models were used: a Deep Learning LSTM (Long Short-Term Memory) model and a KNN (K-Nearest Neighbors) algorithm. The results indicate that the LSTM model outperforms KNN in predicting brain activation events, achieving an accuracy of \(88.52 \%\) , compared to KNN’s accuracy of \(82.35 \%\) . The model is continually being refined to enhance its predictive accuracy and multimodality. This work highlights the potential of deep learning models in data analysis and underscores the importance of multimodal approaches for understanding complex brain functions.