Class imbalance problem afflicts medical data classification due to the inherent bias towards the over-represented class. This results in improper prediction of the minority class, which is generally the class of interest. In this study, imbalanced data is handled for text-based depression detection using popular oversampling techniques. Depression is a critical health condition with serious consequences if not handled early. However, the lack of substantial data for depressed individuals in comparison with that of healthy individuals leads to low-performing decision models. This study is an exhaustive investigation of the combinations of various text vectorization methods and popular oversampling techniques over varied classifiers. Experiments exhibit best performance with the combination of CountVectorizer and adaptive synthetic sampling using the k-nearest neighbour classifier with F1 depressed score and F1 non-depressed score as 0.80 and 0.93, respectively. Taking the severity levels of depression into consideration, a context-aware severity-based adaptive oversampling technique for depression (AdaDepSyn) is proposed to generate a normally distributed synthetic data. The proposed technique shows improved performance with F1 depressed score and F1 non-depressed score as 0.81 and 0.90 respectively and is statistically significant for depression detection.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Investigating Oversampling for Improved Text-Based Depression Detection

  • Kanak,
  • Subhajit Das,
  • Krishan Kant,
  • Sanchit Jain,
  • Ashish Kumar Swarnkar,
  • Thejas Suresh,
  • Baljeet Kaur

摘要

Class imbalance problem afflicts medical data classification due to the inherent bias towards the over-represented class. This results in improper prediction of the minority class, which is generally the class of interest. In this study, imbalanced data is handled for text-based depression detection using popular oversampling techniques. Depression is a critical health condition with serious consequences if not handled early. However, the lack of substantial data for depressed individuals in comparison with that of healthy individuals leads to low-performing decision models. This study is an exhaustive investigation of the combinations of various text vectorization methods and popular oversampling techniques over varied classifiers. Experiments exhibit best performance with the combination of CountVectorizer and adaptive synthetic sampling using the k-nearest neighbour classifier with F1 depressed score and F1 non-depressed score as 0.80 and 0.93, respectively. Taking the severity levels of depression into consideration, a context-aware severity-based adaptive oversampling technique for depression (AdaDepSyn) is proposed to generate a normally distributed synthetic data. The proposed technique shows improved performance with F1 depressed score and F1 non-depressed score as 0.81 and 0.90 respectively and is statistically significant for depression detection.