Managing missing data in classification tasks poses significant challenges due to the diversity and unpredictability of missingness mechanisms and types. Common methods, such as imputation or deletion, often fail to provide robust solutions across domains, leading to potentially deceptive conclusions due to data distortion. A detailed analysis of missing data types and mechanisms is crucial for selecting appropriate deletion or imputation methods, including single imputation, model-based approaches, or interpolation techniques. This paper introduces Analogy Associative Graphs, which were designed to enhance predictive accuracy for datasets with many incomplete entities, and an algorithm for making predictions. The proposed model leverages specific graph structures to infer missing features using analogies between similar entities. We evaluated this model against well-established machine learning models and popular methods, including the Support Vector Classifier (SVC), AutoSklearn Classifier (AutoML), and Multi-Layer Perceptron Neural Network (MLP) across multiple datasets. Our research results demonstrate high predictive accuracy, F1 score, and stability of our model, even with up to 40% missing data. This performance surpasses common models, which can struggle with incomplete data and often rely on extensive data preprocessing. The ability of our model to handle incomplete data without compromising data integrity or corrupting information establishes it as a versatile and reliable tool for classification tasks in sectors plagued by data incompleteness.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing Predictive Capabilities with Analogy Associative Graphs for Incomplete Datasets

  • Konrad Komnata,
  • Jakub Komnata,
  • Adrian Horzyk,
  • Wojciech Komnata,
  • Mateusz Szyd

摘要

Managing missing data in classification tasks poses significant challenges due to the diversity and unpredictability of missingness mechanisms and types. Common methods, such as imputation or deletion, often fail to provide robust solutions across domains, leading to potentially deceptive conclusions due to data distortion. A detailed analysis of missing data types and mechanisms is crucial for selecting appropriate deletion or imputation methods, including single imputation, model-based approaches, or interpolation techniques. This paper introduces Analogy Associative Graphs, which were designed to enhance predictive accuracy for datasets with many incomplete entities, and an algorithm for making predictions. The proposed model leverages specific graph structures to infer missing features using analogies between similar entities. We evaluated this model against well-established machine learning models and popular methods, including the Support Vector Classifier (SVC), AutoSklearn Classifier (AutoML), and Multi-Layer Perceptron Neural Network (MLP) across multiple datasets. Our research results demonstrate high predictive accuracy, F1 score, and stability of our model, even with up to 40% missing data. This performance surpasses common models, which can struggle with incomplete data and often rely on extensive data preprocessing. The ability of our model to handle incomplete data without compromising data integrity or corrupting information establishes it as a versatile and reliable tool for classification tasks in sectors plagued by data incompleteness.