<p>In this study, first, we improved an existing variant of the Nearest Centroid algorithm. In this new version, the predictive power of features and within-class variances are used as weights in distance calculation. This version is called the Enhanced Nearest Centroid (ENC). Second, we proposed a new model tree algorithm for binary classification. It is named as the Enhanced Nearest Centroid Model Tree (ENCMT). The model tree is built using ENC at each leaf node of the decision tree. To evaluate the performance of the new model tree, we used an independent test platform and ran the algorithm on 30 binary datasets available therein. Results showed that ENCMT improves the performance of the decision tree algorithm. We also compared ENCMT with the Logistic Model Tree (LMT) algorithm and showed that it outperforms LMT as well. We also designed a bagging algorithm where ENCMT is used to build a random forest. Our comparison results show that its performance is significantly better than the Random Forest (RF) algorithm. </p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhanced nearest centroid model tree classifier

  • Mehmet Hamdi Özçelik,
  • Ekrem Duman,
  • Selami Bağrıyanık,
  • Serol Bulkan

摘要

In this study, first, we improved an existing variant of the Nearest Centroid algorithm. In this new version, the predictive power of features and within-class variances are used as weights in distance calculation. This version is called the Enhanced Nearest Centroid (ENC). Second, we proposed a new model tree algorithm for binary classification. It is named as the Enhanced Nearest Centroid Model Tree (ENCMT). The model tree is built using ENC at each leaf node of the decision tree. To evaluate the performance of the new model tree, we used an independent test platform and ran the algorithm on 30 binary datasets available therein. Results showed that ENCMT improves the performance of the decision tree algorithm. We also compared ENCMT with the Logistic Model Tree (LMT) algorithm and showed that it outperforms LMT as well. We also designed a bagging algorithm where ENCMT is used to build a random forest. Our comparison results show that its performance is significantly better than the Random Forest (RF) algorithm.