Scholarlink

This study investigates the impact of different validation techniques on the performance evaluation of software effort estimation models. Specifically, it compares k-fold cross-validation, leave-one-out cross-validation (LOOCV), and hold-out validation using the eSOMCOCOMO approach, which enhances COCOMO model predictions through the Self-Organizing Migrating Algorithm (SOMA). The evaluation was conducted on three benchmark datasets (NASA18, Kemerer, and Miyazaki94) and assessed using standard evaluation metrics (MMRE, PRED(25), MMER, MAE, MSE, RMSE, and R2). Statistical hypothesis testing revealed significant differences among most validation techniques, except in the comparison conducted on the NASA18 dataset. LOOCV demonstrates superior stability across multiple runs, whereas hold-out validation showed high variance.

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A Comparative Evaluation of Validation Techniques in Software Effort Estimation Using eSOMCOCOMO

  • 会议论文

  • 发表日期：

    2025年

查看全文
  • Darina Bajusova,
  • Radek Silhavy,
  • Petr Silhavy

摘要

This study investigates the impact of different validation techniques on the performance evaluation of software effort estimation models. Specifically, it compares k-fold cross-validation, leave-one-out cross-validation (LOOCV), and hold-out validation using the eSOMCOCOMO approach, which enhances COCOMO model predictions through the Self-Organizing Migrating Algorithm (SOMA). The evaluation was conducted on three benchmark datasets (NASA18, Kemerer, and Miyazaki94) and assessed using standard evaluation metrics (MMRE, PRED(25), MMER, MAE, MSE, RMSE, and R2). Statistical hypothesis testing revealed significant differences among most validation techniques, except in the comparison conducted on the NASA18 dataset. LOOCV demonstrates superior stability across multiple runs, whereas hold-out validation showed high variance.