The evaluation of simulation models is a fundamental step in establishing their credibility. Conventional approaches often rely on qualitative expert judgment, a process that is often inefficient and labor-intensive. Additionally, simulation outputs are often limited due to high computational costs or intrinsic model properties. To address these challenges, we propose a Quantitative Learning Method (QLM) that employs a dual-layer architecture. This method is designed to integrate historical assessment scores in small-sample contexts, learning the mapping from raw simulation outputs to evaluation metrics. Validated on two classic simulation models against seven baseline algorithms, QLM demonstrates robust generalization and stable performance, mitigating the overfitting prevalent in machine learning approaches under data constraints. Furthermore, its inherent transparency the mapping between simulation outputs and credibility scores offers considerable interpretability and practical value.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Quantitative Learning Method for Simulation Model Evaluation Using L-SHADE Optimized Structured Regression

  • Jiayi Zhang,
  • Yuanjun Laili,
  • Jiabei Gong,
  • Lin Zhang,
  • Lei Ren

摘要

The evaluation of simulation models is a fundamental step in establishing their credibility. Conventional approaches often rely on qualitative expert judgment, a process that is often inefficient and labor-intensive. Additionally, simulation outputs are often limited due to high computational costs or intrinsic model properties. To address these challenges, we propose a Quantitative Learning Method (QLM) that employs a dual-layer architecture. This method is designed to integrate historical assessment scores in small-sample contexts, learning the mapping from raw simulation outputs to evaluation metrics. Validated on two classic simulation models against seven baseline algorithms, QLM demonstrates robust generalization and stable performance, mitigating the overfitting prevalent in machine learning approaches under data constraints. Furthermore, its inherent transparency the mapping between simulation outputs and credibility scores offers considerable interpretability and practical value.