In this paper, we address the task of identifying false positive discrepancies in critical Instrumentation and Control (I&C) software testing as an Irregular Multivariate Time Series Classification (IMTSC) problem and evaluate the performance of different Neural Network architectures, including GRU-D, Transformer, and the Set Function for Time Series (SEFT). Architectures are trained on a real-world dataset from industrial test reports, and evaluated in our use case. Our finding is that the Transformer-based method outperforms the other baselines in terms of precision, while SEFT shows noteworthy performance compared to the literature benchmarks and in the lowest training time, highlighting the importance of our context-focused evaluation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

False Positive Detection in Instrumentation and Control System Testing

  • Anas El Haoufi,
  • Gabriel Thomas,
  • Nicolas Hili

摘要

In this paper, we address the task of identifying false positive discrepancies in critical Instrumentation and Control (I&C) software testing as an Irregular Multivariate Time Series Classification (IMTSC) problem and evaluate the performance of different Neural Network architectures, including GRU-D, Transformer, and the Set Function for Time Series (SEFT). Architectures are trained on a real-world dataset from industrial test reports, and evaluated in our use case. Our finding is that the Transformer-based method outperforms the other baselines in terms of precision, while SEFT shows noteworthy performance compared to the literature benchmarks and in the lowest training time, highlighting the importance of our context-focused evaluation.