Corroborative V&V for Autonomous Systems: Integrating Evidence and Discrepancy Analysis for Safety Assurance
摘要
Verification and validation of robotic and autonomous systems often relies on heterogeneous verification methods (e.g., formal verification, simulation-based testing and physical experiments) to build confidence in system correctness. Manually reconciling evidence from these diverse sources is both time-consuming and error-prone for safety engineers. Moreover, tool support to help safety assessors integrate heterogeneous evidence into coherent, evidence-based assurance cases is much needed. Towards addressing these challenges, in this study we propose an Eclipse plugin (ECV2), which integrates multi-source evidence from formal verification, simulation test-benches and experiment logs. It computes per-metric ranges across techniques, assigns criticality levels and automatically flags outliers. It generates human-readable, evidence-linked recommendations to guide targeted refinement. To ensure semantic consistency and objective guidance, ECV2 aligns each metric with relevant domain ontologies and assurance-case thresholds. Its interactive, colour-coded, multi-column tree view highlights criticality variances directly within the Eclipse environment. We demonstrate ECV2 through a nuclear-radiation autonomous inspection robot case study, deriving nine measurements from PRISM formal verification alongside corresponding metrics from a ROS-based patrol software simulation.