Operational-profile–based testing or statistical software testing (ST) has been a tool in determining quantitative indicators for “on -demand failure probabilities” of software-based devices for many decades. In the UK nuclear industry, the technique has found widespread application and been shown to be effective in supporting safety justification. In a time where a changeover of generations, changes in working styles and a pervasive skills shortage all work on and affect safety culture, new ways are needed to build up and maintain competency in this and other complex assurance techniques. In the case of ST, specific process steps in designing and generating valid ST test-cases show a high degree of repeatability between projects - especially for statistical testing of commercial-off-the-shelf computer-based devices. Encapsulating some of the expert input within this process into configurable components that can be reused, easily combined and configured mimics this repeatability. This has two advantages: firstly, a significant reduction of cost and effort in performing ST, secondly a significant improvement in how competency in the technique can be developed and maintained. A prototype for a generic and reuseable statistical test rig (SDITS – Smart Device Integrity Test Station) has been developed and is introduced in this paper. Initial results are presented and areas for future work and collaboration highlighted.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Managing Capability in Software Dependability Testing Through Generic Test Rigs

  • Silke Kuball,
  • Lee Walker,
  • Martin Rendell

摘要

Operational-profile–based testing or statistical software testing (ST) has been a tool in determining quantitative indicators for “on -demand failure probabilities” of software-based devices for many decades. In the UK nuclear industry, the technique has found widespread application and been shown to be effective in supporting safety justification. In a time where a changeover of generations, changes in working styles and a pervasive skills shortage all work on and affect safety culture, new ways are needed to build up and maintain competency in this and other complex assurance techniques. In the case of ST, specific process steps in designing and generating valid ST test-cases show a high degree of repeatability between projects - especially for statistical testing of commercial-off-the-shelf computer-based devices. Encapsulating some of the expert input within this process into configurable components that can be reused, easily combined and configured mimics this repeatability. This has two advantages: firstly, a significant reduction of cost and effort in performing ST, secondly a significant improvement in how competency in the technique can be developed and maintained. A prototype for a generic and reuseable statistical test rig (SDITS – Smart Device Integrity Test Station) has been developed and is introduced in this paper. Initial results are presented and areas for future work and collaboration highlighted.