Nondeterministic Coverage Metrics as Key Performance Indicator for Model- and Value-based Testing

Abstract

Assessing the testing or software development process by only using KPIs can easily be misleading. A better solution is a paradigm shift to value-based software engineering, which integrates value considerations into software engineering and offers a broader and more technical view on KPIs. Coverage metrics are such a technical view and a very helpful KPI. This paper combines value-based testing and model-based testing of nondeterministic systems and introduces new coverage metrics for this. Therewith, the quality of test suites is raised and value-based testing gets strongly supported, e.g., by KPIs derived from nondeterministic coverage metrics and better requirements-based and risk-based testing.