2020
Journal article  Open Access

Testing relative to usage scope: revisiting software coverage criteria

Miranda B., Bertolino A.

Coverage testing  Software  relative coverage 

Coverage criteria provide a useful and widely used means to guide software testing; however, indiscriminately pursuing full coverage may not always be convenient or meaningful, as not all entities are of interest in any usage context. We aim at introducing a more meaningful notion of coverage that takes into account how the software is going to be used. Entities that are not going to be exercised by the user should not contribute to the coverage ratio. We revisit the definition of coverage measures, introducing a notion of relative coverage. According to this notion, we provide a definition and a theoretical framework of relative coverage, within which we discuss implications on testing theory and practice. Through the evaluation of three different instances of relative coverage, we could observe that relative coverage measures provide a more effective strategy than traditional ones: we could reach higher coverage measures, and test cases selected by relative coverage could achieve higher reliability. We hint at several other useful implications of relative coverage notion on different aspects of software testing.

Source: ACM transactions on software engineering and methodology 29 (2020). doi:10.1145/3389126

Publisher: Association for Computing Machinery,, New York, NY , Stati Uniti d'America


Metrics



Back to previous page
BibTeX entry
@article{oai:it.cnr:prodotti:425811,
	title = {Testing relative to usage scope: revisiting software coverage criteria},
	author = {Miranda B. and Bertolino A.},
	publisher = {Association for Computing Machinery,, New York, NY , Stati Uniti d'America},
	doi = {10.1145/3389126},
	journal = {ACM transactions on software engineering and methodology},
	volume = {29},
	year = {2020}
}
CNR ExploRA

Bibliographic record

ISTI Repository

Postprint version Open Access

DOI

10.1145/3389126

Also available from

dl.acm.orgRestricted