Sökning: onr:"swepub:oai:DiVA.org:mdh-66246" >
The Comparative Eva...
The Comparative Evaluation of Test Prioritization Approaches in an Industrial Study
-
- Ahmad, Azeem, 1984- (författare)
- Linköpings universitet,Programvara och system,Tekniska fakulteten,Ericsson AB
-
- de Oliveira Neto, Francisco Gomes (författare)
- Gothenburg University,Göteborgs universitet,Institutionen för data- och informationsteknik (GU),Department of Computer Science and Engineering (GU)
-
- Enoiu, Eduard Paul, PhD (författare)
- Mälardalens universitet,Inbyggda system
-
visa fler...
-
- Sandahl, Kristian, 1959- (författare)
- Linköpings universitet,Programvara och system,Tekniska fakulteten,PELAB
-
- Leifler, Ola, 1978- (författare)
- Linköpings universitet,Programvara och system,Tekniska fakulteten
-
visa färre...
-
(creator_code:org_t)
- Institute of Electrical and Electronics Engineers Inc. 2023
- 2023
- Engelska.
-
Ingår i: Proc. - IEEE Int. Conf. Softw. Qual., Reliab., Secur. Companion, QRS-C. - : Institute of Electrical and Electronics Engineers Inc.. - 9798350359398 ; , s. 35-44
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
https://gup.ub.gu.se...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- Many test prioritisation techniques have been proposed in order to improve test effectiveness of Continuous Integration (CI) pipelines. Particularly, diversity-based testing (DBT) has shown promising and competitive results to improve test effectiveness. We report on a case study considering the CI pipeline of Axis Communications in Sweden. We compared three different prioritisation approaches (i.e., diversity, failure history and time) in terms of their impact on coverage, failure detection rates and reduction on test execution time. Our results reveal that DBT is the best candidate to provide feature coverage, whereas failure rate prioritisation yields better failure coverage. Time-based prioritisation is not a reliable approach to provide cost-effective testing. Moreover, DBT would allow stakeholders to receive quick feedback on many combinations of integrated features to verify their code changes. Our participants report that developers are mainly interested in: (i) receiving quick feedback on a high combination of integrated features to verify their code changes, and (ii) associate their test suites to confidence scores representing the risk of missing failures given that fewer tests are executed.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Programvaruteknik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Software Engineering (hsv//eng)
Nyckelord
- comparative evaluation
- continuous integration
- diversity based testing
- regression testing
- Cost effectiveness
- Failure rate
- Integration testing
- Code changes
- Comparative evaluations
- Continuous integrations
- Evaluation of test
- Prioritization
- Prioritization techniques
- Test effectiveness
- Test prioritization
- Pipelines
- comparative evaluation
- continuous integration
- diversity based testing
- regression testing
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)
Hitta via bibliotek
Till lärosätets databas