Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing

Tahvili, SaharMälardalens högskola,RISE,SICS,Mälardalen University, Sweden,Inbyggda system (author)

In software system development, testing can take considerable time and resources, and there are numerous examples in the literature of how to improve the testing process. In particular, methods for selection and prioritization of test cases can play a critical role in efficient use of testing resources. This paper focuses on the problem of selection and ordering of integration-level test cases. Integration testing is performed to evaluate the correctness of several units in composition. Further, for reasons of both effectiveness and safety, many embedded systems are still tested manually. To this end, we propose a process, supported by an online decision support system, for ordering and selection of test cases based on the test result of previously executed test cases. To analyze the economic efficiency of such a system, a customized return on investment (ROI) metric tailored for system integration testing is introduced. Using data collected from the development process of a large-scale safety-critical embedded system, we perform Monte Carlo simulations to evaluate the expected ROI of three variants of the proposed new process. The results show that our proposed decision support system is beneficial in terms of ROI at system integration testing and thus qualifies as an important element in improving the integration testing process.

Bohlin, MarkusMälardalens högskola,RISE,SICS,Inbyggda system(Swepub:mdh)mbn05 (author)
Saadatmand, MehrdadMälardalens högskola,RISE,SICS,Mälardalen University, Sweden,Inbyggda system(Swepub:mdh)msd03 (author)
Larsson, StigRISE,SICS,SICS, Sweden(Swepub:mdh)sln06 (author)
Afzal, WasifMälardalens högskola,Inbyggda system(Swepub:mdh)wal01 (author)
Sundmark, DanielMälardalens högskola,RISE,SICS,Mälardalen University, Sweden,Inbyggda system(Swepub:mdh)dsk01 (author)
RISESICS (creator_code:org_t)

In:Product-Focused Software Process ImprovementCham : Springer International Publishing, s. 268-284, s. 268-28497833194909399783319490946
In:Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)Cham : Springer International Publishing, s. 268-284, s. 268-284

By the author/editor: Tahvili, Sahar; Bohlin, Markus; Saadatmand, Mehr ...; Larsson, Stig; Afzal, Wasif; Sundmark, Daniel

About the subject

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Electrical Engin ...; and Computer Systems

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.