Automatic creation of acceptance tests by extracting conditionals from requirements: NLP approach and case study

Automatic creation of acceptance tests by extracting conditionals from requirements : NLP approach and case study

Acceptance testing is crucial to determine whether a system fulfills end-user requirements. However, the creation of acceptance tests is a laborious task entailing two major challenges: (1) practitioners need to determine the right set of test cases that fully covers a requirement, and (2) they need to create test cases manually due to insufficient tool support. Existing approaches for automatically deriving test cases require semi-formal or even formal notations of requirements, though unrestricted natural language is prevalent in practice. In this paper, we present our tool-supported approach CiRA (Conditionals in Requirements Artifacts) capable of creating the minimal set of required test cases from conditional statements in informal requirements. We demonstrate the feasibility of CiRA in a case study with three industry partners. In our study, out of 578 manually created test cases, 71.8% can be generated automatically. Additionally, CiRA discovered 80 relevant test cases that were missed in manual test case design. CiRA is publicly available at www.cira.bth.se/demo/. © 2022

NATURVETENSKAP Data- och informationsvetenskap Programvaruteknik hsv//swe
NATURAL SCIENCES Computer and Information Sciences Software Engineering hsv//eng
Acceptance testing
Automatic test case creation
Causality extraction
Natural language processing
Requirements engineering
Natural language processing systems
Software testing
Automatic creations
Case-studies
Language processing
Natural languages
Requirement engineering
Test case
Acceptance tests

Frattini, Julian,1995-Blekinge Tekniska Högskola,Institutionen för programvaruteknik(Swepub:bth)juf (författare)
Vogelsang, AndreasUniversity of Cologne, DEU (författare)
Mendez, DanielBlekinge Tekniska Högskola,Institutionen för programvaruteknik(Swepub:bth)dmz (författare)
Unterkalmsteiner, MichaelBlekinge Tekniska Högskola,Institutionen för programvaruteknik(Swepub:bth)mun (författare)
Wehrle, AndreasAllianz Deutschland AG, DEU (författare)
Henao, Pablo RestrepoNetlight Consulting GmbH, DEU (författare)
Yousefi, ParisaEricsson, SWE (författare)
Juricic, TediEricsson, SWE (författare)
Radduenz, JeannetteAllianz Deutschland AG, DEU (författare)
Wiecher, CarstenLeopold Kostal GmbH & Co. KG, DEU (författare)
Netlight Consulting GmbH, DEUInstitutionen för programvaruteknik (creator_code:org_t)

Av författaren/redakt...: Fischbach, Janni ...; Frattini, Julian ...; Vogelsang, Andre ...; Mendez, Daniel; Unterkalmsteiner ...; Wehrle, Andreas; visa fler...; Henao, Pablo Res ...; Yousefi, Parisa; Juricic, Tedi; Radduenz, Jeanne ...; Wiecher, Carsten; visa färre...

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Programvarutekni ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.