An Industrial Study on the Challenges and Effects of Diversity-Based Testing in Continuous Integration

↓ Direkt till sidans innehåll
↓ Direkt till sidans sekundära innehåll (sidomenyn)

Sökning: WFRF:(Leifler Ola) > An Industrial Study...

Ahmad, Azeem (författare)

An Industrial Study on the Challenges and Effects of Diversity-Based Testing in Continuous Integration

Artikel/kapitelEngelska2023

Förlag, utgivningsår, omfång ...

2023

Nummerbeteckningar

LIBRIS-ID:oai:gup.ub.gu.se/337439
https://gup.ub.gu.se/publication/337439URI
https://doi.org/10.1109/QRS60937.2023.00041DOI

Kompletterande språkuppgifter

Språk:engelska

Ingår i deldatabas

SwePubSwePub

Klassifikation

Ämneskategori:ref swepub-contenttype
Ämneskategori:kon swepub-publicationtype

Anmärkningar

Many test prioritisation techniques have been proposed in order to improve test effectiveness of Continuous Integration (CI) pipelines. Particularly, diversity-based testing (DBT) has shown promising and competitive results to improve test effectiveness. However, the technical and practical challenges of introducing test prioritisation in CI pipelines are rarely discussed, thus hindering the applicability and adoption of those proposed techniques. This research builds on our prior work in which we evaluated diversity-based techniques in an industrial setting. This work investigates the factors that influence the adoption of DBT both in connection to improvements in test cost-effectiveness, as well as the process and human related challenges to transfer and use DBT prioritisation in CI pipelines. We report on a case study considering the CI pipeline of Axis Communications in Sweden. We performed a thematic analysis of a focus group interview with senior practitioners at the company to identify the challenges and perceived benefits of using test prioritisation in their test process. Our thematic analysis reveals a list of ten challenges and seven perceived effects of introducing test prioritisation in CI cycles. For instance, our participants emphasized the importance of introducing comprehensible and transparent techniques that instill trust in its users. Moreover, practitioners prefer techniques compatible with their current test infrastructure (e.g., test framework and environments) in order to reduce instrumentation efforts and avoid disrupting their current setup. In conclusion, we have identified tradeoffs between different test prioritisation techniques pertaining to the technical, process and human aspects of regression testing in CI. We summarize those findings in a list of seven advantages that refer to specific stakeholder interests and describe the effects of adopting DBT in CI pipelines.

Ämnesord och genrebeteckningar

NATURVETENSKAP Data- och informationsvetenskap hsv//swe
NATURAL SCIENCES Computer and Information Sciences hsv//eng
continuous integration
diversity based testing
emprirical study
regression testing
test suite minimisation

Biuppslag (personer, institutioner, konferenser, titlar ...)

de Oliveira Neto, Francisco GomesGothenburg University,Göteborgs universitet,Institutionen för data- och informationsteknik (GU),Department of Computer Science and Engineering (GU)(Swepub:gu)xdeofr (författare)
Enoiu, Eduard Paul (författare)
Sandahl, Kristian (författare)
Leifler, Ola (författare)
Göteborgs universitetInstitutionen för data- och informationsteknik (GU) (creator_code:org_t)

Sammanhörande titlar

Ingår i:IEEE International Conference on Software Quality, Reliability and Security, QRS2693-91779798350319583

Internetlänk

Hitta via bibliotek

IEEE International Conference on Software Quality, Reliability and Security, QRS (Sök värdpublikationen i LIBRIS)

Till lärosätets databas

Hitta mer i SwePub

Av författaren/redakt...: Ahmad, Azeem; de Oliveira Neto ...; Enoiu, Eduard Pa ...; Sandahl, Kristia ...; Leifler, Ola

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...

Artiklar i publikationen: IEEE Internation ...

Av lärosätet: Göteborgs universitet

Sök utanför SwePub

Sök vidare i:: Google; Google Book Search; Google Scholar

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.

LIBRIS.kb.se