Selective Regression Testing based on Big Data: Comparing Feature Extraction Techniques

Al Sabbagh, Khaled,1987Gothenburg University,Göteborgs universitet,Institutionen för data- och informationsteknik, datavetenskap (GU),Department of Computer Science and Engineering, Computing Science (GU) (author)

Regression testing is a necessary activity in continuous integration (CI) since it provides confidence that modified parts of the system are correct at each integration cycle. CI provides large volumes of data which can be used to support regression testing activities. By using machine learning, patterns about faulty changes in the modified program can be induced, allowing test orchestrators to make inferences about test cases that need to be executed at each CI cycle. However, one challenge in using learning models lies in finding a suitable way for characterizing source code changes and preserving important information. In this paper, we empirically evaluate the effect of three feature extraction algorithms on the performance of an existing ML-based selective regression testing technique. We designed and performed an experiment to empirically investigate the effect of Bag of Words (BoW), Word Embeddings (WE), and content-based feature extraction (CBF). We used stratified cross validation on the space of features generated by the three FE techniques and evaluated the performance of three machine learning models using the precision and recall metrics. The results from this experiment showed a significant difference between the models' precision and recall scores, suggesting that the BoW-fed model outperforms the other two models with respect to precision, whereas a CBF-fed model outperforms the rest with respect to recall.

Staron, Miroslaw,1977Gothenburg University,Göteborgs universitet,Institutionen för data- och informationsteknik, Software Engineering (GU),Software Center,Institutionen för data- och informationsteknik (GU),Institutionen för data- och informationsteknik, Software Engineering (GU),Department of Computer Science and Engineering (GU)(Swepub:gu)xstmir (author)
Ochodek, MiroslawPolitechnika Poznanska,Poznan University of Technology (author)
Hebig, Regina,1984Gothenburg University,Göteborgs universitet,Institutionen för data- och informationsteknik, Software Engineering (GU),Institutionen för data- och informationsteknik (GU),Institutionen för data- och informationsteknik, Software Engineering (GU),Department of Computer Science and Engineering (GU)(Swepub:gu)xhebir (author)
Meding, Wilhelm,1970Telefonaktiebolaget L M Ericsson,Ericsson (author)
Göteborgs universitetInstitutionen för data- och informationsteknik, datavetenskap (GU) (creator_code:org_t)

By the author/editor: Al Sabbagh, Khal ...; Staron, Miroslaw ...; Ochodek, Mirosla ...; Hebig, Regina, 1 ...; Meding, Wilhelm, ...

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Software Enginee ...

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Information Syst ...

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Computer Science ...

By the university: Chalmers University of Technology; University of Gothenburg

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.