Revisiting the Impact of Concept Drift on Just-in-Time Quality Assurance

Bennin, Kwabena Ebo,1987-Blekinge Tekniska Högskola,Institutionen för programvaruteknik (author)

open access
The performance of software defect prediction(SDP) models is known to be dependent on the datasets used for training the models. Evolving data in a dynamic software development environment such as significant refactoring and organizational changes introduces new concept to the prediction model, thus making improved classification performance difficult. In this study, we investigate and assess the existence and impact of concept drift on SDP performances. We empirically asses the prediction performance of five models by conducting cross-version experiments using fifty-five releases of five open-source projects. Prediction performance fluctuated as the training datasets changed over time. Our results indicate that the quality and the reliability of defect prediction models fluctuate over time and that this instability should be considered by software quality teams when using historical datasets. The performance of a static predictor constructed with data from historical versions may degrade over time due to the challenges posed by concept drift. © 2020 IEEE.

NATURVETENSKAP Data- och informationsvetenskap Programvaruteknik hsv//swe
NATURAL SCIENCES Computer and Information Sciences Software Engineering hsv//eng
Concept drift
Defect prediction
Just-in-Time Quality assurance
Computer software selection and evaluation
Defects
Forecasting
Open source software
Software design
Software quality
Software reliability
Classification performance
Defect prediction models
Dynamic softwares
Open source projects
Organizational change
Prediction performance
Software defect prediction
Training data sets
Predictive analytics

Ali, Nauman binBlekinge Tekniska Högskola,Institutionen för programvaruteknik(Swepub:bth)nal (author)
Börstler, Jürgen,1960-Blekinge Tekniska Högskola,Institutionen för programvaruteknik(Swepub:bth)jub (author)
Yu, XiaoCity University of Hong Kong, HKG (author)
Blekinge Tekniska HögskolaInstitutionen för programvaruteknik (creator_code:org_t)

In:Proceedings - 2020 IEEE 20th International Conference on Software Quality, Reliability, and Security, QRS 2020: Institute of Electrical and Electronics Engineers Inc., s. 53-599781728189130

By the author/editor: Bennin, Kwabena ...; Ali, Nauman bin; Börstler, Jürgen ...; Yu, Xiao

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Software Enginee ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.