Automated Code Review Comment Classification to Improve Modern Code Reviews

Modern Code Reviews (MCRs) are a widely-used quality assurance mechanism in continuous integration and deployment. Unfortunately, in medium and large projects, the number of changes that need to be integrated, and consequently the number of comments triggered during MCRs could be overwhelming. Therefore, there is a need for quickly recognizing which comments are concerning issues that need prompt attention to guide the focus of the code authors, reviewers, and quality managers. The goal of this study is to design a method for automated classification of review comments to identify the needed change faster and with higher accuracy. We conduct a Design Science Research study on three open-source systems. We designed a method (CommentBERT) for automated classification of the code-review comments based on the BERT (Bidirectional Encoder Representations from Transformers) language model and a new taxonomy of comments. When applied to 2,672 comments from Wireshark, The Mono Framework, and Open Network Automation Platform (ONAP) projects, the method achieved accuracy, measured using Matthews Correlation Coefficient, of 0.46–0.82 (Wireshark), 0.12–0.8 (ONAP), and 0.48–0.85 (Mono). Based on the results, we conclude that the proposed method seems promising and could be potentially used to build machine-learning-based tools to support MCRs as long as there is a sufficient number of historical code-review comments to train the model.

Staron, Miroslaw,1977Göteborgs universitet,University of Gothenburg(Swepub:cth)miroslaw (author)
Meding, Wilhelm,1970Telefonaktiebolaget L M Ericsson,Ericsson (author)
Söder, Ola (author)
Politechnika PoznanskaGöteborgs universitet (creator_code:org_t)

In:Lecture Notes in Business Information ProcessingCham : Springer International Publishing439 LNBIP, s. 23-401865-13561865-1348

By the author/editor: Ochodek, M.; Staron, Miroslaw ...; Meding, Wilhelm, ...; Söder, Ola

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Other Computer a ...

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Information Syst ...

SOCIAL SCIENCES: SOCIAL SCIENCES; and Media and Commun ...; and Information Syst ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.