Write a Blog >>
Fri 13 Nov 2020 01:05 - 01:06 at Virtual room 1 - Empirical

Aim: In contrast to studies of defects found during code review, we aim to clarify whether code reviews measures can explain the prevalence of post-release defects.

Method: We replicate McIntosh \etal’s (EMSE 2016) study that uses additive regression to model the relationship between defects and code reviews. To increase external validity, we apply the same methodology on a new software project. We discuss our findings with the first author of the original study, McIntosh. We then investigate how to reduce the impact of correlated predictors in the variable selection process and how to increase understanding of the inter-relationships among the predictors by employing Bayesian Network (BN) models.

Context: As in the original study, we use the same measures authors obtained for Qt project in the original study. We mine data from version control and issue tracker of Google Chrome and operationalize measures that are close analogs to the large collection of code, process, and code review measures used in the replicated the study.

Results: Both the data from the original study and the Chrome data showed high instability of the influence of code review measures on defects with the results being highly sensitive to variable selection procedure. Models without code review predictors had as good or better fit than those with review predictors. Replication, however, confirms with the bulk of prior work showing that prior defects, module size, and authorship have the strongest relationship to post-release defects. The application of BN models helped explain the observed instability by demonstrating that the review-related predictors do {\it not} affect post-release defects directly and showed indirect effects. For example, changes that have \emph{no review discussion} tend to be associated with files that have had many \emph{prior defects} which in turn increase the number of post-release defects.

We hope that similar analyses of other software engineering techniques may also yield a more nuanced view of their impact. Our replication package including our data and scripts is publicly available.

Fri 13 Nov
Times are displayed in time zone: (UTC) Coordinated Universal Time change

01:00 - 01:02
Talk
Research Papers
P. Merlin UesbeckUniversity of Nevada at Las Vegas, USA, Cole S. PetersonUniversity of Nebraska-Lincoln, USA, Bonita SharifUniversity of Nebraska-Lincoln, USA, Andreas StefikUniversity of Nevada at Las Vegas, USA
DOI
01:03 - 01:04
Talk
Tool Demos
Ratnadira WidyasariSingapore Management University, Singapore, Sheng Qin SimSingapore Management University, Singapore, Camellia LokSingapore Management University, Singapore, Haodi QiSingapore Management University, Singapore, Jack PhanSingapore Management University, Singapore, Qijin TaySingapore Management University, Singapore, Constance TanSingapore Management University, Singapore, Fiona WeeSingapore Management University, Singapore, Jodie Ethelda TanSingapore Management University, Singapore, Yuheng YiehSingapore Management University, Singapore, Brian GohSingapore Management University, Singapore, Ferdian ThungSingapore Management University, Hong Jin KangSingapore Management University, Singapore, Thong HoangSingapore Management University, Singapore, David LoSingapore Management University, Ouh Eng LiehSingapore Management University, Singapore
DOI
01:05 - 01:06
Talk
Journal First
Andrey KrutauzConcordia University, Tapajit DeyLero - The Irish Software Research Centre and University of Limerick, Peter RigbyConcordia University, Montreal, Canada, Audris MockusUniversity of Tennessee - Knoxville
01:07 - 01:08
Talk
Research Papers
Jaeseong LeeUniversity of Texas at Austin, USA, Pengyu NieUniversity of Texas at Austin, USA, Junyi Jessy LiUniversity of Texas at Austin, USA, Milos GligoricUniversity of Texas at Austin
DOI
01:09 - 01:10
Talk
Research Papers
Yiling LouPeking University, China, Zhenpeng ChenPeking University, China, Yanbin CaoPeking University, China, Dan HaoPeking University, China, Lu ZhangPeking University, China
DOI
01:11 - 01:12
Talk
Research Papers
Ameya KetkarOregon State University, USA, Nikolaos TsantalisConcordia University, Canada, Danny DigUniversity of Colorado Boulder, USA
DOI Pre-print Media Attached
01:13 - 01:30
Talk
Paper Presentations
Cole S. PetersonUniversity of Nebraska-Lincoln, USA, Pengyu NieUniversity of Texas at Austin, USA, Ratnadira WidyasariSingapore Management University, Singapore, Peter RigbyConcordia University, Montreal, Canada, Yiling LouPeking University, China, M: Kelly BlincoeUniversity of Auckland