Write a Blog >>
Thu 5 Nov 2020 17:05 - 17:25 at Virtual room 1 - Search

Background: Reviewer recommendation approaches have been proposed to provide automated support in finding suitable reviewers to review a given patch. However, they mainly focused on reviewer experience, and did not take into account the review workload, which is another important factor for a reviewer to decide if they will accept a review invitation. Aim: We set out to empirically investigate the feasibility of automatically recommending reviewers while considering the review workload amongst other factors. Method: We develop a novel approach that leverages a multi-objective meta-heuristic algorithm to search for reviewers guided by two objectives, i.e., (1) maximizing the chance of participating in a review, and (2) minimizing the skewness of the review workload distribution among reviewers.Results: Through an empirical study of 230,090 patches with 7,431 reviewers spread across four open source projects, we find that our approach can recommend reviewers who are potentially suitable for a newly-submitted patch with 19% - 260% higher F-measure than the five benchmarks. Conclusion: Our empirical results demonstrate that the review workload and other important information should be taken into consideration in finding reviewers who are potentially suitable for a newly-submitted patch. In addition, the results show the effectiveness of realizing this approach using a multi-objective search-based approach.

Thu 5 Nov

Displayed time zone: (UTC) Coordinated Universal Time change

17:05 - 17:45
17:05
20m
Talk
Workload-Aware Reviewer Recommendation using a Multi-Objective Search-based Approach
PROMISE 2020
Wisam Haitham Abbood Al-Zubaidi University of Wollongong, Patanamon Thongtanunam The University of Melbourne, Hoa Khanh Dam University of Wollongong, Kla Tantithamthavorn Monash University, Australia, Aditya Ghose University of Wollongong
17:25
20m
Talk
Evaluating Hyper-Parameter Tuning using Random Search in Support Vector Machines for Software Effort Estimation
PROMISE 2020
Leonardo Villalobos-Arias Universidad de Costa Rica, Christian Quesada-López Universidad de Costa Rica, Jose Guevara-Coto Universidad de Costa Rica, Alexandra Martinez Universidad de Costa Rica, Marcelo Jenkins Universidad de Costa Rica