Workload-Aware Reviewer Recommendation using a Multi-Objective Search-based Approach
Background: Reviewer recommendation approaches have been proposed to provide automated support in finding suitable reviewers to review a given patch. However, they mainly focused on reviewer experience, and did not take into account the review workload, which is another important factor for a reviewer to decide if they will accept a review invitation. Aim: We set out to empirically investigate the feasibility of automatically recommending reviewers while considering the review workload amongst other factors. Method: We develop a novel approach that leverages a multi-objective meta-heuristic algorithm to search for reviewers guided by two objectives, i.e., (1) maximizing the chance of participating in a review, and (2) minimizing the skewness of the review workload distribution among reviewers.Results: Through an empirical study of 230,090 patches with 7,431 reviewers spread across four open source projects, we find that our approach can recommend reviewers who are potentially suitable for a newly-submitted patch with 19% - 260% higher F-measure than the five benchmarks. Conclusion: Our empirical results demonstrate that the review workload and other important information should be taken into consideration in finding reviewers who are potentially suitable for a newly-submitted patch. In addition, the results show the effectiveness of realizing this approach using a multi-objective search-based approach.
Thu 5 NovDisplayed time zone: (UTC) Coordinated Universal Time change
17:05 - 17:45 | |||
17:05 20mTalk | Workload-Aware Reviewer Recommendation using a Multi-Objective Search-based Approach PROMISE 2020 Wisam Haitham Abbood Al-Zubaidi University of Wollongong, Patanamon Thongtanunam The University of Melbourne, Hoa Khanh Dam University of Wollongong, Kla Tantithamthavorn Monash University, Australia, Aditya Ghose University of Wollongong | ||
17:25 20mTalk | Evaluating Hyper-Parameter Tuning using Random Search in Support Vector Machines for Software Effort Estimation PROMISE 2020 Leonardo Villalobos-Arias Universidad de Costa Rica, Christian Quesada-López Universidad de Costa Rica, Jose Guevara-Coto Universidad de Costa Rica, Alexandra Martinez Universidad de Costa Rica, Marcelo Jenkins Universidad de Costa Rica |