Automatically Identifying Performance Issue Reports with Heuristic Linguistic Patterns
Performance issues compromise the response time and resource consumption of a software system. Modern software systems use issue tracking systems to manage all kinds of issue reports, including performance issues.
The problem is that performance issues are often not explicitly tagged. The tagging mechanism, if exists, is completely voluntary, depending on the project's convention and on submitters' discipline. For example, the performance tag rate in Apache's Jira system is below 1%. This paper contributes a hybrid classification approach that combines linguistic patterns and machine/deep learning techniques to automatically detect performance issue reports. We manually analyzed 980 real-life performance issue reports and derived 80 project-agnostic linguistic patterns that recur in the reports. Our approach uses these linguistic patterns to construct the sentence-level and issue-level learning features for training effective machine/deep learning classifiers. We test our approach on two separate datasets, each consisting of 980 unclassified issue reports, and compare the results with 31 baseline methods. Our approach can reach up to 83% precision and up to 59% recall. The only comparable baseline method is BERT, which is still 25% lower in the F1-score.
Tue 10 NovDisplayed time zone: (UTC) Coordinated Universal Time change
17:30 - 18:00
|Automatically Identifying Performance Issue Reports with Heuristic Linguistic Patterns|
Yutong Zhao Stevens Institute of Technology, USA, Lu Xiao Stevens Institute of Technology, USA, Pouria Babvey Stevens Institute of Technology, USA, Lei Sun Stevens Institute of Technology, USA, Sunny Wong Analytical Graphics, USA, Angel A. Martinez Analytical Graphics, USA, Xiao Wang Stevens Institute of Technology, USADOI
|Calm Energy Accounting for Multithreaded Java Applications|
Timur Babakol SUNY Binghamton, USA, Anthony Canino University of Pennsylvania, USA, Khaled Mahmoud SUNY Binghamton, USA, Rachit Saxena SUNY Binghamton, USA, Yu David Liu SUNY Binghamton, USADOI
|Dynamically Reconfiguring Software Microbenchmarks: Reducing Execution Time without Sacrificing Result Quality|
Christoph Laaber University of Zurich, Switzerland, Stefan Würsten University of Zurich, Switzerland, Harald Gall University of Zurich, Switzerland, Philipp Leitner Chalmers University of Technology, Sweden / University of Gothenburg, SwedenDOI Pre-print Media Attached
|Investigating types and survivability of performance bugs in mobile apps|
|Testing Self-Adaptive Software with Probabilistic Guarantees on Performance MetricsACM SIGSOFT Distinguished Paper Award|
Claudio Mandrioli Lund University, Sweden, Martina Maggio Saarland University, Germany / Lund University, SwedenDOI Pre-print
|Conversations on Performance / QoS|