BugsInPy: A Database of Existing Bugs in Python Programs to Enable Controlled Testing and Debugging Studies
The 2019 edition of Stack Overflow developer survey highlights that, for the first time, Python outperformed Java in terms of popularity. The gap between Python and Java further widened in the 2020 edition of the survey. Unfortunately, despite the rapid increase in Python's popularity, there are not many testing and debugging tools that are designed for Python. This is in stark contrast with the abundance of testing and debugging tools for Java. Thus, there is a need to push research on tools that can help Python developers.
One factor that contributed to the rapid growth of Java testing and debugging tools is the availability of benchmarks. A popular benchmark is the Defects4J benchmark; its initial version contained 357 real bugs from 5 real-world Java programs. Each bug comes with a test suite that can expose the bug. Defects4J has been used by hundreds of testing and debugging studies and has helped to push the frontier of research in these directions.
In this project, inspired by Defects4J, we create another benchmark database and tool that contain 493 real bugs from 17 real-world Python programs. We hope our benchmark can help catalyze future work on testing and debugging tools that work on Python programs.
Fri 13 NovDisplayed time zone: (UTC) Coordinated Universal Time change
01:00 - 01:30 | |||
01:00 2mTalk | A Randomized Controlled Trial on the Effects of Embedded Computer Language Switching Research Papers P. Merlin Uesbeck University of Nevada at Las Vegas, USA, Cole S. Peterson University of Nebraska-Lincoln, USA, Bonita Sharif University of Nebraska-Lincoln, USA, Andreas Stefik University of Nevada at Las Vegas, USA DOI | ||
01:03 1mTalk | BugsInPy: A Database of Existing Bugs in Python Programs to Enable Controlled Testing and Debugging Studies Tool Demos Ratnadira Widyasari Singapore Management University, Singapore, Sheng Qin Sim Singapore Management University, Singapore, Camellia Lok Singapore Management University, Singapore, Haodi Qi Singapore Management University, Singapore, Jack Phan Singapore Management University, Singapore, Qijin Tay Singapore Management University, Singapore, Constance Tan Singapore Management University, Singapore, Fiona Wee Singapore Management University, Singapore, Jodie Ethelda Tan Singapore Management University, Singapore, Yuheng Yieh Singapore Management University, Singapore, Brian Goh Singapore Management University, Singapore, Ferdian Thung Singapore Management University, Hong Jin Kang Singapore Management University, Singapore, Thong Hoang Singapore Management University, Singapore, David Lo Singapore Management University, Eng Lieh Ouh Singapore Management University, Singapore DOI | ||
01:05 1mTalk | Do Code Review Measures Explain the Incidence of Post-Release Defects? Case Study Replications and Bayesian Networks Journal First Andrey Krutauz Concordia University, Tapajit Dey Lero - The Irish Software Research Centre and University of Limerick, Peter Rigby Concordia University, Montreal, Canada, Audris Mockus University of Tennessee - Knoxville | ||
01:07 1mTalk | On the Naturalness of Hardware Descriptions Research Papers Jaeseong Lee University of Texas at Austin, USA, Pengyu Nie University of Texas at Austin, USA, Junyi Jessy Li University of Texas at Austin, USA, Milos Gligoric University of Texas at Austin DOI | ||
01:09 1mTalk | Understanding Build Issue Resolution in Practice: Symptoms and Fix Patterns Research Papers Yiling Lou Peking University, China, Zhenpeng Chen Peking University, China, Yanbin Cao Peking University, China, Dan Hao Peking University, China, Lu Zhang Peking University, China DOI | ||
01:11 1mTalk | Understanding Type Changes in Java Research Papers Ameya Ketkar Oregon State University, USA, Nikolaos Tsantalis Concordia University, Canada, Danny Dig University of Colorado Boulder, USA DOI Pre-print Media Attached | ||
01:13 17mTalk | Conversations on Empirical 2 Paper Presentations Cole S. Peterson University of Nebraska-Lincoln, USA, Pengyu Nie University of Texas at Austin, USA, Ratnadira Widyasari Singapore Management University, Singapore, Peter Rigby Concordia University, Montreal, Canada, Yiling Lou Peking University, China, M: Kelly Blincoe University of Auckland | ||