Biases and Differences in Code Review using Medical Imaging and Eye-Tracking: Genders, Humans, and Machines
Code review is a critical step in modern software quality assurance, yet it is vulnerable to human biases.
Previous studies have clarified the extent of the problem, particularly regarding biases against the authors of code,but no consensus understanding has emerged.
Advances in medical imaging are increasingly applied to software engineering, supporting grounded neurobiological explorations of computing activities, including the review, reading, and writing of source code.
In this paper, we present the results of a controlled experiment using both medical imaging and also eye tracking to investigate the neurological correlates of biases and differences between genders of humans and machines (e.g., automated program repair tools) in code review.
We find that men and women conduct code reviews differently, in ways that are measurable and supported by behavioral, eye-tracking and medical imaging data.
We also find biases in how humans review code as a function of its apparent author, when controlling for code quality.
In addition to advancing our fundamental understanding of how cognitive biases relate to the code review process, the results may inform subsequent training and tool design to reduce bias.
Thu 12 NovDisplayed time zone: (UTC) Coordinated Universal Time change
01:30 - 02:00
CommunityPaper Presentations / Research Papers at Virtual room 1
|A First Look at Good First Issues on GitHub|
Xin Tan Peking University, China, Minghui Zhou Peking University, China, Zeyu Sun Peking University, ChinaDOI
|A Theory of the Engagement in Open Source Projects via Summer of Code Programs|
Jefferson Silva PUC-SP, Brazil, Igor Wiese Federal University of Technology Paraná, Brazil, Daniel M. German University of Victoria, Canada, Christoph Treude University of Adelaide, Australia, Marco Gerosa Northern Arizona University, USA, Igor Steinmacher Northern Arizona University, USADOI
|Biases and Differences in Code Review using Medical Imaging and Eye-Tracking: Genders, Humans, and Machines|
Yu Huang University of Michigan, Kevin Leach University of Michigan, Zohreh Sharafi University of Michigan, Nicholas McKay University of Michigan, USA, Tyler Santander University of California at Santa Barbara, Westley Weimer University of Michigan, USADOI
|Does Stress Impact Technical Interview Performance?|
Mahnaz (Mana) Behroozi North Carolina State University, USA, Shivani Shirolkar North Carolina State University, USA, Titus Barik Microsoft, USA, Chris Parnin North Carolina State University, USADOI
|Reducing Implicit Gender Biases in Software Development: Does Intergroup Contact Theory Work?|
|Conversations on Community|
Kelly Blincoe University of Auckland, Mahnaz (Mana) Behroozi North Carolina State University, USA, Xin Tan Peking University, China, Yi Wang Rochester Institute of Technology, Yu Huang University of Michigan, M: Peter Rigby Concordia University, Montreal, Canada