Software engineering candidates commonly participate in whiteboard technical interviews as part of a hiring assessment. During these sessions, candidates write code while thinking aloud as they work towards a solution, under the watchful eye of an interviewer. While technical interviews should allow for an unbiased and inclusive assessment of problem-solving ability, surprisingly, technical interviews may be instead a procedure for identifying candidates who best handle and migrate stress solely caused by being examined by an interviewer (performance anxiety).
To understand if coding interviews{—}as administered today{—}can induce stress that significantly hinders performance, we conducted a randomized controlled trial with 48 Computer Science students, comparing them in private and public whiteboard settings. We found that performance is reduced by more than half, by simply being watched by an interviewer. We also observed that stress and cognitive load were significantly higher in a traditional technical interview when compared with our private interview. Consequently, interviewers may be filtering out qualified candidates by confounding assessment of problem-solving ability with unnecessary stress. We propose interview modifications to make problem-solving assessment more equitable and inclusive, such as through private focus sessions and retrospective think-aloud, allowing companies to hire from a larger and diverse pool of talent.
Thu 12 NovDisplayed time zone: (UTC) Coordinated Universal Time change
01:30 - 02:00 | |||
01:30 2mTalk | A First Look at Good First Issues on GitHub Research Papers Xin Tan Peking University, China, Minghui Zhou Peking University, China, Zeyu Sun Peking University, China DOI | ||
01:32 2mTalk | A Theory of the Engagement in Open Source Projects via Summer of Code Programs Research Papers Jefferson Silva PUC-SP, Brazil, Igor Wiese Federal University of Technology Paraná, Brazil, Daniel M. German University of Victoria, Canada, Christoph Treude University of Adelaide, Australia, Marco Gerosa Northern Arizona University, USA, Igor Steinmacher Northern Arizona University, USA DOI | ||
01:35 1mTalk | Biases and Differences in Code Review using Medical Imaging and Eye-Tracking: Genders, Humans, and Machines Research Papers Yu Huang University of Michigan, Kevin Leach University of Michigan, Zohreh Sharafi University of Michigan, Nicholas McKay University of Michigan, USA, Tyler Santander University of California at Santa Barbara, Westley Weimer University of Michigan, USA DOI | ||
01:37 1mTalk | Does Stress Impact Technical Interview Performance? Research Papers Mahnaz (Mana) Behroozi North Carolina State University, USA, Shivani Shirolkar North Carolina State University, USA, Titus Barik Microsoft, USA, Chris Parnin North Carolina State University, USA DOI | ||
01:39 1mTalk | Reducing Implicit Gender Biases in Software Development: Does Intergroup Contact Theory Work? Research Papers DOI | ||
01:41 19mTalk | Conversations on Community Paper Presentations Kelly Blincoe University of Auckland, Mahnaz (Mana) Behroozi North Carolina State University, USA, Xin Tan Peking University, China, Yi Wang Rochester Institute of Technology, Yu Huang University of Michigan, M: Peter Rigby Concordia University, Montreal, Canada |