Write a Blog >>
Tue 10 Nov 2020 17:11 - 17:12 at Virtual room 2 - Empirical

\emph{Atoms of confusion} are small patterns of code
that have been empirically validated to be difficult to hand-evaluate by
programmers. Previous research focused on defining and quantifying this
phenomenon, but not on explaining or critiquing it. In this work, we address core
omissions to the body of work on atoms of confusion, focusing on the how' andwhy' of programmer misunderstanding.

We performed a think-aloud study in which we observed programmers, both
professionals and students, as they hand-evaluated confusing code. We
performed a qualitative analysis of the data and found several
surprising results, which explain previous results, outline
avenues of further research, and suggest improvements of the
research methodology.

A notable observation is that correct hand-evaluations do not imply
understanding, and incorrect evaluations not misunderstanding.
We believe this and other observations may be used to
improve future studies and models of program comprehension. We argue
that thinking of confusion as an atomic construct may pose challenges to
formulating new candidates for atoms of confusion.
Ultimately, we question
whether hand-evaluation correctness is, itself, a
sufficient instrument to study program comprehension.

Tue 10 Nov
Times are displayed in time zone: (UTC) Coordinated Universal Time change

17:00 - 17:02
An Empirical Analysis of the Costs of Clone- and Platform-Oriented Software Reuse
Research Papers
Jacob KrügerUniversity of Magdeburg, Germany, Thorsten BergerChalmers University of Technology, Sweden / University of Gothenburg, Sweden
17:03 - 17:04
Community Expectations for Research Artifacts and Evaluation ProcessesACM SIGSOFT Distinguished Paper Award
Research Papers
Ben HermannTechnical University Dortmund, Stefan WinterTU Darmstadt, Janet SiegmundTU Chemnitz, Germany
DOI Pre-print Media Attached
17:05 - 17:06
On the Relationship between Design Discussions and Design Quality: A Case Study of Apache Projects
Research Papers
Umme Ayda MannanOregon State University, USA, Iftekhar AhmedUniversity of California at Irvine, USA, Carlos JensenOregon State University, USA, Anita SarmaOregon State University, USA
17:07 - 17:08
On the Relationship between Refactoring Actions and Bugs: A Differentiated Replication
Research Papers
Massimiliano Di PentaUniversity of Sannio, Italy, Gabriele BavotaUSI Lugano, Switzerland, Fiorella ZampettiUniversity of Sannio, Italy
17:09 - 17:10
The 'as Code' Activities: Development Anti-patterns for Infrastructure as Code
Journal First
Akond RahmanTennessee Tech University, Effat FarhanaNC State University, Laurie WilliamsNorth Carolina State University
Link to publication DOI Pre-print Media Attached
17:11 - 17:12
Thinking Aloud about Confusing Code: A Qualitative Investigation of Program Comprehension and Atoms of Confusion
Research Papers
Dan Gopstein New York University, USA, Anne-Laure FayardNew York University, USA, Sven ApelSaarland University, Germany, Justin CapposNew York University, USA
DOI Pre-print
17:13 - 17:30
Conversations on Empirical 1
Paper Presentations
Akond RahmanTennessee Tech University, Ben HermannTechnical University Dortmund, Iftekhar AhmedUniversity of California at Irvine, USA, Jacob KrügerOtto von Guericke University Magdeburg, Massimiliano Di PentaUniversity of Sannio, Italy, M: Brittany JohnsonGeorge Mason University