Write a Blog >>
Tue 10 Nov 2020 17:11 - 17:12 at Virtual room 2 - Empirical

\emph{Atoms of confusion} are small patterns of code
that have been empirically validated to be difficult to hand-evaluate by
programmers. Previous research focused on defining and quantifying this
phenomenon, but not on explaining or critiquing it. In this work, we address core
omissions to the body of work on atoms of confusion, focusing on the how' andwhy' of programmer misunderstanding.

We performed a think-aloud study in which we observed programmers, both
professionals and students, as they hand-evaluated confusing code. We
performed a qualitative analysis of the data and found several
surprising results, which explain previous results, outline
avenues of further research, and suggest improvements of the
research methodology.

A notable observation is that correct hand-evaluations do not imply
understanding, and incorrect evaluations not misunderstanding.
We believe this and other observations may be used to
improve future studies and models of program comprehension. We argue
that thinking of confusion as an atomic construct may pose challenges to
formulating new candidates for atoms of confusion.
Ultimately, we question
whether hand-evaluation correctness is, itself, a
sufficient instrument to study program comprehension.

Tue 10 Nov

Displayed time zone: (UTC) Coordinated Universal Time change

17:00 - 17:30
17:00
2m
Talk
An Empirical Analysis of the Costs of Clone- and Platform-Oriented Software Reuse
Research Papers
Jacob Krüger University of Magdeburg, Germany, Thorsten Berger Chalmers University of Technology, Sweden / University of Gothenburg, Sweden
DOI
17:03
1m
Talk
Community Expectations for Research Artifacts and Evaluation ProcessesACM SIGSOFT Distinguished Paper Award
Research Papers
Ben Hermann Technical University Dortmund, Stefan Winter TU Darmstadt, Janet Siegmund TU Chemnitz, Germany
DOI Pre-print Media Attached
17:05
1m
Talk
On the Relationship between Design Discussions and Design Quality: A Case Study of Apache Projects
Research Papers
Umme Ayda Mannan Oregon State University, USA, Iftekhar Ahmed University of California at Irvine, USA, Carlos Jensen Oregon State University, USA, Anita Sarma Oregon State University, USA
DOI
17:07
1m
Talk
On the Relationship between Refactoring Actions and Bugs: A Differentiated Replication
Research Papers
Massimiliano Di Penta University of Sannio, Italy, Gabriele Bavota USI Lugano, Switzerland, Fiorella Zampetti University of Sannio, Italy
DOI
17:09
1m
Talk
The 'as Code' Activities: Development Anti-patterns for Infrastructure as Code
Journal First
Akond Rahman Tennessee Tech University, Effat Farhana NC State University, Laurie Williams North Carolina State University
Link to publication DOI Pre-print Media Attached
17:11
1m
Talk
Thinking Aloud about Confusing Code: A Qualitative Investigation of Program Comprehension and Atoms of Confusion
Research Papers
Dan Gopstein New York University, USA, Anne-Laure Fayard New York University, USA, Sven Apel Saarland University, Germany, Justin Cappos New York University, USA
DOI Pre-print
17:13
17m
Talk
Conversations on Empirical 1
Paper Presentations
Akond Rahman Tennessee Tech University, Ben Hermann Technical University Dortmund, Iftekhar Ahmed University of California at Irvine, USA, Jacob Krüger University of Magdeburg, Germany, Massimiliano Di Penta University of Sannio, Italy, M: Brittany Johnson George Mason University