Testing Self-Adaptive Software with Probabilistic Guarantees on Performance MetricsACM SIGSOFT Distinguished Paper Award
This paper discusses the problem of testing the performance of the adaptation layer in a self-adaptive system. The problem is notoriously hard, due to the high degree of uncertainty and variability inherent in an adaptive software application. In particular, providing any type of formal guarantee for this problem is extremely difficult. In this paper we propose the use of a rigorous probabilistic approach to overcome the mentioned difficulties and provide probabilistic guarantees on the software performance. We describe the set up needed for the application of a probabilistic approach. We then discuss the traditional tools from statistics that could be applied to analyse the results, highlighting their limitations and motivating why they are unsuitable for the given problem. We propose the use of a novel tool – \emph{the scenario theory} – to overcome said limitations. We conclude the paper with a thorough empirical evaluation of the proposed approach, using two adaptive software applications: the Tele-Assistance Service and the Self-Adaptive Video Encoder. With the first, we empirically expose the trade-off between data collection and confidence in the testing campaign. With the second, we demonstrate how to compare different adaptation strategies.
Tue 10 NovDisplayed time zone: (UTC) Coordinated Universal Time change
17:30 - 18:00 | |||
17:30 2mTalk | Automatically Identifying Performance Issue Reports with Heuristic Linguistic Patterns Research Papers Yutong Zhao Stevens Institute of Technology, USA, Lu Xiao Stevens Institute of Technology, USA, Pouria Babvey Stevens Institute of Technology, USA, Lei Sun Stevens Institute of Technology, USA, Sunny Wong Analytical Graphics, USA, Angel A. Martinez Analytical Graphics, USA, Xiao Wang Stevens Institute of Technology, USA DOI | ||
17:33 1mTalk | Calm Energy Accounting for Multithreaded Java Applications Research Papers Timur Babakol SUNY Binghamton, USA, Anthony Canino University of Pennsylvania, USA, Khaled Mahmoud SUNY Binghamton, USA, Rachit Saxena SUNY Binghamton, USA, Yu David Liu SUNY Binghamton, USA DOI | ||
17:35 1mTalk | Dynamically Reconfiguring Software Microbenchmarks: Reducing Execution Time without Sacrificing Result Quality Research Papers Christoph Laaber University of Zurich, Switzerland, Stefan Würsten University of Zurich, Switzerland, Harald Gall University of Zurich, Switzerland, Philipp Leitner Chalmers University of Technology, Sweden / University of Gothenburg, Sweden DOI Pre-print Media Attached | ||
17:37 1mTalk | Investigating types and survivability of performance bugs in mobile apps Journal First Alejandro Mazuera-Rozo Università della Svizzera italiana & Universidad de los Andes, Catia Trubiani Gran Sasso Science Institute, Mario Linares-Vásquez Universidad de los Andes, Gabriele Bavota USI Lugano, Switzerland | ||
17:39 1mTalk | Testing Self-Adaptive Software with Probabilistic Guarantees on Performance MetricsACM SIGSOFT Distinguished Paper Award Research Papers Claudio Mandrioli Lund University, Sweden, Martina Maggio Saarland University, Germany / Lund University, Sweden DOI Pre-print | ||
17:41 19mTalk | Conversations on Performance / QoS Paper Presentations Alejandro Mazuera-Rozo Università della Svizzera italiana & Universidad de los Andes, Christoph Laaber University of Zurich, Switzerland, Claudio Mandrioli Lund University, Sweden, Timur Babakol SUNY Binghamton, USA, M: Mei Nagappan University of Waterloo |