Establishing Key Performance Indicators for Measuring Software-Development Processes at a Large Organization
Developing software systems in large organizations requires the cooperation of various organizational units and stakeholders. As software-development processes are distributed among such organizational units; and are constantly transformed to fulfill new domain regulations, address changing customer requirements, or adopt new software-engineering methods; it is challenging to ensure, measure, and steer—essentially monitor—the quality of the resulting systems. One means to facilitate such monitoring throughout whole software-development processes are key performance indicators, which provide a consolidated analysis of an organizations’ performance. However, it is also challenging to introduce key performance indicators for the software development of a large organization, as they must be implemented at and accepted by all relevant organizational units. In this paper, we report our experiences of introducing new key performance indicators for software-development processes at Volkswagen Financial Services AG, a large organization in the financial sector. We describe i) our methodology; ii) how we customized and use key performance indicators; iii) benefits achieved, namely improved monitoring and comparability, which help to define quality-improving actions; iv) and six lessons learned. These insights are helpful for other practitioners, providing an overview of a methodology they can adopt to assess the feasibility of key performance indicators as well as their benefits. Moreover, we hope to motivate research to investigate methods for introducing and monitoring key performance indicators to facilitate their adoption.
Wed 11 NovDisplayed time zone: (UTC) Coordinated Universal Time change
17:00 - 17:30 | ProductivityJournal First / Student Research Competition / Paper Presentations / Industry Papers / Tool Demos at Virtual room 2 | ||
17:00 2mTalk | Assisting the Elite-driven Open Source Development through Activity Data Paper Presentations Zhendong Wang University of California, Irvine | ||
17:03 1mTalk | Attention Tracking for Developers Student Research Competition Rozaliya Amirova Innopolis University, Russia DOI | ||
17:05 1mTalk | CRSG: A Serious Game for Teaching Code Review Tool Demos Link to publication DOI Authorizer link Pre-print | ||
17:07 1mTalk | Establishing Key Performance Indicators for Measuring Software-Development Processes at a Large Organization Industry Papers Cem Sürücü Volkswagen Financial Services, Germany / University of Magdeburg, Germany, Bianying Song Volkswagen Financial Services, Germany, Jacob Krüger University of Magdeburg, Germany, Gunter Saake University of Magdeburg, Germany, Thomas Leich Harz University of Applied Sciences, Germany DOI | ||
17:09 1mTalk | How to Succeed in the Software Business While Giving Away the Source Code: The AdaCore Experience Journal First Ben Brosgol AdaCore | ||
17:11 1mTalk | The End of the Myth of Individual Programmer Productivity Journal First William R. Nichols Carnegie Mellon University/Software Engineering Institute | ||
17:12 2mTalk | Unveiling Elite Developers’ Activities in Open Source Projects Journal First Zhendong Wang University of California, Irvine, Yang Feng Nanjing University, Yi Wang CoCo Labs, USA, James Jones University of California, Irvine, David Redmiles University of California, Irvine | ||
17:14 16mTalk | Conversations on Productivity Paper Presentations Ben Brosgol AdaCore, Kaan Ünlü Bilkent University, Rozaliya Amirova Innopolis University, Russia, Zhendong Wang University of California, Irvine, William R. Nichols Carnegie Mellon University/Software Engineering Institute, M: Alexander Serebrenik Eindhoven University of Technology |