Jump to ContentJump to Main Navigation
Show Summary Details
More options …

it - Information Technology

Methods and Applications of Informatics and Information Technology

Editor-in-Chief: Conrad, Stefan

See all formats and pricing
More options …
Volume 61, Issue 4


Explainable software systems

Prof. Dr. Andreas Vogelsang
Published Online: 2019-07-02 | DOI: https://doi.org/10.1515/itit-2019-0015


Software and software-controlled technical systems play an increasing role in our daily lives. In cyber-physical systems, which connect the physical and the digital world, software does not only influence how we perceive and interact with our environment but software also makes decisions that influence our behavior. Therefore, the ability of software systems to explain their behavior and decisions will become an important property that will be crucial for their acceptance in our society. We call software systems with this ability explainable software systems. In the past, we have worked on methods and tools to design explainable software systems. In this article, we highlight some of our work on how to design explainable software systems. More specifically, we describe an architectural framework for designing self-explainable software systems, which is based on the MAPE-loop for self-adaptive systems. Afterward, we show that explainability is also important for tools that are used by engineers during the development of software systems. We show examples from the area of requirements engineering where we use techniques from natural language processing and neural networks to help engineers comprehend the complex information structures embedded in system requirements.

Keywords: Explainability; quality attributes; cyber-physical systems

ACM CCS: Software and its engineeringSoftware creation and managementDesigning softwareSoftware and its engineeringSoftware organization and propertiesExtra-functional properties


  • 1.

    F. Chiyah Garcia, D. Robb, X. Liu, A. Laskov, P. Patron, and H. Hastie. Explain Yourself: A natural language interface for scrutable autonomous robots. Proceedings of the Explainable Robotic Systems Workshop (HRI), 2018.Google Scholar

  • 2.

    H. Femmer, D. Méndez Fernández, S. Wagner, and S. Eder. Rapid quality assurance with requirements smells. Journal of Software and Systems (JSS), 123:190–213, 2016.Web of ScienceGoogle Scholar

  • 3.

    J. Hayes, A. Dekhtyar, and J. Osborne. Improving requirements tracing via information retrieval. Proceedings of the 11th IEEE International Requirements Engineering Conference (RE), pp. 138–147, 2003.Google Scholar

  • 4.

    IBM. An Architectural Blueprint for Autonomic Computing. White Paper, 2005.

  • 5.

    P. Le Bras, D. Robb, T. Methven, S. Padilla, and M. Chantler. Improving user confidence in concept maps: Exploring data driven explanations. Proceedings of the Conference on Human Factors in Computing Systems (CHI), pp. 1–13, 2018.Google Scholar

  • 6.

    B. Lim, A. Dey, and D. Avrahami. Why and why not explanations improve the intelligibility of context-aware intelligent systems. Proceedings of the Conference on Human Factors in Computing Systems (CHI), pp. 2119–2129, 2009.Google Scholar

  • 7.

    A. Perini, A. Susi, and P. Avesani. A machine learning approach to software requirements prioritization. IEEE Transactions on Software Engineering (TSE), 39(4):445–461, 2013.Web of ScienceCrossrefGoogle Scholar

  • 8.

    J. Winkler and A. Vogelsang. Automatic classification of requirements based on convolutional neural networks. Proceedings of the IEEE 24th International Requirements Engineering Conference Workshops (REW), pp. 39–45, 2016.Google Scholar

  • 9.

    J. Winkler and A. Vogelsang. “What does my classifier learn?” A visual approach to understanding natural language text classifiers. Proceedings of the 22nd International Conference on Natural Language & Information Systems (NLDB), pp. 468–479, 2017.Google Scholar

  • 10.

    J. Winkler and A. Vogelsang. Using Tools to Assist Identification of Non-requirements in Requirements Specifications–A Controlled Experiment. Proceedings of the 24th International Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ), pp. 57–71, 2018.Google Scholar

About the article

Prof. Dr. Andreas Vogelsang

Prof. Dr. Andreas Vogelsang is an assistant professor (junior professor) for software engineering at the Berlin Institute of Technology (TU Berlin). He is leading the software engineering group at the Daimler Center for Automotive IT Innovations (DCAITI). He received a Ph. D. from the Technical University of Munich in 2015. His research interests comprise requirements engineering, model-based systems engineering, and software architectures for embedded systems. He has published his research in international journals and conferences such as IEEE Software, SoSyM, ICSE, and RE. In 2018, he was appointed as Junior-Fellow of the German Society for Informatics (GI).

Received: 2019-05-14

Accepted: 2019-05-14

Published Online: 2019-07-02

Published in Print: 2019-08-27

Citation Information: it - Information Technology, Volume 61, Issue 4, Pages 193–196, ISSN (Online) 2196-7032, ISSN (Print) 1611-2776, DOI: https://doi.org/10.1515/itit-2019-0015.

Export Citation

© 2019 Walter de Gruyter GmbH, Berlin/Boston.Get Permission

Comments (0)

Please log in or register to comment.
Log in