Jump to ContentJump to Main Navigation
Show Summary Details
More options …


Journal of Interactive Media

Editor-in-Chief: Ziegler, Jürgen

See all formats and pricing
More options …
Volume 18, Issue 1


Requirements and Interaction Patterns for a Novel Interaction Device for Patients in Intensive Care

Börge Kordts / Jan Patrick Kopetz / Adrienne Henkel / Andreas Schrader / Nicole Jochems
Published Online: 2019-04-16 | DOI: https://doi.org/10.1515/icom-2019-0004


Intensive care patients that are weaned from mechanical ventilation are facing substantial physical and psychical stress. Due to the breathing tube, they often cannot voice their basic needs adequately. Possible consequences, amongst other complications, are a prolonged healing process and a delirium. To address this issue and support patient communication in intensive care, we provide a solution tailored to patients that are dealing with limited cognitive and physiological abilities, hindering them to use traditional devices efficiently. For this purpose, we develop a novel interaction device tailored to the special situation of in-bed interaction.

In this paper, we present key requirements for the device, which are relevant to the interaction itself as well as possible interaction gestures that may be performed with the device. The basis for this is a human-centered design process consisting of a comprehensive user and context analysis, as well as a requirements analysis. As a result, we identified three categories relevant for the interaction, namely look and feel, sensors, and actuators. The results of the requirement analysis were precise enough to start the actual development process of the device.

Keywords: Intensive Care Unit; Mechanical Ventilation; Weaning; Human-Computer Interaction; Ambient Computing; Human Centered Design; Augmentative and Alternative Communication


  • [1]

    Alham Abuatiq. Patients’ and health care providers’ perception of stressors in the intensive care units. Dimensions of Critical Care Nursing, 34(4):205–214, 2015.Web of ScienceCrossrefGoogle Scholar

  • [2]

    Bashar Altakrouri. (Ambient assisted living with dynamic interaction ensembles. Doctoral thesis, The Department of Computer Sciences/Engineering), University of Luebeck, Luebeck, Germany, August 31 2014.Google Scholar

  • [3]

    Bashar Altakrouri and Andreas Schrader. Towards dynamic natural interaction ensembles. In Fourth International Workshop on Physicality, page 1, 2012.Google Scholar

  • [4]

    Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften. S3-Leitlinie: Analgesie, Sedierung und Delirmanagement in der Intensivmedizin 08/2015 – DAS – Leitlinie, August 2015. URL https://www.awmf.org/uploads/tx_szleitlinien/001-012l_S3_Analgesie_Sedierung_Delirmanagement_Intensivmedizin_2015-08_01.pdf.Google Scholar

  • [5]

    Patrick Baudisch, Mike Sinclair, and Andrew Wilson. Soap: a pointing device that works in mid-air. In Proceedings of the 19th annual ACM symposium on User interface software and technology, pages 43–46. ACM, 2006.Google Scholar

  • [6]

    T Bohrer, M Koller, T Neubert, A Moldzio, O Beaujean, A Hellinger, W Lorenz, and M Rothmund. Wie erleben allgemeinchirurgische Patienten die Intensivstation? Ergebnisse einer prospektiven Beobachtungsstudie. Der Chirurg, 73(5):443–450, 2002.CrossrefGoogle Scholar

  • [7]

    Svenja Burgsmüller, Ann-Katrin Vandereike, Jan Patrick Kopetz, Michael Sengpiel, and Nicole Jochems. Study of Desirable Characteristics of a Communication Device for Intensive Care Patients. In Student Conference Proceedings 2018, Infinite Science Publishing, 2018. ISBN 978-3-945954-47-8.Google Scholar

  • [8]

    Helen Carruthers, Felicity Astin, and Wendy Munro. Which alternative communication methods are effective for voiceless patients in Intensive Care Units? A systematic review. Intensive & Critical Care Nursing, 42:88–96, October 2017. ISSN 1532-4036. .CrossrefWeb of ScienceGoogle Scholar

  • [9]

    Omid Dehzangi and Muhamed Farooq. Portable Brain-Computer Interface for the Intensive Care Unit Patient Communication Using Subject-Dependent SSVEP Identification, 2018. URL https://www.hindawi.com/journals/bmri/2018/9796238/abs/.Google Scholar

  • [10]

    Destatis. Gesundheit: Grunddaten Der Krankenhäuser 2017. Number 2120611177004 in Fachserie 12 Reihe 6.1.1. Statistisches Bundesamt (Destatis), 2018.

  • [11]

    Bernd Froehlich, Jan Hochstrate, Verena Skuk, and Anke Huckauf. The GlobeFish and the GlobeMouse: Two New Six Degree of Freedom Input Devices for Graphics Applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’06, pages 191–199. ACM, 2006. ISBN 978-1-59593-372-0.Google Scholar

  • [12]

    Jonah Garry, Kelly Casey, Therese Kling Cole, Angela Regensburg, Colleen McElroy, Eric Schneider, David Efron, and Albert Chi. A pilot study of eye-tracking devices in intensive care. Surgery, 159(3):938–944, March 2016. ISSN 1532-7361. .CrossrefWeb of ScienceGoogle Scholar

  • [13]

    Miriam Goldberg, Leigh Hochberg, Dawn Carpenter, Johnny Isenberger, Stephen Heard, and J. Walz. Principles of augmentative and alternative communication system design in the icu setting. UMass Center for Clinical and Translational Science Research Retreat, May 2017. URL https://escholarship.umassmed.edu/cts_retreat/2017/posters/27.Google Scholar

  • [14]

    Miriam Goldberg, Leigh Hochberg, Dawn Carpenter, Johnny Isenberger, Stephen Heard, and J. Walz. Testing a Novel Manual Communication System for Mechanically Ventilated ICU Patients. UMass Center for Clinical and Translational Science Research Retreat, May 2017. URL https://escholarship.umassmed.edu/cts_retreat/2017/posters/28.Google Scholar

  • [15]

    Charlotte Handberg and Anna Katarina Voss. Implementing augmentative and alternative communication in critical care settings: Perspectives of healthcare professionals. Journal of Clinical Nursing, 27(1–2):102–114, January 2018. ISSN 1365-2702. .CrossrefWeb of ScienceGoogle Scholar

  • [16]

    Mary Beth Happ, Kathryn Garrett, Dana DiVirgilio Thomas, Judith Tate, Elisabeth George, Martin Houze, Jill Radtke, and Susan Sereika. Nurse-patient communication interactions in the intensive care unit. American Journal of Critical Care: An Official Publication, American Association of Critical-Care Nurses, 20(2):e28–40, March 2011. ISSN 1937-710X. .CrossrefGoogle Scholar

  • [17]

    Adrienne Henkel, Björn Hussels, Jan Patrick Kopetz, Susanne Krotsetis, Nicole Jochems, and Katrin Balzer. Nutzer- und Aufgabenanalyse für ein sozio-technisches System zur Unterstützung der Kommunikation und Reorientierung beatmeter Patientinnen und Patienten in Intensivstationen: Ergebnisse und methodische Herausforderungen. In Zukunft der Pflege: Tagungsband der 1. Clusterkonferenz 2018 – Innovative Technologien für die Pflege, 2018.Google Scholar

  • [18]

    ISO. 9241-210: 2010. ergonomics of human system interaction-part 210: Human-centred design for interactive systems. International Standardization Organization (ISO). Switzerland, 2009.

  • [19]

    Jan Patrick Kopetz, Ann-Katrin Vandereike, Svenja Burgsmüller, Michael Sengpiel, Daniel Wessel, and Nicole Jochems. How should “BIRDY” look and feel? Designing a new interaction device for intensive care patients based on user preferences. In 20th Congress of International Ergonomics Association – IEA 2018, Florence, 2018.Google Scholar

  • [20]

    Börge Kordts, Jan Patrick Kopetz, Katrin Balzer, and Nicole Jochems. Requirements for a System Supporting Patient Communication in Intensive Care in Germany. In Zukunft der Pflege: Tagungsband der 1. Clusterkonferenz 2018 – Innovative Technologien für die Pflege, 2018.Google Scholar

  • [21]

    Rebecca S. Koszalinski, Ruth M. Tappen, and David Viggiano. Evaluation of Speak for Myself with Patients Who Are Voiceless. Rehabilitation Nursing: The Official Journal of the Association of Rehabilitation Nurses, 40(4):235–242, August 2015. ISSN 0278-4807. .CrossrefGoogle Scholar

  • [22]

    Gernot Marx, Elke Muhl, Kai Zacharowski, and Stefan Zeuzem. Die Intensivmedizin. Springer-Verlag, 2014.Google Scholar

  • [23]

    Michael Isfort. Personalsituation in der Intensivpflege – Permanent “am Limit”. BibliomedPflege, (04-2017):22–27, November 2017. URL https://www.bibliomed-pflege.de/zeitschriften/pflegenintensiv/heftarchiv/ausgabe/artikel/pi-4-2017-das-intensivtagebuch-bruecke-zur-erinnerung/33646-permanent-am-limit/.Google Scholar

  • [24]

    Shio Miyafuji, Toshiki Sato, Zhengqing Li, and Hideki Koike. Qoom: An interactive omnidirectional ball display. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST ’17, pages 599–609. ACM, 2017. ISBN 978-1-4503-4981-9.Google Scholar

  • [25]

    Marci Nilsen, Susan M. Sereika, Leslie A. Hoffman, Amber Barnato, Heidi Donovan, and Mary Beth Happ. Nurse and Patient Interaction Behaviors Effects on Nursing Care Quality for Mechanically Ventilated, Older Adults in the ICU. Research in gerontological nursing, 7(3):113–125, May 2014. ISSN 1940-4921. . URL https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4040337/.CrossrefWeb of ScienceGoogle Scholar

  • [26]

    Gary Perelman, Marcos Serrano, Mathieu Raynal, Celia Picard, Mustapha Derras, and Emmanuel Dubois. The Roly-Poly Mouse: Designing a Rolling Input Device Unifying 2D and 3D Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, pages 327–336. ACM, New York, NY, USA, 2015. ISBN 978-1-4503-3145-6.Google Scholar

  • [27]

    Carmen S. Rodriguez, Meredeth Rowe, Brent Koeppel, Loris Thomas, Michelle S. Troche, and Glenna Paguio. Development of a communication intervention to assist hospitalized suddenly speechless patients. Technology and Health Care: Official Journal of the European Society for Engineering and Medicine, 20(6):489–500, 2012. ISSN 1878-7401. .CrossrefGoogle Scholar

  • [28]

    Louise Rose, Katie N Dainty, Joanne Jordan, and Bronagh Blackwood. Weaning from mechanical ventilation: a scoping review of qualitative studies. American Journal of Critical Care, 23(5):e54–e70, 2014.CrossrefGoogle Scholar

  • [29]

    Houssem Saidi, Marcos Serrano, Pourang Irani, and Emmanuel Dubois. TDome: A Touch-Enabled 6DOF Interactive Device for Multi-Display Environments. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, pages 5892–5904. ACM, 2017. ISBN 978-1-4503-4655-9. . URL http://doi.acm.org/10.1145/3025453.3025661.CrossrefGoogle Scholar

  • [30]

    A. W. Schindler, N. Schindler, F. Enz, A. Lueck, T. Olderog, and D. A. Vagts. ICU personnel have inaccurate perceptions of their patients’ experiences. Acta Anaesthesiologica Scandinavica, 57(8):1032–1040, September 2013. ISSN 1399-6576. .CrossrefWeb of ScienceGoogle Scholar

  • [31]

    Steffen Preuss. ichó · interaktive Förderung für Menschen mit Demenz, 2019. URL https://icho-systems.de/.Google Scholar

  • [32]

    Shwu-Feng Tsay, Pei-Fan Mu, Shirling Lin, Kai-Wei Katherine Wang, and Yu-Chih Chen. The experiences of adult ventilator-dependent patients: A meta-synthesis review. Nursing & health sciences, 15(4):525–533, 2013.CrossrefWeb of ScienceGoogle Scholar

  • [33]

    Ann-Katrin Vandereike, Svenja Burgsmüller, Jan Patrick Kopetz, Michael Sengpiel, and Nicole Jochems. Interaction Paradigms of a Ball-Shaped Input Device for Intensive Care Patients. In Student Conference Proceedings 2018, Infinite Science Publishing, 2018. ISBN 978-3-945954-47-8.Google Scholar

  • [34]

    Fabio Varesano and Fabiana Vernero. Introducing PALLA, a Novel Input Device for Leisure Activities: A Case Study on a Tangible Video Game for Seniors. In Proceedings of the 4th International Conference on Fun and Games, FnG ’12, pages 35–44. ACM, 2012. ISBN 978-1-4503-1570-8. . URL http://doi.acm.org/10.1145/2367616.2367621.CrossrefGoogle Scholar

  • [35]

    Nicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges, Eyal Ofek, Alex Butler, Xiang Cao, and Billy Chen. Mouse 2.0: Multi-touch Meets the Mouse. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology, UIST ’09, pages 33–42. ACM, 2009. ISBN 978-1-60558-745-5. . URL http://doi.acm.org/10.1145/1622176.1622184.CrossrefGoogle Scholar

  • [36]

    Li Wang, Xiao Li, Zongxia Yang, Xueli Tang, Qiang Yuan, Lijing Deng, and Xin Sun. Semi-recumbent position versus supine position for the prevention of ventilator-associated pneumonia in adults requiring mechanical ventilation. The Cochrane Database of Systematic Reviews, (1):CD009946, January 2016. ISSN 1469-493X.Web of ScienceGoogle Scholar

About the article

Börge Kordts

Börge Kordts (PhD student, M.Sc. in Computer Science) is a researcher and member of the Ambient Computing Group at the Institute of Telematics (ITM) of the University of Lübeck. His research interests include human computer interaction in smart spaces, accessibility, and digital healthcare.

Jan Patrick Kopetz

Jan Patrick Kopetz (PhD student, M.Sc. in Media Informatics) is a researcher at the Institute for Multimedia and Interactive Systems (IMIS) of the University of Lubeck. His research interests include human computer interaction, new interaction devices, mobile media, augmented reality, and digital healthcare.

Adrienne Henkel

Adrienne Henkel (M.Sc. Health and Nursing Science) is a research assistant at the Institute for Social Medicine and Epidemiology (ISE), University of Lubeck. Her research interests include clinical nursing research and digital technologies in healthcare, especially in nursing.

Andreas Schrader

Andreas Schrader (PhD in Computer Science) is a Professor for Ambient Computing and head of the Ambient Computing Working Group at the Institute of Telematics (ITM) at the University of Lübeck. His research interests include human interaction in smart spaces with a special focus on frameworks for the development of ambient health systems.

Nicole Jochems

Nicole Jochems (PhD in Engineering) is a Professor for Media Informatics and Head of the Media Informatics Programme at the Institute for Multimedia and Interactive Systems (IMIS) of the University of Lubeck. Her research interests include methods in the area of human-centerd design, age-specific design, virtual- and augmented reality, and digital healthcare.

Published Online: 2019-04-16

Published in Print: 2019-04-26

Funding Source: Bundesministerium für Bildung und Forschung

Award identifier / Grant number: 16SV7689

This publication is part of the research project “ACTIVATE” financed by the Federal Ministry of Education and Research (BMBF, under Grant No. 16SV7689) and promoted by VDI/VDE Innovation + Technik GmbH.

Citation Information: i-com, Volume 18, Issue 1, Pages 67–78, ISSN (Online) 2196-6826, ISSN (Print) 1618-162X, DOI: https://doi.org/10.1515/icom-2019-0004.

Export Citation

© 2019 Walter de Gruyter GmbH, Berlin/Boston.Get Permission

Comments (0)

Please log in or register to comment.
Log in