Skip to content
Licensed Unlicensed Requires Authentication Published by Oldenbourg Wissenschaftsverlag April 16, 2019

Requirements and Interaction Patterns for a Novel Interaction Device for Patients in Intensive Care

Börge Kordts, Jan Patrick Kopetz, Adrienne Henkel, Andreas Schrader and Nicole Jochems
From the journal i-com


Intensive care patients that are weaned from mechanical ventilation are facing substantial physical and psychical stress. Due to the breathing tube, they often cannot voice their basic needs adequately. Possible consequences, amongst other complications, are a prolonged healing process and a delirium. To address this issue and support patient communication in intensive care, we provide a solution tailored to patients that are dealing with limited cognitive and physiological abilities, hindering them to use traditional devices efficiently. For this purpose, we develop a novel interaction device tailored to the special situation of in-bed interaction.

In this paper, we present key requirements for the device, which are relevant to the interaction itself as well as possible interaction gestures that may be performed with the device. The basis for this is a human-centered design process consisting of a comprehensive user and context analysis, as well as a requirements analysis. As a result, we identified three categories relevant for the interaction, namely look and feel, sensors, and actuators. The results of the requirement analysis were precise enough to start the actual development process of the device.

Funding source: Bundesministerium für Bildung und Forschung

Award Identifier / Grant number: 16SV7689

Funding statement: This publication is part of the research project “ACTIVATE” financed by the Federal Ministry of Education and Research (BMBF, under Grant No. 16SV7689) and promoted by VDI/VDE Innovation + Technik GmbH.


Furthermore, we thank all participants who took part in our studies.


[1] Alham Abuatiq. Patients’ and health care providers’ perception of stressors in the intensive care units. Dimensions of Critical Care Nursing, 34(4):205–214, 2015.10.1097/DCC.0000000000000121Search in Google Scholar

[2] Bashar Altakrouri. (Ambient assisted living with dynamic interaction ensembles. Doctoral thesis, The Department of Computer Sciences/Engineering), University of Luebeck, Luebeck, Germany, August 31 2014.Search in Google Scholar

[3] Bashar Altakrouri and Andreas Schrader. Towards dynamic natural interaction ensembles. In Fourth International Workshop on Physicality, page 1, 2012.10.14236/ewic/HCI2012.85Search in Google Scholar

[4] Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften. S3-Leitlinie: Analgesie, Sedierung und Delirmanagement in der Intensivmedizin 08/2015 – DAS – Leitlinie, August 2015. URL in Google Scholar

[5] Patrick Baudisch, Mike Sinclair, and Andrew Wilson. Soap: a pointing device that works in mid-air. In Proceedings of the 19th annual ACM symposium on User interface software and technology, pages 43–46. ACM, 2006.10.1145/1166253.1166261Search in Google Scholar

[6] T Bohrer, M Koller, T Neubert, A Moldzio, O Beaujean, A Hellinger, W Lorenz, and M Rothmund. Wie erleben allgemeinchirurgische Patienten die Intensivstation? Ergebnisse einer prospektiven Beobachtungsstudie. Der Chirurg, 73(5):443–450, 2002.10.1007/s00104-002-0471-zSearch in Google Scholar

[7] Svenja Burgsmüller, Ann-Katrin Vandereike, Jan Patrick Kopetz, Michael Sengpiel, and Nicole Jochems. Study of Desirable Characteristics of a Communication Device for Intensive Care Patients. In Student Conference Proceedings 2018, Infinite Science Publishing, 2018. ISBN 978-3-945954-47-8.Search in Google Scholar

[8] Helen Carruthers, Felicity Astin, and Wendy Munro. Which alternative communication methods are effective for voiceless patients in Intensive Care Units? A systematic review. Intensive & Critical Care Nursing, 42:88–96, October 2017. ISSN 1532-4036. 10.1016/j.iccn.2017.03.003.Search in Google Scholar

[9] Omid Dehzangi and Muhamed Farooq. Portable Brain-Computer Interface for the Intensive Care Unit Patient Communication Using Subject-Dependent SSVEP Identification, 2018. URL in Google Scholar

[10] Destatis. Gesundheit: Grunddaten Der Krankenhäuser 2017. Number 2120611177004 in Fachserie 12 Reihe 6.1.1. Statistisches Bundesamt (Destatis), 2018.Search in Google Scholar

[11] Bernd Froehlich, Jan Hochstrate, Verena Skuk, and Anke Huckauf. The GlobeFish and the GlobeMouse: Two New Six Degree of Freedom Input Devices for Graphics Applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’06, pages 191–199. ACM, 2006. ISBN 978-1-59593-372-0.10.1145/1124772.1124802Search in Google Scholar

[12] Jonah Garry, Kelly Casey, Therese Kling Cole, Angela Regensburg, Colleen McElroy, Eric Schneider, David Efron, and Albert Chi. A pilot study of eye-tracking devices in intensive care. Surgery, 159(3):938–944, March 2016. ISSN 1532-7361. 10.1016/j.surg.2015.08.012.Search in Google Scholar

[13] Miriam Goldberg, Leigh Hochberg, Dawn Carpenter, Johnny Isenberger, Stephen Heard, and J. Walz. Principles of augmentative and alternative communication system design in the icu setting. UMass Center for Clinical and Translational Science Research Retreat, May 2017. URL in Google Scholar

[14] Miriam Goldberg, Leigh Hochberg, Dawn Carpenter, Johnny Isenberger, Stephen Heard, and J. Walz. Testing a Novel Manual Communication System for Mechanically Ventilated ICU Patients. UMass Center for Clinical and Translational Science Research Retreat, May 2017. URL in Google Scholar

[15] Charlotte Handberg and Anna Katarina Voss. Implementing augmentative and alternative communication in critical care settings: Perspectives of healthcare professionals. Journal of Clinical Nursing, 27(1–2):102–114, January 2018. ISSN 1365-2702. 10.1111/jocn.13851.Search in Google Scholar

[16] Mary Beth Happ, Kathryn Garrett, Dana DiVirgilio Thomas, Judith Tate, Elisabeth George, Martin Houze, Jill Radtke, and Susan Sereika. Nurse-patient communication interactions in the intensive care unit. American Journal of Critical Care: An Official Publication, American Association of Critical-Care Nurses, 20(2):e28–40, March 2011. ISSN 1937-710X. 10.4037/ajcc2011433.Search in Google Scholar

[17] Adrienne Henkel, Björn Hussels, Jan Patrick Kopetz, Susanne Krotsetis, Nicole Jochems, and Katrin Balzer. Nutzer- und Aufgabenanalyse für ein sozio-technisches System zur Unterstützung der Kommunikation und Reorientierung beatmeter Patientinnen und Patienten in Intensivstationen: Ergebnisse und methodische Herausforderungen. In Zukunft der Pflege: Tagungsband der 1. Clusterkonferenz 2018 – Innovative Technologien für die Pflege, 2018.Search in Google Scholar

[18] ISO. 9241-210: 2010. ergonomics of human system interaction-part 210: Human-centred design for interactive systems. International Standardization Organization (ISO). Switzerland, 2009.Search in Google Scholar

[19] Jan Patrick Kopetz, Ann-Katrin Vandereike, Svenja Burgsmüller, Michael Sengpiel, Daniel Wessel, and Nicole Jochems. How should “BIRDY” look and feel? Designing a new interaction device for intensive care patients based on user preferences. In 20th Congress of International Ergonomics Association – IEA 2018, Florence, 2018.Search in Google Scholar

[20] Börge Kordts, Jan Patrick Kopetz, Katrin Balzer, and Nicole Jochems. Requirements for a System Supporting Patient Communication in Intensive Care in Germany. In Zukunft der Pflege: Tagungsband der 1. Clusterkonferenz 2018 – Innovative Technologien für die Pflege, 2018.Search in Google Scholar

[21] Rebecca S. Koszalinski, Ruth M. Tappen, and David Viggiano. Evaluation of Speak for Myself with Patients Who Are Voiceless. Rehabilitation Nursing: The Official Journal of the Association of Rehabilitation Nurses, 40(4):235–242, August 2015. ISSN 0278-4807. 10.1002/rnj.186.Search in Google Scholar

[22] Gernot Marx, Elke Muhl, Kai Zacharowski, and Stefan Zeuzem. Die Intensivmedizin. Springer-Verlag, 2014.10.1007/978-3-642-54953-3Search in Google Scholar

[23] Michael Isfort. Personalsituation in der Intensivpflege – Permanent “am Limit”. BibliomedPflege, (04-2017):22–27, November 2017. URL in Google Scholar

[24] Shio Miyafuji, Toshiki Sato, Zhengqing Li, and Hideki Koike. Qoom: An interactive omnidirectional ball display. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, UIST ’17, pages 599–609. ACM, 2017. ISBN 978-1-4503-4981-9.10.1145/3126594.3126607Search in Google Scholar

[25] Marci Nilsen, Susan M. Sereika, Leslie A. Hoffman, Amber Barnato, Heidi Donovan, and Mary Beth Happ. Nurse and Patient Interaction Behaviors Effects on Nursing Care Quality for Mechanically Ventilated, Older Adults in the ICU. Research in gerontological nursing, 7(3):113–125, May 2014. ISSN 1940-4921. 10.3928/19404921-20140127-02. URL in Google Scholar

[26] Gary Perelman, Marcos Serrano, Mathieu Raynal, Celia Picard, Mustapha Derras, and Emmanuel Dubois. The Roly-Poly Mouse: Designing a Rolling Input Device Unifying 2D and 3D Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, pages 327–336. ACM, New York, NY, USA, 2015. ISBN 978-1-4503-3145-6.Search in Google Scholar

[27] Carmen S. Rodriguez, Meredeth Rowe, Brent Koeppel, Loris Thomas, Michelle S. Troche, and Glenna Paguio. Development of a communication intervention to assist hospitalized suddenly speechless patients. Technology and Health Care: Official Journal of the European Society for Engineering and Medicine, 20(6):489–500, 2012. ISSN 1878-7401. 10.3233/THC-2012-0695.Search in Google Scholar

[28] Louise Rose, Katie N Dainty, Joanne Jordan, and Bronagh Blackwood. Weaning from mechanical ventilation: a scoping review of qualitative studies. American Journal of Critical Care, 23(5):e54–e70, 2014.10.4037/ajcc2014539Search in Google Scholar

[29] Houssem Saidi, Marcos Serrano, Pourang Irani, and Emmanuel Dubois. TDome: A Touch-Enabled 6DOF Interactive Device for Multi-Display Environments. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, pages 5892–5904. ACM, 2017. ISBN 978-1-4503-4655-9. 10.1145/3025453.3025661. URL in Google Scholar

[30] A. W. Schindler, N. Schindler, F. Enz, A. Lueck, T. Olderog, and D. A. Vagts. ICU personnel have inaccurate perceptions of their patients’ experiences. Acta Anaesthesiologica Scandinavica, 57(8):1032–1040, September 2013. ISSN 1399-6576. 10.1111/aas.12148.Search in Google Scholar

[31] Steffen Preuss. ichó · interaktive Förderung für Menschen mit Demenz, 2019. URL in Google Scholar

[32] Shwu-Feng Tsay, Pei-Fan Mu, Shirling Lin, Kai-Wei Katherine Wang, and Yu-Chih Chen. The experiences of adult ventilator-dependent patients: A meta-synthesis review. Nursing & health sciences, 15(4):525–533, 2013.10.1111/nhs.12049Search in Google Scholar

[33] Ann-Katrin Vandereike, Svenja Burgsmüller, Jan Patrick Kopetz, Michael Sengpiel, and Nicole Jochems. Interaction Paradigms of a Ball-Shaped Input Device for Intensive Care Patients. In Student Conference Proceedings 2018, Infinite Science Publishing, 2018. ISBN 978-3-945954-47-8.Search in Google Scholar

[34] Fabio Varesano and Fabiana Vernero. Introducing PALLA, a Novel Input Device for Leisure Activities: A Case Study on a Tangible Video Game for Seniors. In Proceedings of the 4th International Conference on Fun and Games, FnG ’12, pages 35–44. ACM, 2012. ISBN 978-1-4503-1570-8. 10.1145/2367616.2367621. URL in Google Scholar

[35] Nicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges, Eyal Ofek, Alex Butler, Xiang Cao, and Billy Chen. Mouse 2.0: Multi-touch Meets the Mouse. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology, UIST ’09, pages 33–42. ACM, 2009. ISBN 978-1-60558-745-5. 10.1145/1622176.1622184. URL in Google Scholar

[36] Li Wang, Xiao Li, Zongxia Yang, Xueli Tang, Qiang Yuan, Lijing Deng, and Xin Sun. Semi-recumbent position versus supine position for the prevention of ventilator-associated pneumonia in adults requiring mechanical ventilation. The Cochrane Database of Systematic Reviews, (1):CD009946, January 2016. ISSN 1469-493X.10.1002/14651858.CD009946.pub2Search in Google Scholar

Published Online: 2019-04-16
Published in Print: 2019-04-26

© 2019 Walter de Gruyter GmbH, Berlin/Boston