Jump to ContentJump to Main Navigation
Show Summary Details
More options …


Journal of Interactive Media

Editor-in-Chief: Ziegler, Jürgen

3 Issues per year

See all formats and pricing
More options …
Volume 15, Issue 2


Photo-enriched Documentation during Surgeries with Google Glass: An Exploratory Usability Study in a Department of Paediatric Surgery

Tilo Mentler
  • Corresponding author
  • Institute for Multimedia and Interactive Systems, University of Luebeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Janosch Kappel / Lutz Wünsch / Michael Herczeg
  • Institute for Multimedia and Interactive Systems, University of Luebeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
Published Online: 2016-08-16 | DOI: https://doi.org/10.1515/icom-2016-0017


Due to hygienic regulations and mobility requirements, medical professionals show great interest in wearable devices allowing for hands-free interaction and ubiquitous information access. Smartglasses like the prototype “Google Glass” have already been evaluated in pre-hospital as well as clinical medical care. Based on laboratory studies according to the reliability of voice and gesture recognition and field studies during four surgeries in the department of paediatric surgeries, we discuss usability and acceptance of smartglasses for photo-enriched documentation during surgeries. While technical limitations (e. g. poor camera quality) have to be overcome, usable solutions for human-smartglasses interaction by voice and gesture recognition seem to be possible midterm. Surgeons and other members of surgical teams are curious about smartglasses in their working environment. This can be a starting point for a wider use, if user interface and interaction design for smartglasses are further explored and developed in a user-centered process meeting their requirements. In this regard, transmodal consistency is recommended as a design principle for applications supporting multiple input and output modalities.

Keywords: Smartglasses; Surgery; Usability; Field Study; Photo-enriched Documentation


  • [1]

    Albrecht, U.-V., Jan, U. von, Kuebler, J., Zoeller, C., Lacher, M., Muensterer, O. J., Ettinger, M., Klintschar, M. & Hagemeier, L. (2014). Google Glass for documentation of medical findings: evaluation in forensic medicine. Journal of medical Internet research, 16 (2), e53.Google Scholar

  • [2]

    Aldaz, G., Shluzas, L. A., Pickham, D., Eris, O., Sadler, J., Joshi, S. & Leifer, L. (2015). Hands-free image capture, data tagging and transfer using Google Glass: a pilot study for improved wound care management. PloS one, 10 (4), e0121179.Google Scholar

  • [3]

    Berndt, H., Mentler, T. & Herczeg, M. (2015). Optical Head-Mounted Displays in Mass Casualty Incidents. International Journal of Information Systems for Crisis Response and Management, 7 (3), 1–15.Google Scholar

  • [4]

    Chimenti, P. C. & Mitten, D. J. (2015). Google Glass as an Alternative to Standard Fluoroscopic Visualization for Percutaneous Fixation of Hand Fractures: A Pilot Study. Plastic and reconstructive surgery, 136 (2), 328–330.Google Scholar

  • [5]

    Cicero, M. X., Walsh, B., Solad, Y., Whitfill, T., Paesano, G., Kim, K., Baum, C. R. & Cone, D. C. (2015). Do you see what I see? Insights from using google glass for disaster telemedicine triage. Prehospital and disaster medicine, 30 (1), 4–8.Google Scholar

  • [6]

    Davis, C. R. & Rosenfield, L. K. (2015). Looking at plastic surgery through Google Glass: part 1. Systematic review of Google Glass evidence and the first plastic surgical procedures. Plastic and reconstructive surgery, 135 (3), 918–928.Google Scholar

  • [7]

    Eickhoff, U. & Fenger, H. (2004). Chirurgie und Recht (Facharzt und Recht). Berlin, Heidelberg: Springer.Google Scholar

  • [8]

    Euler, S. (2006). Grundkurs Spracherkennung. Wiesbaden: Vieweg & Sohn Verlag.Google Scholar

  • [9]

    Feng, S., Caire, R., Cortazar, B., Turan, M., Wong, A. & Ozcan, A. (2014). Immunochromatographic diagnostic test analysis using Google Glass. ACS nano, 8 (3), 3069–3079.CrossrefWeb of ScienceGoogle Scholar

  • [10]

    Glauser, W. (2013). Doctors among early adopters of Google Glass. CMAJ: Canadian Medical Association journal = journal de l’Association medicale canadienne, 185 (16), 1385.Google Scholar

  • [11]

    Knight, H. M., Gajendragadkar, P. R. & Bokhari, A. (2015). Wearable technology: using Google Glass as a teaching tool. BMJ case reports, 2015.Google Scholar

  • [12]

    Mentler, T. & Herczeg, M. (2016). Herausforderungen und Lösungsansätze für die Gebrauchstauglichkeit interaktiver Datenbrillen in der prä- und innerklinischen Versorgung. In: Arbeit in komplexen Systemen. Digital, vernetzt, human?!. Bericht zum 62. Arbeitswissenschaftlichen Kongress vom 02. – 04. März 2016, Hrsg.: Gesellschaft für Arbeitswissenschaft e. V. (GfA).Google Scholar

  • [13]

    Mentler, T., Wolters, C. & Herczeg, M. (2015). Use cases and usability challenges for head-mounted displays in healthcare. Current Directions in Biomedical Engineering, 1 (1), 534–537.Google Scholar

  • [14]

    Moshtaghi, O., Kelley, K. S., Armstrong, W. B., Ghavami, Y., Gu, J. & Djalilian, H. R. (2015). Using Google Glass to solve communication and surgical education challenges in the operating room. The Laryngoscope, 125 (10), 2295–2297.Google Scholar

  • [15]

    Rasmussen, J. (1983). Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models. IEEE Transactions on Systems, Man, and Cybernetics 13(3), 257–266.CrossrefGoogle Scholar

  • [16]

    Severn Audit and Research Collaborative in Orthopaedics. (2016). Assessing the quality of operation notes: a review of 1092 operation notes in 9 UK hospitals. Patient Safety in Surgery, 10 (1), 203.Google Scholar

  • [17]

    Udani, A. D., Harrison, T. K., Howard, S. K., Kim, T. E., Brock-Utne, J. G., Gaba, D. M. & Mariano, E. R. (2012). Preliminary study of ergonomic behavior during simulated ultrasound-guided regional anesthesia using a head-mounted display. Journal of ultrasound in medicine: official journal of the American Institute of Ultrasound in Medicine, 31 (8), 1277–1280.Google Scholar

  • [18]

    Vorraber, W., Voessner, S., Stark, G., Neubacher, D., DeMello, S. & Bair, A. (2014). Medical applications of near-eye display devices: an exploratory study. International journal of surgery (London, England), 12 (12), 1266–1272.Google Scholar

  • [19]

    Widmer, A. & Müller, H. (2014). Using Google Glass to enhance pre-hospital care. Swiss Medical Informatics, 30, 1–4.Google Scholar

  • [20]

    Wurnig, P. N., Hollaus, P. H., Wurnig, C. H., Wolf, R. K., Ohtsuka, T. & Pridun, N. S. (2003). A new method for digital video documentation in surgical procedures and minimally invasive surgery. Surgical endoscopy, 17 (2), 232–235.Google Scholar

About the article

Tilo Mentler

Tilo Mentler is a research assistant at the Institute for Multimedia and Interactive Systems (IMIS) of the University of Luebeck. He holds a diploma in Informatics, specializing in Digital Media. Recently, he finished his dissertation about the usability of mobile interactive systems in regular and extraordinary missions of Emergency Medical Services. His main current research interests include human-computer interaction in safety-critical contexts (e.g. medicine), usability engineering and interaction design of mobile devices. He is a founding member and vice-chairman of the sub-group “Human-Computer Interaction in Safety-Critical Systems” within the special interest group “Human-Computer Interaction” of the German Informatics Society (GI).

Janosch Kappel

Janosch Kappel is a student of Medical Engineering Science at the University of Luebeck. Recently, he finished his Bachelor’s degree and is now proceeding with the Master programme Medical Engineering Science at the University of Luebeck.

Lutz Wünsch

Lutz Wünsch is professor of paediatric surgery at the University of Luebeck and chairman of the Department of Paediatric Surgery at the UKSH (University Medical Center Schleswig-Holstein). His areas of interest are paediatric urology and minimal invasive surgery and he has authored many articles on these topics. He is also interested in surgical education and new strategies to improve surgical skills.

Michael Herczeg

Prof. Dr. rer. nat. Michael Herczeg is professor of practical computer science and media informatics and director of the Institute for Multimedia and Interactive Systems (IMIS) of the University of Luebeck. His main areas of interest are human-computer interaction, software ergonomics, interaction design, multimedia and interactive systems, computer-aided teaching and learning as well as safety-critical human-machine systems. He is a co-founder and chair of the German ACM SIGCHI and Human-Computer-Interaction section of the German Informatics Society (GI). Prof. Herczeg is a member of ACM and GI and served as an organizer, reviewer, chair and keynote speaker for more than 100 conferences and workshops. He is an author and editor of more than 200 publications and is an editor for books and journals in interactive media. He works as a consultant for industry and government in the area of human-computer-interaction, human factors, software-ergonomics, usability engineering, eLearning and safety-critical human-machine systems.

Published Online: 2016-08-16

Published in Print: 2016-08-01

Citation Information: i-com, Volume 15, Issue 2, Pages 171–178, ISSN (Online) 2196-6826, ISSN (Print) 1618-162X, DOI: https://doi.org/10.1515/icom-2016-0017.

Export Citation

© 2016 Walter de Gruyter GmbH, Berlin/Boston.Get Permission

Comments (0)

Please log in or register to comment.
Log in