Accessible Requires Authentication Published by Oldenbourg Wissenschaftsverlag August 16, 2016

Photo-enriched Documentation during Surgeries with Google Glass: An Exploratory Usability Study in a Department of Paediatric Surgery

Tilo Mentler, Janosch Kappel, Lutz Wünsch and Michael Herczeg
From the journal i-com


Due to hygienic regulations and mobility requirements, medical professionals show great interest in wearable devices allowing for hands-free interaction and ubiquitous information access. Smartglasses like the prototype “Google Glass” have already been evaluated in pre-hospital as well as clinical medical care. Based on laboratory studies according to the reliability of voice and gesture recognition and field studies during four surgeries in the department of paediatric surgeries, we discuss usability and acceptance of smartglasses for photo-enriched documentation during surgeries. While technical limitations (e. g. poor camera quality) have to be overcome, usable solutions for human-smartglasses interaction by voice and gesture recognition seem to be possible midterm. Surgeons and other members of surgical teams are curious about smartglasses in their working environment. This can be a starting point for a wider use, if user interface and interaction design for smartglasses are further explored and developed in a user-centered process meeting their requirements. In this regard, transmodal consistency is recommended as a design principle for applications supporting multiple input and output modalities.


[1] Albrecht, U.-V., Jan, U. von, Kuebler, J., Zoeller, C., Lacher, M., Muensterer, O. J., Ettinger, M., Klintschar, M. & Hagemeier, L. (2014). Google Glass for documentation of medical findings: evaluation in forensic medicine. Journal of medical Internet research, 16 (2), e53. Search in Google Scholar

[2] Aldaz, G., Shluzas, L. A., Pickham, D., Eris, O., Sadler, J., Joshi, S. & Leifer, L. (2015). Hands-free image capture, data tagging and transfer using Google Glass: a pilot study for improved wound care management. PloS one, 10 (4), e0121179. Search in Google Scholar

[3] Berndt, H., Mentler, T. & Herczeg, M. (2015). Optical Head-Mounted Displays in Mass Casualty Incidents. International Journal of Information Systems for Crisis Response and Management, 7 (3), 1–15. Search in Google Scholar

[4] Chimenti, P. C. & Mitten, D. J. (2015). Google Glass as an Alternative to Standard Fluoroscopic Visualization for Percutaneous Fixation of Hand Fractures: A Pilot Study. Plastic and reconstructive surgery, 136 (2), 328–330. Search in Google Scholar

[5] Cicero, M. X., Walsh, B., Solad, Y., Whitfill, T., Paesano, G., Kim, K., Baum, C. R. & Cone, D. C. (2015). Do you see what I see? Insights from using google glass for disaster telemedicine triage. Prehospital and disaster medicine, 30 (1), 4–8. Search in Google Scholar

[6] Davis, C. R. & Rosenfield, L. K. (2015). Looking at plastic surgery through Google Glass: part 1. Systematic review of Google Glass evidence and the first plastic surgical procedures. Plastic and reconstructive surgery, 135 (3), 918–928. Search in Google Scholar

[7] Eickhoff, U. & Fenger, H. (2004). Chirurgie und Recht (Facharzt und Recht). Berlin, Heidelberg: Springer. Search in Google Scholar

[8] Euler, S. (2006). Grundkurs Spracherkennung. Wiesbaden: Vieweg & Sohn Verlag. Search in Google Scholar

[9] Feng, S., Caire, R., Cortazar, B., Turan, M., Wong, A. & Ozcan, A. (2014). Immunochromatographic diagnostic test analysis using Google Glass. ACS nano, 8 (3), 3069–3079. Search in Google Scholar

[10] Glauser, W. (2013). Doctors among early adopters of Google Glass. CMAJ: Canadian Medical Association journal = journal de l’Association medicale canadienne, 185 (16), 1385. Search in Google Scholar

[11] Knight, H. M., Gajendragadkar, P. R. & Bokhari, A. (2015). Wearable technology: using Google Glass as a teaching tool. BMJ case reports, 2015. Search in Google Scholar

[12] Mentler, T. & Herczeg, M. (2016). Herausforderungen und Lösungsansätze für die Gebrauchstauglichkeit interaktiver Datenbrillen in der prä- und innerklinischen Versorgung. In: Arbeit in komplexen Systemen. Digital, vernetzt, human?!. Bericht zum 62. Arbeitswissenschaftlichen Kongress vom 02. – 04. März 2016, Hrsg.: Gesellschaft für Arbeitswissenschaft e. V. (GfA). Search in Google Scholar

[13] Mentler, T., Wolters, C. & Herczeg, M. (2015). Use cases and usability challenges for head-mounted displays in healthcare. Current Directions in Biomedical Engineering, 1 (1), 534–537. Search in Google Scholar

[14] Moshtaghi, O., Kelley, K. S., Armstrong, W. B., Ghavami, Y., Gu, J. & Djalilian, H. R. (2015). Using Google Glass to solve communication and surgical education challenges in the operating room. The Laryngoscope, 125 (10), 2295–2297. Search in Google Scholar

[15] Rasmussen, J. (1983). Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models. IEEE Transactions on Systems, Man, and Cybernetics 13(3), 257–266. Search in Google Scholar

[16] Severn Audit and Research Collaborative in Orthopaedics. (2016). Assessing the quality of operation notes: a review of 1092 operation notes in 9 UK hospitals. Patient Safety in Surgery, 10 (1), 203. Search in Google Scholar

[17] Udani, A. D., Harrison, T. K., Howard, S. K., Kim, T. E., Brock-Utne, J. G., Gaba, D. M. & Mariano, E. R. (2012). Preliminary study of ergonomic behavior during simulated ultrasound-guided regional anesthesia using a head-mounted display. Journal of ultrasound in medicine: official journal of the American Institute of Ultrasound in Medicine, 31 (8), 1277–1280. Search in Google Scholar

[18] Vorraber, W., Voessner, S., Stark, G., Neubacher, D., DeMello, S. & Bair, A. (2014). Medical applications of near-eye display devices: an exploratory study. International journal of surgery (London, England), 12 (12), 1266–1272. Search in Google Scholar

[19] Widmer, A. & Müller, H. (2014). Using Google Glass to enhance pre-hospital care. Swiss Medical Informatics, 30, 1–4. Search in Google Scholar

[20] Wurnig, P. N., Hollaus, P. H., Wurnig, C. H., Wolf, R. K., Ohtsuka, T. & Pridun, N. S. (2003). A new method for digital video documentation in surgical procedures and minimally invasive surgery. Surgical endoscopy, 17 (2), 232–235. Search in Google Scholar

Published Online: 2016-8-16
Published in Print: 2016-8-1

© 2016 Walter de Gruyter GmbH, Berlin/Boston