Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Oldenbourg May 22, 2021

GeniePutt: Augmenting human motor skills through electrical muscle stimulation

Sarah Faltaous ORCID logo, Aya Abdulmaksoud, Markus Kempe, Florian Alt and Stefan Schneegass

Abstract

Motor skills are omnipresent in our daily lives. Humans seek to learn new skills or improve existing ones. In this work, we explore how the actuation of the human body can be used to augment motor skills. We present GeniePutt, which augments the human performance via electrical muscle stimulation (EMS). We conducted a user study in which we controlled the turning angle of the wrist through GeniePutt to increase participants’ accuracy in a mini-golf scenario. Our results indicate that the best accuracy can be achieved when human capabilities are combined with augmentation performed through EMS.

ACM CCS:

Funding source: Deutscher Akademischer Austauschdienst

Award Identifier / Grant number: 57460599

Funding statement: This research is funded by the DAAD within the context of the Computing for Intercultural Competences (ComIC) project (Grant No: 57460599).

References

1. Adams, J. A., Gopher, D., and Lintern, G. Effects of visual and proprioceptive feedback on motor learning. Journal of Motor Behavior (1977).10.1037/e573672012-004Search in Google Scholar

2. Adams, V. Electromyostimulation to fight atrophy and to build muscle: facts and numbers. Journal of cachexia, sarcopenia and muscle 9, 4 (2018), 631–634.10.1002/jcsm.12332Search in Google Scholar PubMed PubMed Central

3. Cressman, E. K., and Henriques, D. Y. Sensory recalibration of hand position following visuomotor adaptation. Journal of neurophysiology 102, 6 (2009), 3505–3518.10.1152/jn.00514.2009Search in Google Scholar PubMed

4. Dai, T. H., Liu, J. Z., Sahgal, V., Brown, R. W., and Yue, G. H. Relationship between muscle output and functional mri-measured brain activation. Experimental brain research 140, 3 (2001), 290–300.10.1007/s002210100815Search in Google Scholar PubMed

5. Filipovic, A., Kleinoder, H., Dormann, U., and Mester, J. Electromyostimulation-a systematic review of the effects of different ems methods on selected strength parameters in trained and elite athletes. J. Strength Cond. Res 26 (2012), 2600–2614.10.1519/JSC.0b013e31823f2cd1Search in Google Scholar PubMed

6. Galati, G., Committeri, G., Sanes, J. N., and Pizzamiglio, L. Spatial coding of visual and somatic sensory information in body-centred coordinates. European Journal of Neuroscience 14, 4 (2001), 737–746.10.1046/j.0953-816x.2001.01674.xSearch in Google Scholar PubMed

7. Haith, A., Jackson, C. P., Miall, R. C., and Vijayakumar, S. Unifying the sensory and motor components of sensorimotor adaptation. In Advances in neural information processing systems (2009), pp. 593–600.Search in Google Scholar

8. Hassan, M., Daiber, F., Wiehr, F., Kosmalla, F., and Krüger, A. Footstriker: An ems-based foot strike assistant for running. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1–18.10.1145/3053332Search in Google Scholar

9. Horn, R. R., and Williams, A. M. Observational learning: Is it time we took another look? In Skill Acquisition in Sport (2004), Routledge, pp. 199–230.Search in Google Scholar

10. Kannan, K. S., Manoj, K., and Arumugam, S. Labeling methods for identifying outliers. International Journal of Statistics and Systems 10, 2 (2015), 231–238.Search in Google Scholar

11. Kasahara, S., Nishida, J., and Lopes, P. Preemptive action: Accelerating human reaction using electrical muscle stimulation without compromising agency. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019), ACM, p. 643.Search in Google Scholar

12. Kim, B. J., and Robinson, C. J. Postural control and detection of slip/fall initiation in the elderly population. Ergonomics 48, 9 (2005), 1065–1085.10.1080/00140130500071028Search in Google Scholar PubMed

13. Kosmalla, F., Daiber, F., Wiehr, F., and Krüger, A. Climbvis: Investigating in-situ visualizations for understanding climbing movements by demonstration. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (New York, NY, USA, 2017), ISS’17 (2017), ACM, pp. 270–279.10.1145/3132272.3134119Search in Google Scholar

14. Kosmalla, F., Murlowski, C., Daiber, F., and Krüger, A. Slackliner – an interactive slackline training assistant. In Proceedings of the 26th ACM International Conference on Multimedia (New York, NY, USA, 2018), MM’18 (2018), ACM, pp. 154–162.10.1145/3240508.3240537Search in Google Scholar

15. Lopes, P., Ion, A., Mueller, W., Hoffmann, D., Jonell, P., and Baudisch, P. Proprioceptive interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (New York, NY, USA, 2015), CHI’15 (2015), Association for Computing Machinery, pp. 939–948.Search in Google Scholar

16. Lopes, P., Jonell, P., and Baudisch, P. Affordance++: allowing objects to communicate dynamic use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015), ACM, pp. 2515–2524.10.1145/2702123.2702128Search in Google Scholar

17. Lopes, P., You, S., Cheng, L.-P., Marwecki, S., and Baudisch, P. Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (2017), ACM, pp. 1471–1482.10.1145/3025453.3025600Search in Google Scholar

18. Lopes, P., You, S., Ion, A., and Baudisch, P. Adding force feedback to mixed reality experiences and games using electrical muscle stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (2018), ACM, p. 446.Search in Google Scholar

19. Lopes, P., Yüksel, D., Guimbretière, F., and Baudisch, P. Muscle-plotter: An interactive system based on electrical muscle stimulation that produces spatial output. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (2016), ACM, pp. 207–217.10.1145/2984511.2984530Search in Google Scholar

20. Newell, K. M. Motor skill acquisition. Annual review of psychology 42, 1 (1991), 213–237.10.1146/annurev.ps.42.020191.001241Search in Google Scholar PubMed

21. Niijima, A., Isezaki, T., Aoki, R., Watanabe, T., and Yamada, T. Controlling maximal voluntary contraction of the upper limb muscles by facial electrical stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2018), CHI’18 (2018), Association for Computing Machinery, pp. 1–7.Search in Google Scholar

22. Pfeiffer, M., Duente, T., and Rohs, M. Let your body move: a prototyping toolkit for wearable force feedback with electrical muscle stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (2016), ACM, pp. 418–427.10.1145/2935334.2935348Search in Google Scholar

23. Pfeiffer, M., Dünte, T., Schneegass, S., Alt, F., and Rohs, M. Cruise control for pedestrians: Controlling walking direction using electrical muscle stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015), pp. 2505–2514.10.1145/2702123.2702190Search in Google Scholar

24. Pfeiffer, M., Dünte, T., Schneegass, S., Alt, F., and Rohs, M. Cruise control for pedestrians: Controlling walking direction using electrical muscle stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015), ACM, pp. 2505–2514.10.1145/2702123.2702190Search in Google Scholar

25. Pfeiffer, M., Schneegaß, S., and Alt, F. Supporting interaction in public space with electrical muscle stimulation. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication (New York, NY, USA, 2013), UbiComp’13 Adjunct (2013), ACM, pp. 5–8.10.1145/2494091.2494094Search in Google Scholar

26. Rubenstein, L. Z. Falls in older people: epidemiology, risk factors and strategies for prevention. Age and ageing 35, suppl_2 (2006), ii37–ii41.10.1093/ageing/afl084Search in Google Scholar PubMed

27. Schneegass, S., Schmidt, A., and Pfeiffer, M. Creating user interfaces with electrical muscle stimulation. Interactions 24, 1 (Dec. 2016), 74–77.10.1145/3019606Search in Google Scholar

28. Sherrington, C.The integrative action of the nervous system. CUP Archive, 1952.Search in Google Scholar

29. Smits-Engelsman, B. C., Niemeijer, A. S., and van Galen, G. P. Fine motor deficiencies in children diagnosed as dcd based on poor grapho-motor ability. Human movement science 20, 1-2 (2001), 161–182.10.1016/S0167-9457(01)00033-1Search in Google Scholar

30. Stifani, N. Motor neurons and the generation of spinal motor neurons diversity. Frontiers in cellular neuroscience 8 (2014), 293.10.3389/fncel.2014.00293Search in Google Scholar

31. Tamaki, E., Miyaki, T., and Rekimoto, J. Possessedhand: Techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2011), CHI’11 (2011), ACM, pp. 543–552.10.1145/1978942.1979018Search in Google Scholar

32. Teka, W. W., Hamade, K. C., Barnett, W. H., Kim, T., Markin, S. N., Rybak, I. A., and Molkov, Y. I. From the motor cortex to the movement and back again. PloS one 12, 6 (2017), e0179288.10.1371/journal.pone.0179288Search in Google Scholar

33. Thelen, E. Coupling perception and action in the development of skill: A dynamic approach. In Sensory-Motor Organizations and Development in Infancy and Early Childhood (Dordrecht, 1990), H. Bloch and B. I. Bertenthal, Eds. (1990), Springer, Netherlands, pp. 39–56.10.1007/978-94-009-2071-2_3Search in Google Scholar

34. Vahdat, S., Darainy, M., Milner, T. E., and Ostry, D. J. Functionally specific changes in resting-state sensorimotor networks after motor learning. Journal of Neuroscience 31, 47 (2011), 16907–16915.10.1523/JNEUROSCI.2737-11.2011Search in Google Scholar

35. Ward, A. R., and Shkuratova, N. Russian electrical stimulation: the early experiments. Physical therapy 82, 10 (2002), 1019–1030.10.1093/ptj/82.10.1019Search in Google Scholar

36. Wolpert, D. M., and Flanagan, J. R. Motor learning. Current biology 20, 11 (2010), R467–R472.10.1016/j.cub.2010.04.035Search in Google Scholar

37. Wolpert, D. M., Ghahramani, Z., and Flanagan, J. R. Perspectives and problems in motor learning. Trends in cognitive sciences 5, 11 (2001), 487–494.10.1016/S1364-6613(00)01773-3Search in Google Scholar

38. Wong, J. D., Kistemaker, D. A., Chin, A., and Gribble, P. L. Can proprioceptive training improve motor learning? Journal of neurophysiology 108, 12 (2012), 3313–3321.10.1152/jn.00122.2012Search in Google Scholar PubMed PubMed Central

39. Wulf, G., McNevin, N., and Shea, C. H. The automaticity of complex motor skill learning as a function of attentional focus. The Quarterly Journal of Experimental Psychology Section A 54, 4 (2001), 1143–1154.10.1080/713756012Search in Google Scholar PubMed

Received: 2020-09-20
Revised: 2021-03-17
Accepted: 2021-04-30
Published Online: 2021-05-22
Published in Print: 2021-07-27

© 2021 Walter de Gruyter GmbH, Berlin/Boston

Scroll Up Arrow