Skip to content
BY 4.0 license Open Access Published by De Gruyter Open Access March 27, 2019

Motion tracking glove for augmented reality and virtual reality

Vu Trieu Minh EMAIL logo , Nikita Katushin and John Pumwa

Abstract

This project designs a smart glove, which can be used for motion tracking in real time to a 3D virtual robotic arm in a PC. The glove is low cost with the price of less than 100 € and uses only internal measurement unit for students to develop their projects on augmented and virtual reality applications. Movement data from the glove is transferred to the PC via UART DMA. The data is set as the motion reference path for the 3D virtual robotic arm to follow. APID feedback controller controls the 3D virtual robot to track exactly the haptic glove movement with zero error in real time. This glove can be used also for remote control, tele-robotics and tele-operation systems.

References

[1] L. R. Jose, G. B. Manuel, G. G. Francisco, Immersive environments and virtual reality: systematic review and advances in communication, Interaction and Simulation, Multimodal Technologies and Interact, 2017, 1(4), 1–2010.3390/mti1040021Search in Google Scholar

[2] S. A. Asmaa, F. D. Lamya, F. I. Lamiaa, Environments and system types of virtual reality technology in STEM: a survey, International Journal of Advanced Computer Science and Applications, 2017, 8(6), 77–8910.14569/IJACSA.2017.080610Search in Google Scholar

[3] N. N. Mansor, M. H. Jamaluddin, A. Z. Shukor, Concept and application of virtual reality haptic technology: a review, Journal of Theoretical and Applied Information Technology, 2017, 95(14), 3320–3336Search in Google Scholar

[4] V. T. Minh, F. M. Hashim, Adaptive teleoperation system with neural network-based multiple model control, Mathematical Problems in Engineering, 2010, Article ID 59205410.1155/2010/592054Search in Google Scholar

[5] C. S. Falcao, M. Soares, Applications of haptic devices and virtual reality in consumer products usability evaluation, In: M. Soares, F. Rebelo (Eds.), Advances in Ergonomics In Design, Usability & Special Populations Part I, AHFE Conference, 2014, 377–383Search in Google Scholar

[6] T. N. Hoang, T. S. Ross, H. T. Bruce, Passive deformable haptic glove to support 3D interactions in mobile augmented reality environments, In: IEEE International Symposium on Mixed and Augmented Reality, Science and Technology, Adelaide, SA, Australia, 2013, 257–25810.1109/ISMAR.2013.6671793Search in Google Scholar

[7] E. Strasnick, C. Holz, E. Ofek, M. Sinclair, H. Benko, Haptic links: bimanual haptics for virtual reality using variable stiffness actuation, In: Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 2018, 1–1210.1145/3173574.3174218Search in Google Scholar

[8] M. Maurizio, P. Claudio, C. Francesco, S. Gionata, D. L. Alessandro, P. Domenico, Evaluation of wearable haptic systems for the fingers in augmented reality applications, IEEE Transactions on Haptics, 2017, 10(4), 511–52210.1109/TOH.2017.2691328Search in Google Scholar PubMed

[9] C. John, J. Robert, G. Audrey, HaptoBend: shape-changing passive haptic feedback in virtual reality, In: ACM Symposium Spatial User Interaction, Brighton, UK, October 2017, 1–9Search in Google Scholar

[10] C. Inrak, W. H. Elliot, L. C. David, J. P. Christopher, F. Sean, Wolverine: a wearable haptic interface for grasping in virtual reality, In: International Conference on Intelligent Robots and Systems, Daejeon, South Korea, 2016, 1–8Search in Google Scholar

[11] K. Li, I.-M. Chen, S. H. Yeo, C. K. Lim, Development of fingermotion capturing device based on optical linear, Journal of Rehabilitation Research & Development, 2011, 48(1), 69–8210.1682/JRRD.2010.02.0013Search in Google Scholar PubMed

[12] F. B. Edgar, A. L. Daniel, X. Q. Washington, H. A. Víctor, Haptic stimulation glove for fine motor rehabilitation in virtual reality environments, In: International Conference on Augmented Reality, Virtual Reality and Computer Graphics, Otranto, Italy, 2018, 211–22910.1007/978-3-319-95282-6_16Search in Google Scholar

[13] C. Inrak, C. Heather, R. Mark, O. Alex, F. Sean, Grabity: a wearable haptic interface for simulating weight and grasping in virtual reality, In: Symposium on User Interface Software and Technology, Quebec, Canada, 2017, 1–12Search in Google Scholar

[14] P. Weber, E. Rueckert, R. Calandra, J. Peters, P. Beckerle, A low-cost sensor glove with vibrotactile feedback and multiple finger joint and hand motion sensing for human-robot interaction, In: Proceedings of 25th IEEE International Symposium on Robot and Human Interactive Communication, Columbia University, NY, USA, 2016, 99–10410.1109/ROMAN.2016.7745096Search in Google Scholar

[15] E. Rueckert, R. Lioutikov, R. Calandra, M. Schmidt, P. Beckerle, J. Peters, Low-cost sensor glove with force feedback for learning from demonstrations using probabilistic trajectory representations, In: International Conference on Robotics and Automation, Seattle, Washington, USA, 2015, 1–3Search in Google Scholar

[16] V. T. Minh, M. Hashim, M. Awang, Development of a realtime clutch transition strategy for a parallel hybrid electric vehicle, In: Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, 2012, 226(2), 188–20310.1177/0959651811414760Search in Google Scholar

[17] V. T. Minh, A. Rani, Modeling and control of distillation column in a petroleum process, Mathematical Problems in Engineering, 2009, Article ID 40470210.1155/2009/404702Search in Google Scholar

[18] Intruction for Invensense, MPU-6050, [Online], Available: https://www.invensense.com/products/motion-tracking/6-axis/mpu-6050/ [Accessed 22 09 2018]Search in Google Scholar

Received: 2018-10-16
Accepted: 2019-02-08
Published Online: 2019-03-27

© 2019 Vu Trieu Minh et al., published by De Gruyter

This work is licensed under the Creative Commons Attribution 4.0 Public License.

Downloaded on 28.11.2022 from frontend.live.degruyter.dgbricks.com/document/doi/10.1515/pjbr-2019-0012/html
Scroll Up Arrow