Skip to content
BY 4.0 license Open Access Published by De Gruyter July 30, 2022

Exploring object and multi-target instrument tracking for AR-guided interventions

Danny Schott, Florian Heinrich, Lara Stallmeister and Christian Hansen


The rapid development of available hard- and software for computer-assisted or augmented reality (AR) guided interventions creates a need for fast and inexpensive prototyping environments. However, intraoperative tracking systems in particular represent a high cost threshold. Therefore, this work presents a low-cost tracking method based on a conventional RGB camera. Here, a combined approach of multiple image targets and 3D object target recognition is implemented. The system is evaluated with a systematic accuracy assessment analyzing a total of 385 3D positions. On average, a deviation of 15,69+-9,95 mm was measured. In addition, a prototypical AR-based needle navigation visualization was developed using Microsoft HoloLens 2. This system’s feasibility and usability was evaluated positively in a pilot study (n=3).

Published Online: 2022-07-30
Published in Print: 2022-07-01

© 2022 by Walter de Gruyter Berlin/Boston

This work is licensed under the Creative Commons Attribution 4.0 International License.

Scroll Up Arrow