Skip to content
BY 4.0 license Open Access Published by De Gruyter October 9, 2021

Partial 3D-reconstruction of the colon from monoscopic colonoscopy videos using shape-from-motion and deep learning

  • Sina Walluscheck EMAIL logo , Thomas Wittenberg , Volker Bruns , Thomas Eixelberger and Ralf Hackner

Abstract

For the image-based documentation of a colonoscopy procedure, a 3D-reconstuction of the hollow colon structure from endoscopic video streams is desirable. To obtain this reconstruction, 3D information about the colon has to be extracted from monocular colonoscopy image sequences. This information can be provided by estimating depth through shape-from-motion approaches, using the image information from two successive image frames and the exact knowledge of their disparity. Nevertheless, during a standard colonoscopy the spatial offset between successive frames is continuously changing. Thus, in this work deep convolutional neural networks (DCNNs) are applied in order to obtain piecewise depth maps and point clouds of the colon. These pieces can then be fused for a partial 3D reconstruction.

Published Online: 2021-10-09
Published in Print: 2021-10-01

© 2021 The Author(s), published by Walter de Gruyter GmbH, Berlin/Boston

This work is licensed under the Creative Commons Attribution 4.0 International License.

Downloaded on 29.4.2024 from https://www.degruyter.com/document/doi/10.1515/cdbme-2021-2085/html
Scroll to top button