DefSLAM: Tracking and Mapping of Deforming Scenes From Monocular Sequences - Université Clermont Auvergne
Article Dans Une Revue IEEE Transactions on Robotics Année : 2020

DefSLAM: Tracking and Mapping of Deforming Scenes From Monocular Sequences

Résumé

Monocular SLAM algorithms perform robustly when observing rigid scenes, however, they fail when the observed scene deforms, for example, in medical endoscopy applications. We present DefSLAM, the first monocular SLAM capable of operating in deforming scenes in real-time. Our approach intertwines Shape-from-Template (SfT) and Non-Rigid Structure-from-Motion (NRSfM) techniques to deal with the exploratory sequences typical of SLAM. A deformation tracking thread recovers the pose of the camera and the deformation of the observed map, at frame rate, by means of SfT processing a template that models the scene shape-at-rest. A deformation mapping thread runs in parallel with the tracking to update the template, at keyframe rate, by means of an isometric NRSfM processing a batch of full perspective keyframes. In our experiments, DefSLAM processes close-up sequences of deforming scenes, both in a laboratory controlled experiment and in medical endoscopy sequences, producing accurate 3D models of the scene with respect to the moving camera.
Fichier principal
Vignette du fichier
texto_completo.pdf (1.37 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03689416 , version 1 (11-01-2024)

Identifiants

Citer

J Lamarca, Shaifali Parashar, Adrien Bartoli, J Monteil. DefSLAM: Tracking and Mapping of Deforming Scenes From Monocular Sequences. IEEE Transactions on Robotics, 2020, 37 (1), pp.291. ⟨10.1109/TRO.2020.3020739⟩. ⟨hal-03689416⟩
39 Consultations
45 Téléchargements

Altmetric

Partager

More