ROBUSfT : Robust real-time shape-from-template, a C ++ library - Université Clermont Auvergne
Article Dans Une Revue Image and Vision Computing Année : 2024

ROBUSfT : Robust real-time shape-from-template, a C ++ library

Résumé

Tracking the 3D shape of a deforming object using only monocular 2D vision is a challenging problem. This is because one should (i) infer the 3D shape from a 2D image, which is a severely underconstrained problem, and (ii) implement the whole solution pipeline in real time. The pipeline typically requires feature detection and matching, mismatch filtering, 3D shape inference and feature tracking algorithms. We propose ROBUSfT, a conventional pipeline based on a template containing the object's rest shape, texture map and deformation law. ROBUSfT is ready-to-use, wide-baseline, capable of handling large deformations, fast up to 30 fps, free of training, and robust against partial occlusions and discontinuities. It outperforms the state-of-the-art methods in challenging video datasets. ROBUSfT is implemented as a publicly available C ++ library. We provide the code, a tutorial on how to use it, and a supplementary video of our experiments at https://github.com/mrshetab/ROBUSfT.
Fichier principal
Vignette du fichier
2301.04037v3.pdf (7.97 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-04628170 , version 1 (15-10-2024)

Licence

Identifiants

Citer

Mohammadreza Shetab-Bushehri, Miguel Aranda, Erol Özgür, Youcef Mezouar, Adrien Bartoli. ROBUSfT : Robust real-time shape-from-template, a C ++ library. Image and Vision Computing, 2024, 141, pp.104867. ⟨10.1016/j.imavis.2023.104867⟩. ⟨hal-04628170⟩
12 Consultations
5 Téléchargements

Altmetric

Partager

More