The Isowarp: The Template-Based Visual Geometry of Isometric Surfaces - Université Clermont Auvergne Accéder directement au contenu
Article Dans Une Revue International Journal of Computer Vision Année : 2021

The Isowarp: The Template-Based Visual Geometry of Isometric Surfaces

Résumé

Registration maps or warps form a key element in Shape-from-Template (SfT). They relate the template with the input image, which contains the projection of the deformed surface. Recently, it was shown that isometric SfT can be solved analytically if the warp and its first-order derivatives are known. In practice, the warp is recovered by interpolating a set of discrete template-to-image point correspondences. This process relies on smoothness priors but ignores the 3D geometry. This may produce errors in the warp and poor reconstructions. In contrast, we propose to create a 3D consistent warp, which technically is a very challenging task, as the 3D shape variables must be eliminated from the isometric SfT equations to find differential constraints for the warp only. Integrating these constraints in warp estimation yields the isowarp, a warp 3D consistent with isometric SfT. Experimental results show that incorporating the isowarp in the SfT pipeline allows the analytic solution to outperform non-convex 3D shape refinement methods and the recent DNN-based SfT methods. The isowarp can be properly initialized with convex methods and its hyperparameters can be automatically obtained with cross-validation. The isowarp is resistant to 3D ambiguities and less computationally expensive than existing 3D shape refinement methods. The isowarp is thus a theoretical and practical breakthrough in SfT.

Domaines

Imagerie
Fichier non déposé

Dates et versions

hal-03703685 , version 1 (24-06-2022)

Identifiants

Citer

David Casillas-Perez, Daniel Pizarro, David Fuentes-Jimenez, Manuel Mazo, Adrien Bartoli. The Isowarp: The Template-Based Visual Geometry of Isometric Surfaces. International Journal of Computer Vision, 2021, 129 (7), pp.2194. ⟨10.1007/s11263-021-01472-w⟩. ⟨hal-03703685⟩
19 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More