COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Tony Danjun, Birdal, Tolga, Navab, Nassir, Bastian, Lennart
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908765511483392
author Wang, Tony Danjun
Birdal, Tolga
Navab, Nassir
Bastian, Lennart
author_facet Wang, Tony Danjun
Birdal, Tolga
Navab, Nassir
Bastian, Lennart
contents 3D pose estimation from sparse multi-views is a critical task for numerous applications, including action recognition, sports analysis, and human-robot interaction. Optimization-based methods typically follow a two-stage pipeline, first detecting 2D keypoints in each view and then associating these detections across views to triangulate the 3D pose. Existing methods rely on mere pairwise associations to model this correspondence problem, treating global consistency between views (i.e., cycle consistency) as a soft constraint. Yet, reconciling these constraints for multiple views becomes brittle when spurious associations propagate errors. We thus propose COMPOSE, a novel framework that formulates multi-view pose correspondence matching as a hypergraph partitioning problem rather than through pairwise association. While the complexity of the resulting integer linear program grows exponentially in theory, we introduce an efficient geometric pruning strategy to substantially reduce the search space. COMPOSE achieves improvements of up to 23% in average precision over previous optimization-based methods and up to 11% over self-supervised end-to-end learned methods, offering a promising solution to a widely studied problem.
format Preprint
id arxiv_https___arxiv_org_abs_2601_09698
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation
Wang, Tony Danjun
Birdal, Tolga
Navab, Nassir
Bastian, Lennart
Computer Vision and Pattern Recognition
3D pose estimation from sparse multi-views is a critical task for numerous applications, including action recognition, sports analysis, and human-robot interaction. Optimization-based methods typically follow a two-stage pipeline, first detecting 2D keypoints in each view and then associating these detections across views to triangulate the 3D pose. Existing methods rely on mere pairwise associations to model this correspondence problem, treating global consistency between views (i.e., cycle consistency) as a soft constraint. Yet, reconciling these constraints for multiple views becomes brittle when spurious associations propagate errors. We thus propose COMPOSE, a novel framework that formulates multi-view pose correspondence matching as a hypergraph partitioning problem rather than through pairwise association. While the complexity of the resulting integer linear program grows exponentially in theory, we introduce an efficient geometric pruning strategy to substantially reduce the search space. COMPOSE achieves improvements of up to 23% in average precision over previous optimization-based methods and up to 11% over self-supervised end-to-end learned methods, offering a promising solution to a widely studied problem.
title COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.09698