Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ruiz-Ponce, Pablo, Escalera, Sergio, García-Rodríguez, José, Deng, Jiankang, Potamias, Rolandos Alexandros
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915894221864960
author Ruiz-Ponce, Pablo
Escalera, Sergio
García-Rodríguez, José
Deng, Jiankang
Potamias, Rolandos Alexandros
author_facet Ruiz-Ponce, Pablo
Escalera, Sergio
García-Rodríguez, José
Deng, Jiankang
Potamias, Rolandos Alexandros
contents Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and increased learning complexity, previous methods tend to ignore hand motions, limiting the realism and expressivity of the interactions. Additionally, current diffusion-based approaches generate entire motion sequences simultaneously, limiting their ability to capture the reactive and adaptive nature of human interactions. To address these limitations, we introduce Interact2Ar, the first end-to-end text-conditioned autoregressive diffusion model for generating full-body, human-human interactions. Interact2Ar incorporates detailed hand kinematics through dedicated parallel branches, enabling high-fidelity full-body generation. Furthermore, we introduce an autoregressive pipeline coupled with a novel memory technique that facilitates adaptation to the inherent variability of human interactions using efficient large context windows. The adaptability of our model enables a series of downstream applications, including temporal motion composition, real-time adaptation to disturbances, and extension beyond dyadic to multi-person scenarios. To validate the generated motions, we introduce a set of robust evaluators and extended metrics designed specifically for assessing full-body interactions. Through quantitative and qualitative experiments, we demonstrate the state-of-the-art performance of Interact2Ar.
format Preprint
id arxiv_https___arxiv_org_abs_2512_19692
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models
Ruiz-Ponce, Pablo
Escalera, Sergio
García-Rodríguez, José
Deng, Jiankang
Potamias, Rolandos Alexandros
Computer Vision and Pattern Recognition
Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and increased learning complexity, previous methods tend to ignore hand motions, limiting the realism and expressivity of the interactions. Additionally, current diffusion-based approaches generate entire motion sequences simultaneously, limiting their ability to capture the reactive and adaptive nature of human interactions. To address these limitations, we introduce Interact2Ar, the first end-to-end text-conditioned autoregressive diffusion model for generating full-body, human-human interactions. Interact2Ar incorporates detailed hand kinematics through dedicated parallel branches, enabling high-fidelity full-body generation. Furthermore, we introduce an autoregressive pipeline coupled with a novel memory technique that facilitates adaptation to the inherent variability of human interactions using efficient large context windows. The adaptability of our model enables a series of downstream applications, including temporal motion composition, real-time adaptation to disturbances, and extension beyond dyadic to multi-person scenarios. To validate the generated motions, we introduce a set of robust evaluators and extended metrics designed specifically for assessing full-body interactions. Through quantitative and qualitative experiments, we demonstrate the state-of-the-art performance of Interact2Ar.
title Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.19692