CaFlow: Enhancing Long-Term Action Quality Assessment with Causal Counterfactual Flow

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Han, Ruisheng, Zhou, Kanglei, Chen, Shuang, Atapour-Abarghouei, Amir, Shum, Hubert P. H.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909927010729984
author Han, Ruisheng
Zhou, Kanglei
Chen, Shuang
Atapour-Abarghouei, Amir
Shum, Hubert P. H.
author_facet Han, Ruisheng
Zhou, Kanglei
Chen, Shuang
Atapour-Abarghouei, Amir
Shum, Hubert P. H.
contents Action Quality Assessment (AQA) predicts fine-grained execution scores from action videos and is widely applied in sports, rehabilitation, and skill evaluation. Long-term AQA, as in figure skating or rhythmic gymnastics, is especially challenging since it requires modeling extended temporal dynamics while remaining robust to contextual confounders. Existing approaches either depend on costly annotations or rely on unidirectional temporal modeling, making them vulnerable to spurious correlations and unstable long-term representations. To this end, we propose CaFlow, a unified framework that integrates counterfactual de-confounding with bidirectional time-conditioned flow. The Causal Counterfactual Regularization (CCR) module disentangles causal and confounding features in a self-supervised manner and enforces causal robustness through counterfactual interventions, while the BiT-Flow module models forward and backward dynamics with a cycle-consistency constraint to produce smoother and more coherent representations. Extensive experiments on multiple long-term AQA benchmarks demonstrate that CaFlow achieves state-of-the-art performance. Code is available at https://github.com/Harrison21/CaFlow
format Preprint
id arxiv_https___arxiv_org_abs_2511_21653
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CaFlow: Enhancing Long-Term Action Quality Assessment with Causal Counterfactual Flow
Han, Ruisheng
Zhou, Kanglei
Chen, Shuang
Atapour-Abarghouei, Amir
Shum, Hubert P. H.
Computer Vision and Pattern Recognition
Action Quality Assessment (AQA) predicts fine-grained execution scores from action videos and is widely applied in sports, rehabilitation, and skill evaluation. Long-term AQA, as in figure skating or rhythmic gymnastics, is especially challenging since it requires modeling extended temporal dynamics while remaining robust to contextual confounders. Existing approaches either depend on costly annotations or rely on unidirectional temporal modeling, making them vulnerable to spurious correlations and unstable long-term representations. To this end, we propose CaFlow, a unified framework that integrates counterfactual de-confounding with bidirectional time-conditioned flow. The Causal Counterfactual Regularization (CCR) module disentangles causal and confounding features in a self-supervised manner and enforces causal robustness through counterfactual interventions, while the BiT-Flow module models forward and backward dynamics with a cycle-consistency constraint to produce smoother and more coherent representations. Extensive experiments on multiple long-term AQA benchmarks demonstrate that CaFlow achieves state-of-the-art performance. Code is available at https://github.com/Harrison21/CaFlow
title CaFlow: Enhancing Long-Term Action Quality Assessment with Causal Counterfactual Flow
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.21653