EvoVid: Temporal-Centric Self-Evolution for Video Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Shiqi, Wang, Ziyue, Zuo, Zhongrong, Qiu, Han, She, Qi, Wen, Bihan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916033678278656
author Huang, Shiqi
Wang, Ziyue
Zuo, Zhongrong
Qiu, Han
She, Qi
Wen, Bihan
author_facet Huang, Shiqi
Wang, Ziyue
Zuo, Zhongrong
Qiu, Han
She, Qi
Wen, Bihan
contents Recent Video Large Language Models (Video-LLMs) have demonstrated strong capabilities in video reasoning through reinforcement learning (RL). However, existing RL pipelines rely heavily on human-annotated tasks and solutions, making them costly to scale and fundamentally constrained by human expertise. Self-evolving frameworks have recently emerged as a promising alternative through autonomous Questioner-Solver self-play. Unfortunately, these approaches are primarily designed for static modalities such as text and images, fundamentally failing to capture the temporal dynamics that are central to video reasoning. In this work, we propose $\textbf{EvoVid}$, a temporal-centric self-evolving framework that enables Video-LLMs to improve directly from raw, unannotated videos. Specifically, we introduce two complementary temporal-centric rewards: a temporal-aware Questioner reward that encourages temporally dependent question generation through temporal perturbation sensitivity, and a temporal-grounded Solver reward that provides automatic temporal supervision via inherent video segment localization. Extensive experiments across four base models and six benchmarks demonstrate consistent improvements over both base models and existing self-evolving baselines, achieving competitive performance with supervised methods. These results highlight temporal-centric self-evolution as an effective and scalable paradigm for video understanding and reasoning.
format Preprint
id arxiv_https___arxiv_org_abs_2605_21931
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EvoVid: Temporal-Centric Self-Evolution for Video Large Language Models
Huang, Shiqi
Wang, Ziyue
Zuo, Zhongrong
Qiu, Han
She, Qi
Wen, Bihan
Computer Vision and Pattern Recognition
Recent Video Large Language Models (Video-LLMs) have demonstrated strong capabilities in video reasoning through reinforcement learning (RL). However, existing RL pipelines rely heavily on human-annotated tasks and solutions, making them costly to scale and fundamentally constrained by human expertise. Self-evolving frameworks have recently emerged as a promising alternative through autonomous Questioner-Solver self-play. Unfortunately, these approaches are primarily designed for static modalities such as text and images, fundamentally failing to capture the temporal dynamics that are central to video reasoning. In this work, we propose $\textbf{EvoVid}$, a temporal-centric self-evolving framework that enables Video-LLMs to improve directly from raw, unannotated videos. Specifically, we introduce two complementary temporal-centric rewards: a temporal-aware Questioner reward that encourages temporally dependent question generation through temporal perturbation sensitivity, and a temporal-grounded Solver reward that provides automatic temporal supervision via inherent video segment localization. Extensive experiments across four base models and six benchmarks demonstrate consistent improvements over both base models and existing self-evolving baselines, achieving competitive performance with supervised methods. These results highlight temporal-centric self-evolution as an effective and scalable paradigm for video understanding and reasoning.
title EvoVid: Temporal-Centric Self-Evolution for Video Large Language Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.21931