EgoLCD: Egocentric Video Generation with Long Context Diffusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Liuzhou, Ye, Jiarui, Wang, Yuanlei, Zhong, Ming, Cao, Mingju, Xia, Wanke, Zeng, Bowen, Zhang, Zeyu, Tang, Hao
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917124527620096
author Zhang, Liuzhou
Ye, Jiarui
Wang, Yuanlei
Zhong, Ming
Cao, Mingju
Xia, Wanke
Zeng, Bowen
Zhang, Zeyu
Tang, Hao
author_facet Zhang, Liuzhou
Ye, Jiarui
Wang, Yuanlei
Zhong, Ming
Cao, Mingju
Xia, Wanke
Zeng, Bowen
Zhang, Zeyu
Tang, Hao
contents Generating long, coherent egocentric videos is difficult, as hand-object interactions and procedural tasks require reliable long-term memory. Existing autoregressive models suffer from content drift, where object identity and scene semantics degrade over time. To address this challenge, we introduce EgoLCD, an end-to-end framework for egocentric long-context video generation that treats long video synthesis as a problem of efficient and stable memory management. EgoLCD combines a Long-Term Sparse KV Cache for stable global context with an attention-based short-term memory, extended by LoRA for local adaptation. A Memory Regulation Loss enforces consistent memory usage, and Structured Narrative Prompting provides explicit temporal guidance. Extensive experiments on the EgoVid-5M benchmark demonstrate that EgoLCD achieves state-of-the-art performance in both perceptual quality and temporal consistency, effectively mitigating generative forgetting and representing a significant step toward building scalable world models for embodied AI. Code: https://github.com/AIGeeksGroup/EgoLCD. Website: https://aigeeksgroup.github.io/EgoLCD.
format Preprint
id arxiv_https___arxiv_org_abs_2512_04515
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EgoLCD: Egocentric Video Generation with Long Context Diffusion
Zhang, Liuzhou
Ye, Jiarui
Wang, Yuanlei
Zhong, Ming
Cao, Mingju
Xia, Wanke
Zeng, Bowen
Zhang, Zeyu
Tang, Hao
Computer Vision and Pattern Recognition
Generating long, coherent egocentric videos is difficult, as hand-object interactions and procedural tasks require reliable long-term memory. Existing autoregressive models suffer from content drift, where object identity and scene semantics degrade over time. To address this challenge, we introduce EgoLCD, an end-to-end framework for egocentric long-context video generation that treats long video synthesis as a problem of efficient and stable memory management. EgoLCD combines a Long-Term Sparse KV Cache for stable global context with an attention-based short-term memory, extended by LoRA for local adaptation. A Memory Regulation Loss enforces consistent memory usage, and Structured Narrative Prompting provides explicit temporal guidance. Extensive experiments on the EgoVid-5M benchmark demonstrate that EgoLCD achieves state-of-the-art performance in both perceptual quality and temporal consistency, effectively mitigating generative forgetting and representing a significant step toward building scalable world models for embodied AI. Code: https://github.com/AIGeeksGroup/EgoLCD. Website: https://aigeeksgroup.github.io/EgoLCD.
title EgoLCD: Egocentric Video Generation with Long Context Diffusion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.04515