Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zheng, Muyang, Zhou, Tong, Wu, Geyang, Lin, Zihao, Wang, Haibo, Huang, Lifu
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914504406728704
author Zheng, Muyang
Zhou, Tong
Wu, Geyang
Lin, Zihao
Wang, Haibo
Huang, Lifu
author_facet Zheng, Muyang
Zhou, Tong
Wu, Geyang
Lin, Zihao
Wang, Haibo
Huang, Lifu
contents Open-ended video game glitch detection aims to identify glitches in gameplay videos, describe them in natural language, and localize when they occur. Unlike conventional game glitch understanding tasks which have largely been framed as image-level recognition or closed-form question answering, this task requires reasoning about game-specific dynamics such as mechanics, physics, rendering, animation, and expected state transitions directly over continuous gameplay videos and distinguishing true glitches from unusual but valid in-game events. To support this task, we introduce VideoGlitchBench, the first benchmark for open-ended video game glitch detection with temporal localization. VideoGlitchBench contains 5,238 gameplay videos from 120 games, each annotated with detailed glitch descriptions and precise temporal spans, enabling unified evaluation of semantic understanding and temporal grounding. We further propose GliDe, an agentic framework with three key components: a game-aware contextual memory for informed reasoning, a debate-based reflector for multi-perspective glitch detection and verification, and an event-level grounding module that recovers complete glitch intervals from fragmented temporal evidence. We also design a task-specific evaluation protocol that jointly measures semantic fidelity and temporal accuracy. Experiments show that this task remains highly challenging for current multimodal models, while GliDe achieves substantially stronger performance than corresponding vanilla model baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2604_07818
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding
Zheng, Muyang
Zhou, Tong
Wu, Geyang
Lin, Zihao
Wang, Haibo
Huang, Lifu
Multiagent Systems
Open-ended video game glitch detection aims to identify glitches in gameplay videos, describe them in natural language, and localize when they occur. Unlike conventional game glitch understanding tasks which have largely been framed as image-level recognition or closed-form question answering, this task requires reasoning about game-specific dynamics such as mechanics, physics, rendering, animation, and expected state transitions directly over continuous gameplay videos and distinguishing true glitches from unusual but valid in-game events. To support this task, we introduce VideoGlitchBench, the first benchmark for open-ended video game glitch detection with temporal localization. VideoGlitchBench contains 5,238 gameplay videos from 120 games, each annotated with detailed glitch descriptions and precise temporal spans, enabling unified evaluation of semantic understanding and temporal grounding. We further propose GliDe, an agentic framework with three key components: a game-aware contextual memory for informed reasoning, a debate-based reflector for multi-perspective glitch detection and verification, and an event-level grounding module that recovers complete glitch intervals from fragmented temporal evidence. We also design a task-specific evaluation protocol that jointly measures semantic fidelity and temporal accuracy. Experiments show that this task remains highly challenging for current multimodal models, while GliDe achieves substantially stronger performance than corresponding vanilla model baselines.
title Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding
topic Multiagent Systems
url https://arxiv.org/abs/2604.07818