Saved in:
Bibliographic Details
Main Authors: Wu, Chaochen, Luo, Guan, Zuo, Meiyun, Fan, Zhitao
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.00370
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918181522636800
author Wu, Chaochen
Luo, Guan
Zuo, Meiyun
Fan, Zhitao
author_facet Wu, Chaochen
Luo, Guan
Zuo, Meiyun
Fan, Zhitao
contents Video moment retrieval uses a text query to locate a moment from a given untrimmed video reference. Locating corresponding video moments with text queries helps people interact with videos efficiently. Current solutions for this task have not considered conflict within location results from different models, so various models cannot integrate correctly to produce better results. This study introduces a reinforcement learning-based video moment retrieval model that can scan the whole video once to find the moment's boundary while producing its locational evidence. Moreover, we proposed a multi-agent system framework that can use evidential learning to resolve conflicts between agents' localization output. As a side product of observing and dealing with conflicts between agents, we can decide whether a query has no corresponding moment in a video (out-of-scope) without additional training, which is suitable for real-world applications. Extensive experiments on benchmark datasets show the effectiveness of our proposed methods compared with state-of-the-art approaches. Furthermore, the results of our study reveal that modeling competition and conflict of the multi-agent system is an effective way to improve RL performance in moment retrieval and show the new role of evidential learning in the multi-agent framework.
format Preprint
id arxiv_https___arxiv_org_abs_2511_00370
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Who Can We Trust? Scope-Aware Video Moment Retrieval with Multi-Agent Conflict
Wu, Chaochen
Luo, Guan
Zuo, Meiyun
Fan, Zhitao
Computer Vision and Pattern Recognition
Artificial Intelligence
Video moment retrieval uses a text query to locate a moment from a given untrimmed video reference. Locating corresponding video moments with text queries helps people interact with videos efficiently. Current solutions for this task have not considered conflict within location results from different models, so various models cannot integrate correctly to produce better results. This study introduces a reinforcement learning-based video moment retrieval model that can scan the whole video once to find the moment's boundary while producing its locational evidence. Moreover, we proposed a multi-agent system framework that can use evidential learning to resolve conflicts between agents' localization output. As a side product of observing and dealing with conflicts between agents, we can decide whether a query has no corresponding moment in a video (out-of-scope) without additional training, which is suitable for real-world applications. Extensive experiments on benchmark datasets show the effectiveness of our proposed methods compared with state-of-the-art approaches. Furthermore, the results of our study reveal that modeling competition and conflict of the multi-agent system is an effective way to improve RL performance in moment retrieval and show the new role of evidential learning in the multi-agent framework.
title Who Can We Trust? Scope-Aware Video Moment Retrieval with Multi-Agent Conflict
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2511.00370