Cover Image

Unleashing the Temporal-Spatial Reasoning Capacity of GPT for Training-Free Audio and Language Referenced Video Object Segmentation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huang, Shaofei, Ling, Rui, Li, Hongyu, Hui, Tianrui, Tang, Zongheng, Wei, Xiaoming, Han, Jizhong, Liu, Si
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Revisiting Audio-Visual Segmentation with Vision-Centric Transformer
by: Huang, Shaofei, et al.
Published: (2025)

LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding
by: Li, Hongyu, et al.
Published: (2025)

Unleashing Hierarchical Reasoning: An LLM-Driven Framework for Training-Free Referring Video Object Segmentation
by: Zhao, Bingrui, et al.
Published: (2025)

Enriching Phrases with Coupled Pixel and Object Contexts for Panoptic Narrative Grounding
by: Hui, Tianrui, et al.
Published: (2023)

Dynamic Prompting of Frozen Text-to-Image Diffusion Models for Panoptic Narrative Grounding
by: Li, Hongyu, et al.
Published: (2024)

FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instruction
by: He, Runze, et al.
Published: (2024)

Cross-Referencing Self-Training Network for Sound Event Detection in Audio Mixtures
by: Park, Sangwook, et al.
Published: (2021)

Learning Motion and Temporal Cues for Unsupervised Video Object Segmentation
by: Zhuge, Yunzhi, et al.
Published: (2025)

Training-Free Spatio-temporal Decoupled Reasoning Video Segmentation with Adaptive Object Memory
by: Zhu, Zhengtong, et al.
Published: (2026)

RASA: Replace Anyone, Say Anything -- A Training-Free Framework for Audio-Driven and Universal Portrait Video Editing
by: Pan, Tianrui, et al.
Published: (2025)

Spatial-Temporal Multi-level Association for Video Object Segmentation
by: Miao, Deshui, et al.
Published: (2024)

Training-Free Robust Interactive Video Object Segmentation
by: Wei, Xiaoli, et al.
Published: (2024)

VGGT-Segmentor: Geometry-Enhanced Cross-View Segmentation
by: Gao, Yulu, et al.
Published: (2026)

Decomposed Attention Fusion in MLLMs for Training-Free Video Reasoning Segmentation
by: Han, Su Ho, et al.
Published: (2025)

Online Reasoning Video Object Segmentation
by: Liu, Jinyuan, et al.
Published: (2026)

In-the-wild Audio Spatialization with Flexible Text-guided Localization
by: Pan, Tianrui, et al.
Published: (2025)

Anchor3DLane++: 3D Lane Detection via Sample-Adaptive Sparse 3D Anchor Regression
by: Huang, Shaofei, et al.
Published: (2024)

Video Object Segmentation-Aware Audio Generation
by: Viertola, Ilpo, et al.
Published: (2025)

Spatio-Temporal Representation Decoupling and Enhancement for Federated Instrument Segmentation in Surgical Videos
by: Fang, Zheng, et al.
Published: (2025)

Temporal-Conditional Referring Video Object Segmentation with Noise-Free Text-to-Video Diffusion Model
by: Zhang, Ruixin, et al.
Published: (2025)

AudioRAG: A Challenging Benchmark for Audio Reasoning and Information Retrieval
by: Lin, Jingru, et al.
Published: (2026)

Video2BEV: Transforming Drone Videos to BEVs for Video-based Geo-localization
by: Ju, Hao, et al.
Published: (2024)

Boosting MLLM Spatial Reasoning with Geometrically Referenced 3D Scene Representations
by: Yuan, Jiangye, et al.
Published: (2026)

Think Before You Segment: An Object-aware Reasoning Agent for Referring Audio-Visual Segmentation
by: Zhou, Jinxing, et al.
Published: (2025)

VTG-GPT: Tuning-Free Zero-Shot Video Temporal Grounding with GPT
by: Xu, Yifang, et al.
Published: (2024)

DOMR: Establishing Cross-View Segmentation via Dense Object Matching
by: Liao, Jitong, et al.
Published: (2025)

Video Spatial Reasoning with Object-Centric 3D Rollout
by: Tang, Haoran, et al.
Published: (2025)

Locality-aware Cross-modal Correspondence Learning for Dense Audio-Visual Events Localization
by: Xing, Ling, et al.
Published: (2024)

Unleashing Temporal Capacity of Spiking Neural Networks through Spatiotemporal Separation
by: Dong, Yiting, et al.
Published: (2025)

Free-GVC: Towards Training-Free Extreme Generative Video Compression with Temporal Coherence
by: Ling, Xiaoyue, et al.
Published: (2026)

Training-Free Open-Ended Object Detection and Segmentation via Attention as Prompts
by: Lin, Zhiwei, et al.
Published: (2024)

KV-Edit: Training-Free Image Editing for Precise Background Preservation
by: Zhu, Tianrui, et al.
Published: (2025)

Training-Free Multimodal Guidance for Video to Audio Generation
by: Grassucci, Eleonora, et al.
Published: (2025)

Rebellion: Noise-Robust Reasoning Training for Audio Reasoning Models
by: Huang, Tiansheng, et al.
Published: (2025)

Latest Object Memory Management for Temporally Consistent Video Instance Segmentation
by: Lee, Seunghun, et al.
Published: (2025)

Unleashing the Power of Chain-of-Prediction for Monocular 3D Object Detection
by: Zhang, Zhihao, et al.
Published: (2025)

One-shot Training for Video Object Segmentation
by: Chen, Baiyu, et al.
Published: (2024)

DDAVS: Disentangled Audio Semantics and Delayed Bidirectional Alignment for Audio-Visual Segmentation
by: Tian, Jingqi, et al.
Published: (2025)

Audio-Sync Video Generation with Multi-Stream Temporal Control
by: Weng, Shuchen, et al.
Published: (2025)

Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis
by: Tang, Hao, et al.
Published: (2025)