Image de couverture de livre

Continuous Perception Matters: Diagnosing Temporal Integration Failures in Multimodal Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Zeyu, Weng, Zhenzhen, Yeung-Levy, Serena
Format:	Preprint
Publié:	2024
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Multi-Human Mesh Recovery with Transformers
par: Wang, Zeyu, et autres
Publié: (2024)

Downscaling Intelligence: Exploring Perception and Reasoning Bottlenecks in Small Multimodal Models
par: Endo, Mark, et autres
Publié: (2025)

Diffusion-HPC: Synthetic Data Generation for Human Mesh Recovery in Challenging Domains
par: Weng, Zhenzhen, et autres
Publié: (2023)

DeforHMR: Vision Transformer with Deformable Cross-Attention for 3D Human Mesh Recovery
par: Heo, Jaewoo, et autres
Publié: (2024)

Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Models
par: Bravo-Sánchez, Laura, et autres
Publié: (2024)

Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM
par: Weng, Zhenzhen, et autres
Publié: (2024)

Zero-shot Action Localization via the Confidence of Large Vision-Language Models
par: Aklilu, Josiah, et autres
Publié: (2024)

Feather the Throttle: Revisiting Visual Token Pruning for Vision-Language Model Acceleration
par: Endo, Mark, et autres
Publié: (2024)

Foundation Models Secretly Understand Neural Network Weights: Enhancing Hypernetwork Architectures with Foundation Models
par: Gu, Jeffrey, et autres
Publié: (2025)

The Impact of Image Resolution on Biomedical Multimodal Large Language Models
par: Chen, Liangyu, et autres
Publié: (2025)

Temporal Preference Optimization for Long-Form Video Understanding
par: Li, Rui, et autres
Publié: (2025)

Seeing Is Believing? A Benchmark for Multimodal Large Language Models on Visual Illusions and Anomalies
par: Hou, Wenjin, et autres
Publié: (2026)

Do VLMs Perceive or Recall? Probing Visual Perception vs. Memory with Classic Visual Illusions
par: Sun, Xiaoxiao, et autres
Publié: (2026)

Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language Models
par: Sui, Elaine, et autres
Publié: (2024)

Motion Diffusion-Guided 3D Global HMR from a Dynamic Camera
par: Heo, Jaewoo, et autres
Publié: (2024)

CrossCheck-Bench: Diagnosing Compositional Failures in Multimodal Conflict Resolution
par: Tian, Baoliang, et autres
Publié: (2025)

Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Models
par: Burgess, James, et autres
Publié: (2023)

SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Models
par: Deng, Andong, et autres
Publié: (2025)

VideoAgent: Long-form Video Understanding with Large Language Model as Agent
par: Wang, Xiaohan, et autres
Publié: (2024)

Revisiting Active Learning in the Era of Vision Foundation Models
par: Gupte, Sanket Rajan, et autres
Publié: (2024)

CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworks
par: Gu, Jeffrey, et autres
Publié: (2025)

Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data
par: Zhang, Yuhui, et autres
Publié: (2024)

Dr.V: A Hierarchical Perception-Temporal-Cognition Framework to Diagnose Video Hallucination by Fine-grained Spatial-Temporal Grounding
par: Luo, Meng, et autres
Publié: (2025)

V-GRPO: Online Reinforcement Learning for Denoising Generative Models Is Easier than You Think
par: Tang, Bingda, et autres
Publié: (2026)

Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
par: Zohar, Orr, et autres
Publié: (2024)

Depth-guided NeRF Training via Earth Mover's Distance
par: Rau, Anita, et autres
Publié: (2024)

NegVQA: Can Vision Language Models Understand Negation?
par: Zhang, Yuhui, et autres
Publié: (2025)

Fine-tuning MLLMs Without Forgetting Is Easier Than You Think
par: Li, He, et autres
Publié: (2026)

Apollo: An Exploration of Video Understanding in Large Multimodal Models
par: Zohar, Orr, et autres
Publié: (2024)

Anny-Fit: All-Age Human Mesh Recovery
par: Bravo-Sánchez, Laura, et autres
Publié: (2026)

Synthetic Designed Experiments for Diagnosing Vision Model Failure
par: Sarkar, Krisanu
Publié: (2026)

Perceive What Matters: Relevance-Driven Scheduling for Multimodal Streaming Perception
par: Huang, Dingcheng, et autres
Publié: (2026)

Interactive Multimodal Fusion with Temporal Modeling
par: Yu, Jun, et autres
Publié: (2025)

VideoPerceiver: Enhancing Fine-Grained Temporal Perception in Video Multimodal Large Language Models
par: Zhao, Fufangchen, et autres
Publié: (2025)

Urban Safety Perception Assessments via Integrating Multimodal Large Language Models with Street View Images
par: Zhang, Jiaxin, et autres
Publié: (2024)

SNN-Driven Multimodal Human Action Recognition via Sparse Spatial-Temporal Data Fusion
par: Zheng, Naichuan, et autres
Publié: (2025)

Can BEV Perception Gracefully Degrade under Sensor Failures?
par: Zhang, Haifa, et autres
Publié: (2026)

Transductive Visual Programming: Evolving Tool Libraries from Experience for Spatial Reasoning
par: Wu, Shengguang, et autres
Publié: (2025)

TTRV: Test-Time Reinforcement Learning for Vision Language Models
par: Singh, Akshit, et autres
Publié: (2025)

Diagnosing and Correcting Concept Omission in Multimodal Diffusion Transformers
par: Baek, Kanghyun, et autres
Publié: (2026)