Image de couverture de livre

Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Pantazopoulos, Georgios, Nikandrou, Malvina, Suglia, Alessandro, Lemon, Oliver, Eshghi, Arash
Format:	Preprint
Publié:	2024
Sujets:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Lost in Space: Probing Fine-grained Spatial Understanding in Vision and Language Resamplers
par: Pantazopoulos, Georgios, et autres
Publié: (2024)

CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Concepts
par: Nikandrou, Malvina, et autres
Publié: (2024)

Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation
par: Nikandrou, Malvina, et autres
Publié: (2024)

Learning To See But Forgetting To Follow: Visual Instruction Tuning Makes LLMs More Prone To Jailbreak Attacks
par: Pantazopoulos, Georgios, et autres
Publié: (2024)

Retrievit: In-context Retrieval Capabilities of Transformers, State Space Models, and Hybrid Architectures
par: Pantazopoulos, Georgios, et autres
Publié: (2026)

AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video Understanding
par: Suglia, Alessandro, et autres
Publié: (2024)

Towards Understanding Visual Grounding in Visual Language Models
par: Pantazopoulos, Georgios, et autres
Publié: (2025)

VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models
par: Saxena, Rohit, et autres
Publié: (2026)

AgriPath: A Systematic Exploration of Architectural Trade-offs for Crop Disease Classification
par: Mooraj, Hamza, et autres
Publié: (2026)

Same Answer, Different Representations: Hidden instability in VLMs
par: Wani, Farooq Ahmad, et autres
Publié: (2026)

Do VLMs Need Vision Transformers? Evaluating State Space Models as Vision Encoders
par: Kuo, Shang-Jui Ray, et autres
Publié: (2026)

Evaluating Vision Language Models (VLMs) for Radiology: A Comprehensive Analysis
par: Li, Frank, et autres
Publié: (2025)

Can Vision-Language Models be a Good Guesser? Exploring VLMs for Times and Location Reasoning
par: Zhang, Gengyuan, et autres
Publié: (2023)

Linear Spaces of Meanings: Compositional Structures in Vision-Language Models
par: Trager, Matthew, et autres
Publié: (2023)

Enhancing Subsequent Video Retrieval via Vision-Language Models (VLMs)
par: Duan, Yicheng, et autres
Publié: (2025)

Can Vision-Language Models Understand Construction Workers? An Exploratory Study
par: Bui, Hieu, et autres
Publié: (2026)

Can Generalist Vision Language Models (VLMs) Rival Specialist Medical VLMs? Benchmarking and Strategic Insights
par: Zhong, Yuan, et autres
Publié: (2025)

Your Vision-Language Model Can't Even Count to 20: Exposing the Failures of VLMs in Compositional Counting
par: Guo, Xuyang, et autres
Publié: (2025)

NanoVLMs: How small can we go and still make coherent Vision Language Models?
par: Agarwalla, Mukund, et autres
Publié: (2025)

Deformba: Vision State Space Model with Adaptive State Fusion
par: Ke, Hongyu, et autres
Publié: (2026)

Edge Reliability Gap in Vision-Language Models: Quantifying Failure Modes of Compressed VLMs Under Visual Corruption
par: Erol, Mehmet Kaan
Publié: (2026)

SF-Mamba: Rethinking State Space Model for Vision
par: Yoshimura, Masakazu, et autres
Publié: (2026)

VLMs have Tunnel Vision: Evaluating Nonlocal Visual Reasoning in Leading VLMs
par: Berman, Shmuel, et autres
Publié: (2025)

MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning
par: Pan, Jiazhen, et autres
Publié: (2025)

Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Models
par: Karamcheti, Siddharth, et autres
Publié: (2024)

Mixed Signals: Decoding VLMs' Reasoning and Underlying Bias in Vision-Language Conflict
par: Pezeshkpour, Pouya, et autres
Publié: (2025)

DISSECT: Diagnosing Where Vision Ends and Language Priors Begin in Scientific VLMs
par: Kukreja, Dikshant, et autres
Publié: (2026)

LLaVA-CKD: Bottom-Up Cascaded Knowledge Distillation for Vision-Language Models
par: Gkalelis, Nikolaos, et autres
Publié: (2026)

Do Vision-Language Models Measure Up? Benchmarking Visual Measurement Reading with MeasureBench
par: Lin, Fenfen, et autres
Publié: (2025)

Evaluating Compositional Generalisation in VLMs and Diffusion Models
par: Pearson, Beth, et autres
Publié: (2025)

Towards Lossless Ultimate Vision Token Compression for VLMs
par: Zheng, Dehua, et autres
Publié: (2025)

MM-R$^3$: On (In-)Consistency of Vision-Language Models (VLMs)
par: Chou, Shih-Han, et autres
Publié: (2024)

TCP-SSM: Efficient Vision State Space Models with Token-Conditioned Poles
par: Shoouri, Sara, et autres
Publié: (2026)

A Separable Self-attention Inspired by the State Space Model for Computer Vision
par: Zhang, Juntao, et autres
Publié: (2025)

Intriguing Equivalence Structures of the Embedding Space of Vision Transformers
par: Salman, Shaeke, et autres
Publié: (2024)

Exploring Token Pruning in Vision State Space Models
par: Zhan, Zheng, et autres
Publié: (2024)

CompareBench: A Benchmark for Visual Comparison Reasoning in Vision-Language Models
par: Cai, Jie, et autres
Publié: (2025)

SAMamba: Adaptive State Space Modeling with Hierarchical Vision for Infrared Small Target Detection
par: Xu, Wenhao, et autres
Publié: (2025)

LightZeroNav: Zero-Shot Vision Language Navigation in Continuous Environments Based on Lightweight VLMs
par: Luo, Kun, et autres
Publié: (2026)

Stateful Token Reduction for Long-Video Hybrid VLMs
par: Jiang, Jindong, et autres
Publié: (2026)