Cover Image

Beyond Text: Frozen Large Language Models in Visual Signal Comprehension

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Lei, Wei, Fangyun, Lu, Yanye
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scaling the Codebook Size of VQGAN to 100,000 with a Utilization Rate of 99%
by: Zhu, Lei, et al.
Published: (2024)

Chat-CBM: Towards Interactive Concept Bottleneck Models with Frozen Large Language Models
by: He, Hangzhou, et al.
Published: (2025)

Revisiting Referring Expression Comprehension Evaluation in the Era of Large Multimodal Models
by: Chen, Jierun, et al.
Published: (2024)

Towards Online Continuous Sign Language Recognition and Translation
by: Zuo, Ronglai, et al.
Published: (2024)

Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label
by: Zhang, Xinliang, et al.
Published: (2024)

Training-free Test-time Improvement for Explainable Medical Image Classification
by: He, Hangzhou, et al.
Published: (2025)

TextRegion: Text-Aligned Region Tokens from Frozen Image-Text Models
by: Xiao, Yao, et al.
Published: (2025)

FLAME: Frozen Large Language Models Enable Data-Efficient Language-Image Pre-training
by: Cao, Anjia, et al.
Published: (2024)

SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehension
by: Li, Bohao, et al.
Published: (2024)

Beyond Shortcuts: Mitigating Visual Illusions in Frozen VLMs via Qualitative Reasoning
by: Guo, Hao, et al.
Published: (2026)

Physics-Informed Conditional Diffusion for Motion-Robust Retinal Temporal Laser Speckle Contrast Imaging
by: Chen, Qian, et al.
Published: (2026)

V2C-CBM: Building Concept Bottlenecks with Vision-to-Concept Tokenizer
by: He, Hangzhou, et al.
Published: (2025)

F-LMM: Grounding Frozen Large Multimodal Models
by: Wu, Size, et al.
Published: (2024)

VP-Bench: A Comprehensive Benchmark for Visual Prompting in Multimodal Large Language Models
by: Xu, Mingjie, et al.
Published: (2025)

X-Fusion: Introducing New Modality to Frozen Large Language Models
by: Mo, Sicheng, et al.
Published: (2025)

FrozenSeg: Harmonizing Frozen Foundation Models for Open-Vocabulary Segmentation
by: Chen, Xi, et al.
Published: (2024)

Harmonizing Visual Text Comprehension and Generation
by: Zhao, Zhen, et al.
Published: (2024)

Frozen-DETR: Enhancing DETR with Image Understanding from Frozen Foundation Models
by: Fu, Shenghao, et al.
Published: (2024)

Dynamic Prompting of Frozen Text-to-Image Diffusion Models for Panoptic Narrative Grounding
by: Li, Hongyu, et al.
Published: (2024)

Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning
by: Li, Siwei, et al.
Published: (2024)

SuperCL: Superpixel Guided Contrastive Learning for Medical Image Segmentation Pre-training
by: Zeng, Shuang, et al.
Published: (2025)

A Hong Kong Sign Language Corpus Collected from Sign-interpreted TV News
by: Niu, Zhe, et al.
Published: (2024)

A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Models
by: Li, Duo, et al.
Published: (2025)

Tango: Taming Visual Signals for Efficient Video Large Language Models
by: Yin, Shukang, et al.
Published: (2026)

Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation
by: Chen, Qian, et al.
Published: (2024)

A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
by: Zuo, Ronglai, et al.
Published: (2024)

IllusionBench+: A Large-scale and Comprehensive Benchmark for Visual Illusion Understanding in Vision-Language Models
by: Zhang, Yiming, et al.
Published: (2025)

VISTA-Bench: Do Vision-Language Models Really Understand Visualized Text as Well as Pure Text?
by: Liu, Qing'an, et al.
Published: (2026)

SOWA: Adapting Hierarchical Frozen Window Self-Attention to Visual-Language Models for Better Anomaly Detection
by: Hu, Zongxiang, et al.
Published: (2024)

Large Language Models are Universal Reasoners for Visual Generation
by: Ren, Sucheng, et al.
Published: (2026)

Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review
by: Fu, Pei, et al.
Published: (2025)

LM4LV: A Frozen Large Language Model for Low-level Vision Tasks
by: Zheng, Boyang, et al.
Published: (2024)

StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyond
by: Lyu, Pengyuan, et al.
Published: (2024)

video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
by: Sun, Guangzhi, et al.
Published: (2024)

Heptapod: Language Modeling on Visual Signals
by: Zhu, Yongxin, et al.
Published: (2025)

Enhancing Large Vision Language Models with Self-Training on Image Comprehension
by: Deng, Yihe, et al.
Published: (2024)

Safety of Multimodal Large Language Models on Images and Texts
by: Liu, Xin, et al.
Published: (2024)

Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models
by: Wang, Xiaomeng, et al.
Published: (2026)

Bridging Degradation Discrimination and Generation for Universal Image Restoration
by: Hu, JiaKui, et al.
Published: (2026)

Universal Image Restoration Pre-training via Degradation Classification
by: Hu, JiaKui, et al.
Published: (2025)