Copertina

TRINS: Towards Multimodal Language Models that Can Read

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Ruiyi, Zhang, Yanzhe, Chen, Jian, Zhou, Yufan, Gu, Jiuxiang, Chen, Changyou, Sun, Tong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LLaVA-Read: Enhancing Reading Ability of Multimodal Language Models
di: Zhang, Ruiyi, et al.
Pubblicazione: (2024)

MMR: Evaluating Reading Ability of Large Multimodal Models
di: Chen, Jian, et al.
Pubblicazione: (2024)

Multimodal LLMs as Customized Reward Models for Text-to-Image Generation
di: Zhou, Shijie, et al.
Pubblicazione: (2025)

Towards Visual Text Grounding of Multimodal Large Language Model
di: Li, Ming, et al.
Pubblicazione: (2025)

Customization Assistant for Text-to-image Generation
di: Zhou, Yufan, et al.
Pubblicazione: (2023)

SV-RAG: LoRA-Contextualizing Adaptation of MLLMs for Long Document Understanding
di: Chen, Jian, et al.
Pubblicazione: (2024)

LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding
di: Zhang, Yanzhe, et al.
Pubblicazione: (2023)

ARTIST: Improving the Generation of Text-rich Images with Disentangled Diffusion Models and Large Language Models
di: Zhang, Jianyi, et al.
Pubblicazione: (2024)

A High-Quality Text-Rich Image Instruction Tuning Dataset via Hybrid Instruction Generation
di: Zhou, Shijie, et al.
Pubblicazione: (2024)

SUGAR: Subject-Driven Video Customization in a Zero-Shot Manner
di: Zhou, Yufan, et al.
Pubblicazione: (2024)

Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints
di: Chen, Jian, et al.
Pubblicazione: (2024)

Enhancing Diffusion Posterior Sampling for Inverse Problems by Integrating Crafted Measurements
di: Zhou, Shijie, et al.
Pubblicazione: (2024)

MENTOR: Efficient Multimodal-Conditioned Tuning for Autoregressive Vision Generation Models
di: Zhao, Haozhe, et al.
Pubblicazione: (2025)

GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding
di: Zhou, Shijie, et al.
Pubblicazione: (2025)

Through the Theory of Mind's Eye: Reading Minds with Multimodal Video Large Language Models
di: Chen, Zhawnen, et al.
Pubblicazione: (2024)

Can Multimodal Large Language Models Truly Understand Small Objects?
di: Han, Fujun, et al.
Pubblicazione: (2026)

Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models
di: Zhu, Wanrong, et al.
Pubblicazione: (2024)

Toffee: Efficient Million-Scale Dataset Construction for Subject-Driven Text-to-Image Generation
di: Zhou, Yufan, et al.
Pubblicazione: (2024)

Personalized Multimodal Large Language Models: A Survey
di: Wu, Junda, et al.
Pubblicazione: (2024)

Scaling the Long Video Understanding of Multimodal Large Language Models via Visual Memory Mechanism
di: Chen, Tao, et al.
Pubblicazione: (2026)

Can Multimodal Large Language Models Truly Perform Multimodal In-Context Learning?
di: Chen, Shuo, et al.
Pubblicazione: (2023)

Zooming into Comics: Region-Aware RL Improves Fine-Grained Comic Understanding in Vision-Language Models
di: Chen, Yule, et al.
Pubblicazione: (2025)

Towards Self-Refinement of Vision-Language Models with Triangular Consistency
di: Deng, Yunlong, et al.
Pubblicazione: (2025)

Language Models Can See Better: Visual Contrastive Decoding For LLM Multimodal Reasoning
di: Pang, Yuqi, et al.
Pubblicazione: (2025)

Investigating Redundancy in Multimodal Large Language Models with Multiple Vision Encoders
di: Wang, Yizhou, et al.
Pubblicazione: (2025)

Can Large Multimodal Models Understand Agricultural Scenes? Benchmarking with AgroMind
di: Li, Qingmei, et al.
Pubblicazione: (2025)

Can We Edit Multimodal Large Language Models?
di: Cheng, Siyuan, et al.
Pubblicazione: (2023)

Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
di: He, Yiran, et al.
Pubblicazione: (2025)

Read and Think: An Efficient Step-wise Multimodal Language Model for Document Understanding and Reasoning
di: Zhang, Jinxu
Pubblicazione: (2024)

MusiXQA: Advancing Visual Music Understanding in Multimodal Large Language Models
di: Chen, Jian, et al.
Pubblicazione: (2025)

Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset
di: Chen, Qian, et al.
Pubblicazione: (2026)

Towards Generalized Multimodal Homography Estimation
di: You, Jinkun, et al.
Pubblicazione: (2026)

Prompt-Aware Adapter: Towards Learning Adaptive Visual Tokens for Multimodal Large Language Models
di: Zhang, Yue, et al.
Pubblicazione: (2024)

Contextual Object Detection with Multimodal Large Language Models
di: Zang, Yuhang, et al.
Pubblicazione: (2023)

Dynamic Multimodal Activation Steering for Hallucination Mitigation in Large Vision-Language Models
di: Yin, Jianghao, et al.
Pubblicazione: (2026)

AutoBench-V: Can Large Vision-Language Models Benchmark Themselves?
di: Bao, Han, et al.
Pubblicazione: (2024)

MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark
di: Chen, Dongping, et al.
Pubblicazione: (2024)

MedVH: Towards Systematic Evaluation of Hallucination for Large Vision Language Models in the Medical Context
di: Gu, Zishan, et al.
Pubblicazione: (2024)

Refer to Any Segmentation Mask Group With Vision-Language Prompts
di: Cao, Shengcao, et al.
Pubblicazione: (2025)

Toward Cognitive Supersensing in Multimodal Large Language Model
di: Li, Boyi, et al.
Pubblicazione: (2026)