Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
Fuente:
arXiv
Guardado en:
| Autores principales: | Yang, Chenyu, Zhu, Xizhou, Zhu, Jinguo, Su, Weijie, Wang, Junjie, Dong, Xuan, Wang, Wenhai, Lu, Lewei, Li, Bin, Zhou, Jie, Qiao, Yu, Dai, Jifeng |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models
por: Yang, Chenyu, et al.
Publicado: (2024)
por: Yang, Chenyu, et al.
Publicado: (2024)
CoMemo: LVLMs Need Image Context with Image Memory
por: Liu, Shi, et al.
Publicado: (2025)
por: Liu, Shi, et al.
Publicado: (2025)
MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
por: Tian, Changyao, et al.
Publicado: (2024)
por: Tian, Changyao, et al.
Publicado: (2024)
HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding
por: Tao, Chenxin, et al.
Publicado: (2024)
por: Tao, Chenxin, et al.
Publicado: (2024)
ZeroGUI: Automating Online GUI Learning at Zero Human Cost
por: Yang, Chenyu, et al.
Publicado: (2025)
por: Yang, Chenyu, et al.
Publicado: (2025)
SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Folding
por: Li, Hao, et al.
Publicado: (2024)
por: Li, Hao, et al.
Publicado: (2024)
Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization
por: Wang, Weiyun, et al.
Publicado: (2024)
por: Wang, Weiyun, et al.
Publicado: (2024)
NaViL: Rethinking Scaling Properties of Native Multimodal Large Language Models under Data Constraints
por: Tian, Changyao, et al.
Publicado: (2025)
por: Tian, Changyao, et al.
Publicado: (2025)
Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures
por: Duan, Yuchen, et al.
Publicado: (2024)
por: Duan, Yuchen, et al.
Publicado: (2024)
Demystify Transformers & Convolutions in Modern Image Deep Networks
por: Hu, Xiaowei, et al.
Publicado: (2022)
por: Hu, Xiaowei, et al.
Publicado: (2022)
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
por: Chen, Zhe, et al.
Publicado: (2023)
por: Chen, Zhe, et al.
Publicado: (2023)
V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
por: Ge, Junqi, et al.
Publicado: (2024)
por: Ge, Junqi, et al.
Publicado: (2024)
VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models
por: Xu, Weiye, et al.
Publicado: (2025)
por: Xu, Weiye, et al.
Publicado: (2025)
Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applications
por: Xiong, Yuwen, et al.
Publicado: (2024)
por: Xiong, Yuwen, et al.
Publicado: (2024)
Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
por: Luo, Gen, et al.
Publicado: (2024)
por: Luo, Gen, et al.
Publicado: (2024)
Parameter-Inverted Image Pyramid Networks
por: Zhu, Xizhou, et al.
Publicado: (2024)
por: Zhu, Xizhou, et al.
Publicado: (2024)
VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks
por: Wu, Jiannan, et al.
Publicado: (2024)
por: Wu, Jiannan, et al.
Publicado: (2024)
Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performance
por: Gao, Zhangwei, et al.
Publicado: (2024)
por: Gao, Zhangwei, et al.
Publicado: (2024)
VisualPRM: An Effective Process Reward Model for Multimodal Reasoning
por: Wang, Weiyun, et al.
Publicado: (2025)
por: Wang, Weiyun, et al.
Publicado: (2025)
Learning 1D Causal Visual Representation with De-focus Attention Networks
por: Tao, Chenxin, et al.
Publicado: (2024)
por: Tao, Chenxin, et al.
Publicado: (2024)
DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
por: Cui, Erfei, et al.
Publicado: (2023)
por: Cui, Erfei, et al.
Publicado: (2023)
Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
por: Li, Hao, et al.
Publicado: (2023)
por: Li, Hao, et al.
Publicado: (2023)
The All-Seeing Project V2: Towards General Relation Comprehension of the Open World
por: Wang, Weiyun, et al.
Publicado: (2024)
por: Wang, Weiyun, et al.
Publicado: (2024)
MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity
por: Liu, Yangzhou, et al.
Publicado: (2024)
por: Liu, Yangzhou, et al.
Publicado: (2024)
Scaling Speech-Text Pre-training with Synthetic Interleaved Data
por: Zeng, Aohan, et al.
Publicado: (2024)
por: Zeng, Aohan, et al.
Publicado: (2024)
Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understanding
por: Wang, Zhaokai, et al.
Publicado: (2025)
por: Wang, Zhaokai, et al.
Publicado: (2025)
OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
por: Li, Qingyun, et al.
Publicado: (2024)
por: Li, Qingyun, et al.
Publicado: (2024)
GenExam: A Multidisciplinary Text-to-Image Exam
por: Wang, Zhaokai, et al.
Publicado: (2025)
por: Wang, Zhaokai, et al.
Publicado: (2025)
ADDP: Learning General Representations for Image Recognition and Generation with Alternating Denoising Diffusion Process
por: Tian, Changyao, et al.
Publicado: (2023)
por: Tian, Changyao, et al.
Publicado: (2023)
MiroFlow: Towards High-Performance and Robust Open-Source Agent Framework for General Deep Research Tasks
por: Su, Shiqian, et al.
Publicado: (2026)
por: Su, Shiqian, et al.
Publicado: (2026)
Global Context Compression with Interleaved Vision-Text Transformation
por: Jiao, Dian, et al.
Publicado: (2026)
por: Jiao, Dian, et al.
Publicado: (2026)
Mono-InternVL-1.5: Towards Cheaper and Faster Monolithic Multimodal Large Language Models
por: Luo, Gen, et al.
Publicado: (2025)
por: Luo, Gen, et al.
Publicado: (2025)
VEGA: Learning Interleaved Image-Text Comprehension in Vision-Language Large Models
por: Zhou, Chenyu, et al.
Publicado: (2024)
por: Zhou, Chenyu, et al.
Publicado: (2024)
VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Models
por: Yin, Ziyi, et al.
Publicado: (2023)
por: Yin, Ziyi, et al.
Publicado: (2023)
Needle In A Multimodal Haystack
por: Wang, Weiyun, et al.
Publicado: (2024)
por: Wang, Weiyun, et al.
Publicado: (2024)
Split Adaptation for Pre-trained Vision Transformers
por: Wang, Lixu, et al.
Publicado: (2025)
por: Wang, Lixu, et al.
Publicado: (2025)
Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space
por: Chen, Chao, et al.
Publicado: (2025)
por: Chen, Chao, et al.
Publicado: (2025)
MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
por: Meng, Fanqing, et al.
Publicado: (2024)
por: Meng, Fanqing, et al.
Publicado: (2024)
Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy
por: Hou, Zhi, et al.
Publicado: (2025)
por: Hou, Zhi, et al.
Publicado: (2025)
Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces
por: Luo, Gen, et al.
Publicado: (2025)
por: Luo, Gen, et al.
Publicado: (2025)
Ejemplares similares
-
PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models
por: Yang, Chenyu, et al.
Publicado: (2024) -
CoMemo: LVLMs Need Image Context with Image Memory
por: Liu, Shi, et al.
Publicado: (2025) -
MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
por: Tian, Changyao, et al.
Publicado: (2024) -
HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding
por: Tao, Chenxin, et al.
Publicado: (2024) -
ZeroGUI: Automating Online GUI Learning at Zero Human Cost
por: Yang, Chenyu, et al.
Publicado: (2025)