Cover Image

Multimodal Autoregressive Pre-training of Large Vision Encoders

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fini, Enrico, Shukor, Mustafa, Li, Xiujun, Dufter, Philipp, Klein, Michal, Haldimann, David, Aitharaju, Sai, da Costa, Victor Guilherme Turrisi, Béthune, Louis, Gan, Zhe, Toshev, Alexander T, Eichner, Marcin, Nabi, Moin, Yang, Yinfei, Susskind, Joshua M., El-Nouby, Alaaeldin
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scaling Laws for Native Multimodal Models
by: Shukor, Mustafa, et al.
Published: (2025)

Scaling Laws for Optimal Data Mixtures
by: Shukor, Mustafa, et al.
Published: (2025)

Scalable Pre-training of Large Autoregressive Image Models
by: El-Nouby, Alaaeldin, et al.
Published: (2024)

Contrastive Perplexity for Controlled Generation: An Application in Detoxifying Large Language Models
by: Klein, Tassilo, et al.
Published: (2024)

Learning Private Representations through Entropy-based Adversarial Training
by: Klein, Tassilo, et al.
Published: (2025)

Chain-of-Sketch: Enabling Global Visual Reasoning
by: Lotfi, Aryo, et al.
Published: (2024)

FlexTok: Resampling Images into 1D Token Sequences of Flexible Length
by: Bachmann, Roman, et al.
Published: (2025)

Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
by: Shukor, Mustafa, et al.
Published: (2024)

Skipping Computations in Multimodal LLMs
by: Shukor, Mustafa, et al.
Published: (2024)

Contrastive Localized Language-Image Pre-Training
by: Chen, Hong-You, et al.
Published: (2024)

MINTAQA IQTISODIYOTINI BARQAROR RIVOJLANTIRISHDA TURIZM SAMARADORLIGINI OSHIRISHNING XORIJIY TAJRIBALARINING AHAMIYATI
by: Nurbek Toshev
Published: (2025)

Scaling Categorical Flow Maps
by: Davis, Oscar, et al.
Published: (2026)

The ePIC Silicon Vertex Tracker: Design and Status
by: Turrisi, R.
Published: (2026)

Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
by: Abnar, Samira, et al.
Published: (2025)

Improved Baselines for Data-efficient Perceptual Augmentation of LLMs
by: Vallaeys, Théophane, et al.
Published: (2024)

Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context Learning
by: Shukor, Mustafa, et al.
Published: (2023)

Architectural Prerequisites for AI Adoption in Institutions and Enterprises
by: Eichner, Rika
Published: (2026)

The Dual Shift: AI Agents intersect with Web3 - Sector Perspective: Governments and Supranational Entities – Re-Architecture for Power Dynamics
by: Eichner, Rika
Published: (2025)

Jarhead : violencia interrumpida / Diana Eichner
by: Eichner, Diana
Published: (2006)

Hombre peligroso, armado hasta los dientes / Diana Eichner
by: Eichner, Diana
Published: (2006)

Mirando a través de la cerradura. Algunos momentos en la historia del cine documental / Diana Eichner
by: Eichner, Diana
Published: (2006)

El infierno globalizado de La pesadilla de Darwin / Diana Eichner
by: Eichner, Diana
Published: (2006)

Los años de censura de Hollywood / Diana Eichner
by: Eichner, Diana
Published: (1934)

Vecinos invasores : ¿Quién invade a quién? / Diana Eichner
by: Eichner, Diana
Published: (2006)

Documental : La verdad incómoda, que nos est matando / Diana Eichner
by: Eichner, Diana
Published: (2006)

Grizzly Man. El abrazo del oso / Diana Eichner
by: Eichner, Diana

Analysis of organic matter in surface sediment core BS960823.KTS_93
by: Eichner, Christiane
Published: (2006)

Analysis of organic matter in surface sediment core BS960823.KTS_96
by: Eichner, Christiane
Published: (2006)

Analysis of organic matter in surface sediment core BS960823.KTS_98
by: Eichner, Christiane
Published: (2006)

YOSHLARGA TA'SIR QILUVCHI G'OYAVIY-MAFKURAVIY TAHDIDLARNING YUZAGA KELISHI
by: Toshev, Suhrob Mirzaqulovich
Published: (2025)

Multivariate Conformal Prediction using Optimal Transport
by: Klein, Michal, et al.
Published: (2025)

World-consistent Video Diffusion with Explicit 3D Modeling
by: Zhang, Qihang, et al.
Published: (2024)

The Potential of CoT for Reasoning: A Closer Look at Trace Dynamics
by: Bachmann, Gregor, et al.
Published: (2026)

Thinking into the Future: Latent Lookahead Training for Transformers
by: Noci, Lorenzo, et al.
Published: (2026)

Der Einfluss des wahrgenommenen Alterns auf die Akzeptanz von Smart-Home-Technologien
by: Eichner, Falk Andreas
Published: (2024)

Analyzing Finetuning Representation Shift for Multimodal LLMs Steering
by: Khayatan, Pegah, et al.
Published: (2025)

A Concept-Based Explainability Framework for Large Multimodal Models
by: Parekh, Jayneel, et al.
Published: (2024)

MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs
by: Daxberger, Erik, et al.
Published: (2025)

LV.—Descriptions of new African Lepidoptera
by: Bethune-Baker, George Thomas
Published: (1909)

Descriptions of New Species of Lepidoptera from New Guinea
by: Bethune-Baker, George Thomas
Published: (1911)