Cover Image

Masked Generative Priors Improve World Models Sequence Modelling Capabilities

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Meo, Cristian, Lica, Mircea, Ikram, Zarif, Nakano, Akihiro, Shah, Vedant, Didolkar, Aniket Rajiv, Liu, Dianbo, Goyal, Anirudh, Dauwels, Justin
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Object-Centric Temporal Consistency via Conditional Autoregressive Inductive Biases
by: Meo, Cristian, et al.
Published: (2024)

Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates
by: Meo, Cristian, et al.
Published: (2024)

$α$-TCVAE: On the relationship between Disentanglement and Diversity
by: Meo, Cristian, et al.
Published: (2024)

Extreme Precipitation Nowcasting using Transformer-based Generative Models
by: Meo, Cristian, et al.
Published: (2024)

Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors
by: Didolkar, Aniket, et al.
Published: (2025)

EfficientTDMPC: Improved MPC Objectives for Sample-Efficient Continuous Control
by: Evers, Thomas, et al.
Published: (2026)

Evolution Guided Generative Flow Networks
by: Ikram, Zarif, et al.
Published: (2024)

Evaluation of Vision-LLMs in Surveillance Video
by: Benschop, Pascal, et al.
Published: (2025)

JEDI: Joint Embedding Diffusion World Model for Online Model-Based Reinforcement Learning
by: Lim, Jing Yu, et al.
Published: (2026)

Absurd World: A Simple Yet Powerful Method to Absurdify the Real-world for Probing LLM Reasoning Capabilities
by: Albright, Ryan, et al.
Published: (2026)

Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs
by: Guo, Siyuan, et al.
Published: (2024)

Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving
by: Didolkar, Aniket, et al.
Published: (2024)

Zero-Shot Object-Centric Representation Learning
by: Didolkar, Aniket, et al.
Published: (2024)

Performance Asymmetry in Model-Based Reinforcement Learning
by: Lim, Jing Yu, et al.
Published: (2025)

Auto-Discovery-Bench: Diagnosing Structured State Tracking in Oracle-Guided Discovery
by: Chen, Tingting, et al.
Published: (2025)

Precipitation Nowcasting Using Physics Informed Discriminator Generative Models
by: Yin, Junzhe, et al.
Published: (2024)

BlockGPT: Spatio-Temporal Modelling of Rainfall via Frame-Level Autoregression
by: Meo, Cristian, et al.
Published: (2025)

Physical Reasoning and Object Planning for Household Embodied Agents
by: Agrawal, Ayush, et al.
Published: (2023)

Discrete Messages Improve Communication Efficiency among Isolated Intelligent Agents
by: Chen, Hang, et al.
Published: (2023)

Compositional Scene Understanding through Inverse Generative Modeling
by: Wang, Yanbo, et al.
Published: (2025)

Rethinking Thinking Tokens: LLMs as Improvement Operators
by: Madaan, Lovish, et al.
Published: (2025)

Improving Sparse Memory Finetuning
by: Goyal, Satyam, et al.
Published: (2026)

Assessing the Geographic Generalization and Physical Consistency of Generative Models for Climate Downscaling
by: Saccardi, Carlo, et al.
Published: (2025)

MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learning
by: Lică, Mircea, et al.
Published: (2024)

Analysing the Masked predictive coding training criterion for pre-training a Speech Representation Model
by: Yadav, Hemant, et al.
Published: (2023)

PEM: Perception Error Model for Virtual Testing of Autonomous Vehicles
by: Piazzoni, Andrea, et al.
Published: (2023)

CodeGolf Bench: A Multi-Language Benchmark for Evaluating Concise Code Generation Capabilities of Large Language Models
by: Padwal, Vedant
Published: (2026)

Slot-VAE: Object-Centric Scene Generation with Slot Attention
by: Wang, Yanbo, et al.
Published: (2023)

Bio-Inspired Artificial Neural Networks based on Predictive Coding
by: Casnici, Davide, et al.
Published: (2025)

MS-HuBERT: Mitigating Pre-training and Inference Mismatch in Masked Language Modelling methods for learning Speech Representations
by: Yadav, Hemant, et al.
Published: (2024)

When Object-Centric World Models Meet Policy Learning: From Pixels to Policies, and Where It Breaks
by: Ferraro, Stefano, et al.
Published: (2025)

Assessing Situational and Spatial Awareness of VLMs with Synthetically Generated Video
by: Benschop, Pascal, et al.
Published: (2026)

ROSER: Few-Shot Robotic Sequence Retrieval for Scalable Robot Learning
by: Rahman, Zillur, et al.
Published: (2026)

Unlearning via Sparse Representations
by: Shah, Vedant, et al.
Published: (2023)

Mamba Sequence Modeling meets Model Predictive Control
by: Cevaal, Michiel, et al.
Published: (2026)

CTRL-O: Language-Controllable Object-Centric Visual Representation Learning
by: Didolkar, Aniket, et al.
Published: (2025)

Sparse Memory Finetuning as a Low-Forgetting Alternative to LoRA and Full Finetuning
by: Gupta, Prakhar, et al.
Published: (2026)

Accelerated Predictive Coding Networks via Direct Kolen-Pollack Feedback Alignment
by: Casnici, Davide, et al.
Published: (2026)

Partition Generative Modeling: Masked Modeling Without Masks
by: Deschenaux, Justin, et al.
Published: (2025)

RAGnaroX: A Secure, Local-Hosted ChatOps Assistant Using Small Language Models
by: Dornauer, Benedikt, et al.
Published: (2026)