Cover Image

Combining Reconstruction and Contrastive Methods for Multimodal Representations in RL

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Becker, Philipp, Mossburger, Sebastian, Otto, Fabian, Neumann, Gerhard
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PointPatchRL -- Masked Reconstruction Improves Reinforcement Learning on Point Clouds
by: Gyenes, Balázs, et al.
Published: (2024)

Efficient Off-Policy Learning for High-Dimensional Action Spaces
by: Otto, Fabian, et al.
Published: (2024)

KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty
by: Becker, Philipp, et al.
Published: (2024)

TROLL: Trust Regions improve Reinforcement Learning for Large Language Models
by: Becker, Philipp, et al.
Published: (2025)

Geometry-aware RL for Manipulation of Varying Shapes and Deformable Objects
by: Hoang, Tai, et al.
Published: (2025)

MuTT: A Multimodal Trajectory Transformer for Robot Skills
by: Kienle, Claudius, et al.
Published: (2024)

Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationarity
by: Gospodinov, Emiliyan, et al.
Published: (2024)

Canonicalizing Multimodal Contrastive Representation Learning
by: Gupta, Sharut, et al.
Published: (2026)

Spectral Bellman Method: Unifying Representation and Exploration in RL
by: Nabati, Ofir, et al.
Published: (2025)

Open the Black Box: Step-based Policy Updates for Temporally-Correlated Episodic Reinforcement Learning
by: Li, Ge, et al.
Published: (2024)

Iterative Sizing Field Prediction for Adaptive Mesh Generation From Expert Demonstrations
by: Freymuth, Niklas, et al.
Published: (2024)

Improving Long-Range Interactions in Graph Neural Simulators via Hamiltonian Dynamics
by: Hoang, Tai, et al.
Published: (2025)

C3RL: Rethinking the Combination of Channel-independence and Channel-mixing from Representation Learning
by: Ma, Shusen, et al.
Published: (2025)

Orthogonalized Multimodal Contrastive Learning with Asymmetric Masking for Structured Representations
by: Cissee, Carolin, et al.
Published: (2026)

Task-Induced Representational Invariances Depend on Learning Objective in Deep RL
by: Halvagal, Manu Srinath, et al.
Published: (2026)

MaNGO - Adaptable Graph Network Simulators via Meta-Learning
by: Dahlinger, Philipp, et al.
Published: (2025)

Learning Robust Heterogeneous Graph Representations via Contrastive-Reconstruction under Sparse Semantics
by: Lin, Di, et al.
Published: (2025)

Multimodal Contrastive Representation Learning in Augmented Biomedical Knowledge Graphs
by: Dang, Tien, et al.
Published: (2025)

CFIRE: A General Method for Combining Local Explanations
by: Müller, Sebastian, et al.
Published: (2025)

Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneck
by: Shou, Yuntao, et al.
Published: (2024)

Score Combining for Contrastive OOD Detection
by: Reehorst, Edward T., et al.
Published: (2025)

Combining LLM decision and RL action selection to improve RL policy for adaptive interventions
by: Karine, Karine, et al.
Published: (2025)

Multimodal Physiological Signals Representation Learning via Multiscale Contrasting for Depression Recognition
by: Shao, Kai, et al.
Published: (2024)

Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Sampling
by: Blessing, Denis, et al.
Published: (2024)

Chunking the Critic: A Transformer-based Soft Actor-Critic with N-Step Returns
by: Tian, Dong, et al.
Published: (2025)

Continual Multimodal Contrastive Learning
by: Liu, Xiaohao, et al.
Published: (2025)

Decipher the Modality Gap in Multimodal Contrastive Learning: From Convergent Representations to Pairwise Alignment
by: Yi, Lingjie, et al.
Published: (2025)

Hadamard Representation: Scaffolding Performance Across Model-free RL
by: Kooi, Jacob E., et al.
Published: (2024)

Benchmarking Vision-Language Contrastive Methods for Medical Representation Learning
by: Roy, Shuvendu, et al.
Published: (2024)

Acquiring Diverse Skills using Curriculum Reinforcement Learning with Mixture of Experts
by: Celik, Onur, et al.
Published: (2024)

Contrastive Network Representation Learning
by: Dong, Zihan, et al.
Published: (2025)

Rainbow-DemoRL: Combining Improvements in Demonstration-Augmented Reinforcement Learning
by: Bhatt, Dwait, et al.
Published: (2026)

Multimodal Visual-Tactile Representation Learning through Self-Supervised Contrastive Pre-Training
by: Dave, Vedant, et al.
Published: (2024)

Guiding Diffusion-based Reconstruction with Contrastive Signals for Balanced Visual Representation
by: Han, Boyu, et al.
Published: (2026)

Rethinking RL Evaluation: Can Benchmarks Truly Reveal Failures of RL Methods?
by: Chen, Zihan, et al.
Published: (2025)

UrbanFusion: Stochastic Multimodal Fusion for Contrastive Learning of Robust Spatial Representations
by: Mühlematter, Dominik J., et al.
Published: (2025)

Meta-RL with Shared Representations Enables Fast Adaptation in Energy Systems
by: Zangato, Théo, et al.
Published: (2026)

Survival Reinforcement Learning: Toward Scalable Self-Supervised RL
by: Nguimatsia-Tiofack, Franki, et al.
Published: (2026)

Geometry of Uncertainty: Learning Metric Spaces for Multimodal State Estimation in RL
by: Reichlin, Alfredo, et al.
Published: (2026)

Contrastive Preference Learning: Learning from Human Feedback without RL
by: Hejna, Joey, et al.
Published: (2023)