Cover Image

SOTAlign: Semi-Supervised Alignment of Unimodal Vision and Language Models via Optimal Transport

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Roschmann, Simon, Krzakala, Paul, Mazelet, Sonia, Bouniot, Quentin, Akata, Zeynep
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers
by: Roschmann, Simon, et al.
Published: (2025)

Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
by: Pach, Mateusz, et al.
Published: (2025)

The Latent Color Subspace: Emergent Order in High-Dimensional Chaos
by: Pach, Mateusz, et al.
Published: (2026)

TimeSAE: Sparse Decoding for Faithful Explanations of Black-Box Time Series Models
by: Oublal, Khalid, et al.
Published: (2026)

From Alexnet to Transformers: Measuring the Non-linearity of Deep Neural Networks with Affine Optimal Transport
by: Bouniot, Quentin, et al.
Published: (2023)

Tailoring Mixup to Data for Calibration
by: Bouniot, Quentin, et al.
Published: (2023)

Dissecting Multimodal In-Context Learning: Modality Asymmetries and Circuit Dynamics in modern Transformers
by: Huang, Yiran, et al.
Published: (2026)

Discovering Chunks in Neural Embeddings for Interpretability
by: Wu, Shuchen, et al.
Published: (2025)

Unsupervised Learning for Optimal Transport plan prediction between unbalanced graphs
by: Mazelet, Sonia, et al.
Published: (2025)

Diamond Maps: Efficient Reward Alignment via Stochastic Flow Maps
by: Holderrieth, Peter, et al.
Published: (2026)

Improving Intervention Efficacy via Concept Realignment in Concept Bottleneck Models
by: Singhi, Nishad, et al.
Published: (2024)

Supervised Distributional Reduction via Optimal Transport and Dependence Maximization
by: Ramesh, Sai-Aakash, et al.
Published: (2026)

Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis
by: Mai, Sijie, et al.
Published: (2024)

COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training
by: Kim, Sanghwan, et al.
Published: (2024)

SUB: Benchmarking CBM Generalization via Synthetic Attribute Substitutions
by: Bader, Jessica, et al.
Published: (2025)

From Drop-off to Recovery: A Mechanistic Analysis of Segmentation in MLLMs
by: Wu, Boyong, et al.
Published: (2026)

Conflict-Aware Pseudo Labeling via Optimal Transport for Entity Alignment
by: Ding, Qijie, et al.
Published: (2022)

Hierarchical Multi-Marginal Optimal Transport for Network Alignment
by: Zeng, Zhichen, et al.
Published: (2023)

Inverse Entropic Optimal Transport Solves Semi-supervised Learning via Data Likelihood Maximization
by: Persiianov, Mikhail, et al.
Published: (2024)

Restyling Unsupervised Concept Based Interpretable Networks with Generative Models
by: Parekh, Jayneel, et al.
Published: (2024)

Unimodal Distributions for Ordinal Regression
by: Cardoso, Jaime S., et al.
Published: (2023)

Fast and Interpretable Protein Substructure Alignment via Optimal Transport
by: Wang, Zhiyu, et al.
Published: (2025)

Reference-Free Rating of LLM Responses via Latent Information
by: Girrbach, Leander, et al.
Published: (2025)

Robust Barycenter Estimation using Semi-Unbalanced Neural Optimal Transport
by: Gazdieva, Milena, et al.
Published: (2024)

Representational Alignment Across Model Layers and Brain Regions with Multi-Level Optimal Transport
by: Shah, Shaan, et al.
Published: (2025)

Building, Reusing, and Generalizing Abstract Representations from Concrete Sequences
by: Wu, Shuchen, et al.
Published: (2024)

Best-Arm Identification in Unimodal Bandits
by: Poiani, Riccardo, et al.
Published: (2024)

Causal Masking on Spatial Data: An Information-Theoretic Case for Learning Spatial Datasets with Unimodal Language Models
by: Junkin, Jared, et al.
Published: (2025)

Concept-Guided Interpretability via Neural Chunking
by: Wu, Shuchen, et al.
Published: (2025)

A Statistical Learning Perspective on Semi-dual Adversarial Neural Optimal Transport Solvers
by: Tarasov, Roman, et al.
Published: (2025)

Multiple Noises in Diffusion Model for Semi-Supervised Multi-Domain Translation
by: Mayet, Tsiry, et al.
Published: (2023)

Unified Vision-Language Modeling via Concept Space Alignment
by: Qiu, Yifu, et al.
Published: (2026)

Context-Adaptive Multi-Prompt Embedding with Large Language Models for Vision-Language Alignment
by: Kim, Dahun, et al.
Published: (2025)

Solving Prior Distribution Mismatch in Diffusion Models via Optimal Transport
by: Wang, Zhanpeng, et al.
Published: (2024)

Reliable Modeling of Distribution Shifts via Displacement-Reshaped Optimal Transport
by: Naumann, Philip, et al.
Published: (2026)

Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition
by: Huang, Chengxiang, et al.
Published: (2025)

Rebalanced Multimodal Learning with Data-aware Unimodal Sampling
by: Jiang, Qingyuan, et al.
Published: (2025)

Semi Supervised Heterogeneous Domain Adaptation via Disentanglement and Pseudo-Labelling
by: Dantas, Cassio F., et al.
Published: (2024)

Semi-Supervised Learning for Large Language Models Safety and Content Moderation
by: Dinuta, Eduard Stefan, et al.
Published: (2025)

Joint Optimal Transport and Embedding for Network Alignment
by: Yu, Qi, et al.
Published: (2025)