InterroGate: Learning to Share, Specialize, and Prune Representations for Multi-task Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bejnordi, Babak Ehteshami, Kumar, Gaurav, Royer, Amelie, Louizos, Christos, Blankevoort, Tijmen, Ghafoorian, Mohsen
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding
by: Bergner, Benjamin, et al.
Published: (2024)

Dirichlet-Prior Shaping: Guiding Expert Specialization in Upcycled MoEs
by: Mirvakhabova, Leyla, et al.
Published: (2025)

KaVa: Latent Reasoning via Compressed KV-Cache Distillation
by: Kuzina, Anna, et al.
Published: (2025)

Pruning vs Quantization: Which is Better?
by: Kuzmin, Andrey, et al.
Published: (2023)

A Mutual Information Perspective on Federated Contrastive Learning
by: Louizos, Christos, et al.
Published: (2024)

On Sampling Strategies for Spectral Model Sharding
by: Korzhenkov, Denis, et al.
Published: (2024)

Variational Learning ISTA
by: Massoli, Fabio Valerio, et al.
Published: (2024)

Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design
by: Cai, Ruisi, et al.
Published: (2024)

Guarding the Meaning: Self-Supervised Training for Semantic Robustness in Guard Models
by: Pinneri, Cristina, et al.
Published: (2025)

Non-exchangeable Conformal Prediction with Optimal Transport: Tackling Distribution Shifts with Unlabeled Data
by: Correia, Alvaro H. C., et al.
Published: (2025)

A Probabilistic Approach to Pose Synchronization for Multi-Reference Alignment with Applications to MIMO Wireless Communication Systems
by: Romijnders, Rob, et al.
Published: (2025)

Interpretable Multi-task Learning with Shared Variable Embeddings
by: Żelaszczyk, Maciej, et al.
Published: (2024)

Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data
by: Morafah, Mahdi, et al.
Published: (2024)

FP8 Quantization: The Power of the Exponent
by: Kuzmin, Andrey, et al.
Published: (2022)

Mixture of Cache-Conditional Experts for Efficient Mobile Device Inference
by: Skliar, Andrii, et al.
Published: (2024)

Private PoEtry: Private In-Context Learning via Product of Experts
by: Romijnders, Rob, et al.
Published: (2026)

Leveraging Temporally Extended Behavior Sharing for Multi-task Reinforcement Learning
by: Lee, Gawon, et al.
Published: (2025)

On Adaptivity in Zeroth-Order Optimization
by: Dbouk, Hassan, et al.
Published: (2026)

FairBranch: Mitigating Bias Transfer in Fair Multi-task Learning
by: Roy, Arjun, et al.
Published: (2023)

Learning Shared Representations for Multi-Task Linear Bandits
by: Lin, Jiabin, et al.
Published: (2026)

Disentangling Representations through Multi-task Learning
by: Vafidis, Pantelis, et al.
Published: (2024)

Gated Ensemble of Spatio-temporal Mixture of Experts for Multi-task Learning in Ride-hailing System
by: Rahman, M. H., et al.
Published: (2020)

Approximating Full Conformal Prediction for Neural Network Regression with Gauss-Newton Influence
by: Tailor, Dharmesh, et al.
Published: (2025)

Multi-task Learning for Heterogeneous Data via Integrating Shared and Task-Specific Encodings
by: Sui, Yang, et al.
Published: (2025)

Representation Learning by Ranking across multiple tasks
by: Gu, Lifeng
Published: (2021)

The LLM Surgeon
by: van der Ouderaa, Tycho F. A., et al.
Published: (2023)

Shared-unique Features and Task-aware Prioritized Sampling on Multi-task Reinforcement Learning
by: Lin, Po-Shao, et al.
Published: (2024)

Protect Your Score: Contact Tracing With Differential Privacy Guarantees
by: Romijnders, Rob, et al.
Published: (2023)

Multi-task Representation Learning for Mixed Integer Linear Programming
by: Cai, Junyang, et al.
Published: (2024)

Masks Can Be Distracting: On Context Comprehension in Diffusion Language Models
by: Piskorz, Julianna, et al.
Published: (2025)

Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features
by: Behnia, Tina, et al.
Published: (2024)

Regret Analysis of Multi-task Representation Learning for Linear-Quadratic Adaptive Control
by: Lee, Bruce D., et al.
Published: (2024)

An Information Theoretic Perspective on Conformal Prediction
by: Correia, Alvaro H. C., et al.
Published: (2024)

Linear Causal Representation Learning by Topological Ordering, Pruning, and Disentanglement
by: Chen, Hao, et al.
Published: (2025)

DNA: Differentially private Neural Augmentation for contact tracing
by: Romijnders, Rob, et al.
Published: (2024)

Monotonic Transformation Invariant Multi-task Learning
by: Murthy, Surya, et al.
Published: (2025)

Advancing Robust Underwater Acoustic Target Recognition through Multi-task Learning and Multi-Gate Mixture-of-Experts
by: Xie, Yuan, et al.
Published: (2024)

Learn to Change the World: Multi-level Reinforcement Learning with Model-Changing Actions
by: Lu, Ziqing, et al.
Published: (2025)

Learning with Shared Representations: Statistical Rates and Efficient Algorithms
by: Niu, Xiaochun, et al.
Published: (2024)

Distributed Networked Multi-task Learning
by: Hong, Lingzhou, et al.
Published: (2024)