Cover Image

SparseJEPA: Sparse Representation Learning of Joint Embedding Predictive Architectures

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hartman, Max, Varshney, Lav
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ACT-JEPA: Novel Joint-Embedding Predictive Architecture for Efficient Policy Representation Learning
by: Vujinovic, Aleksandar, et al.
Published: (2025)

Audio-JEPA: Joint-Embedding Predictive Architecture for Audio Representation Learning
by: Tuncay, Ludovic, et al.
Published: (2025)

T-JEPA: A Joint-Embedding Predictive Architecture for Trajectory Similarity Computation
by: Li, Lihuan, et al.
Published: (2024)

Var-JEPA: A Variational Formulation of the Joint-Embedding Predictive Architecture -- Bridging Predictive and Generative Self-Supervised Learning
by: Gögl, Moritz, et al.
Published: (2026)

US-JEPA: A Joint Embedding Predictive Architecture for Medical Ultrasound
by: Radhachandran, Ashwath, et al.
Published: (2026)

Online Reinforcement Learning with Passive Memory
by: Pattanaik, Anay, et al.
Published: (2024)

UR-JEPA: Uniform Rectifiability as a Regularizer for Joint-Embedding Predictive Architectures
by: Le, Triet M.
Published: (2026)

M3-JEPA: Multimodal Alignment via Multi-gate MoE based on the Joint-Embedding Predictive Architecture
by: Lei, Hongyang, et al.
Published: (2024)

Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
by: Kuang, Yilun, et al.
Published: (2026)

DMT-JEPA: Discriminative Masked Targets for Joint-Embedding Predictive Architecture
by: Mo, Shentong, et al.
Published: (2024)

A Meta-Learning Perspective on Transformers for Causal Language Modeling
by: Wu, Xinbo, et al.
Published: (2023)

Learning General Representation of 12-Lead Electrocardiogram with a Joint-Embedding Predictive Architecture
by: Kim, Sehun
Published: (2024)

Unified Sparse-Matrix Representations for Diverse Neural Architectures
by: Zhu, Yuzhou
Published: (2025)

Label-Efficient Grasp Joint Prediction with Point-JEPA
by: Guzelkabaagac, Jed, et al.
Published: (2025)

Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models
by: Hartman, Max, et al.
Published: (2025)

Compute-Update Federated Learning: A Lattice Coding Approach Over-the-Air
by: Azimi-Abarghouyi, Seyed Mohammad, et al.
Published: (2024)

Beyond Pooling: Matching for Robust Generalization under Data Heterogeneity
by: Roy, Ayush, et al.
Published: (2026)

Efficient Model-Agnostic Multi-Group Equivariant Networks
by: Baltaji, Razan, et al.
Published: (2023)

Are Sparse Autoencoders Useful? A Case Study in Sparse Probing
by: Kantamneni, Subhash, et al.
Published: (2025)

CGM-JEPA: Learning Consistent Continuous Glucose Monitor Representations via Predictive Self-Supervised Pretraining
by: Muhammad, Hada Melino, et al.
Published: (2026)

BiJEPA: Bi-directional Joint Embedding Predictive Architecture for Symmetric Representation Learning
by: Huang, Yongchao
Published: (2026)

Investigating Design Choices in Joint-Embedding Predictive Architectures for General Audio Representation Learning
by: Riou, Alain, et al.
Published: (2024)

Clin-JEPA: A Multi-Phase Co-Training Framework for Joint-Embedding Predictive Pretraining on EHR Patient Trajectories
by: Yang, Yixuan, et al.
Published: (2026)

Unlearning via Sparse Representations
by: Shah, Vedant, et al.
Published: (2023)

Intrinsic-Energy Joint Embedding Predictive Architectures Induce Quasimetric Spaces
by: Kobanda, Anthony, et al.
Published: (2026)

Sparse-by-Design Cross-Modality Prediction: L0-Gated Representations for Reliable and Efficient Learning
by: Cenacchi, Filippo
Published: (2026)

Soft Clustering Anchors for Self-Supervised Speech Representation Learning in Joint Embedding Prediction Architectures
by: Ioannides, Georgios, et al.
Published: (2026)

Why and How Auxiliary Tasks Improve JEPA Representations
by: Yu, Jiacan, et al.
Published: (2025)

Koopman Invariants as Drivers of Emergent Time-Series Clustering in Joint-Embedding Predictive Architectures
by: Ruiz-Morales, Pablo, et al.
Published: (2025)

Representation Without Reward: A JEPA Audit for LLM Fine-Tuning
by: Sengupta, Biswa
Published: (2026)

Interpretable Embeddings with Sparse Autoencoders: A Data Analysis Toolkit
by: Jiang, Nick, et al.
Published: (2025)

LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels
by: Maes, Lucas, et al.
Published: (2026)

BERT-JEPA: Reorganizing CLS Embeddings for Language-Invariant Semantics
by: Gillin, Taj, et al.
Published: (2026)

T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings
by: Deiseroth, Björn, et al.
Published: (2024)

The Sparse Tsetlin Machine: Sparse Representation with Active Literals
by: Østby, Sebastian, et al.
Published: (2024)

Joint Distribution-Informed Shapley Values for Sparse Counterfactual Explanations
by: You, Lei, et al.
Published: (2024)

Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging
by: Zimmer, Max, et al.
Published: (2023)

Incorporating Hierarchical Semantics in Sparse Autoencoder Architectures
by: Muchane, Mark, et al.
Published: (2025)

Dynamic Sparse Attention: Access Patterns and Architecture
by: Levy, Noam
Published: (2026)

SparseSwaps: Tractable LLM Pruning Mask Refinement at Scale
by: Zimmer, Max, et al.
Published: (2025)