Imagen de Portada

Transformers as Unrolled Inference in Probabilistic Laplacian Eigenmaps: An Interpretation and Potential Improvements

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ravuri, Aditya, Lawrence, Neil D.
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE
por: Ravuri, Aditya, et al.
Publicado: (2024)

Protein Language Model Zero-Shot Fitness Predictions are Improved by Inference-only Dropout
por: Ravuri, Aditya, et al.
Publicado: (2025)

Scalable Amortized GPLVMs for Single Cell Transcriptomics Data
por: Zhao, Sarah, et al.
Publicado: (2024)

Hypergraph Laplacian Eigenmaps and Face Recognition Problems
por: Tran, Loc Hoang
Publicado: (2024)

Nonsmooth Nonparametric Regression via Fractional Laplacian Eigenmaps
por: Shi, Zhaoyang, et al.
Publicado: (2024)

A kernel-based analysis of Laplacian Eigenmaps
por: Wahl, Martin
Publicado: (2024)

A Constrained Optimization Perspective of Unrolled Transformers
por: Porras-Valenzuela, Javier, et al.
Publicado: (2026)

Lightweight and Interpretable Transformer via Mixed Graph Algorithm Unrolling for Traffic Forecast
por: Qi, Ji, et al.
Publicado: (2025)

Attention-Only Transformers via Unrolled Subspace Denoising
por: Wang, Peng, et al.
Publicado: (2025)

Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness Priors
por: Do, Tam Thuc, et al.
Publicado: (2024)

Joint Data Inpainting and Graph Learning via Unrolled Neural Networks
por: Batreddy, Subbareddy, et al.
Publicado: (2024)

Efficient Autoregressive Inference for Transformer Probabilistic Models
por: Hassan, Conor, et al.
Publicado: (2025)

On Feature Learning for Titi Monkey Activity Detection
por: Ravuri, Aditya, et al.
Publicado: (2024)

Entropic Optimal Transport Eigenmaps for Nonlinear Alignment and Joint Embedding of High-Dimensional Datasets
por: Landa, Boris, et al.
Publicado: (2024)

Multi-Omics Analysis for Cancer Subtype Inference via Unrolling Graph Smoothness Priors
por: Lu, Jielong, et al.
Publicado: (2025)

Lightweight Transformer for EEG Classification via Balanced Signed Graph Algorithm Unrolling
por: Yao, Junyi, et al.
Publicado: (2025)

Understanding the Curse of Unrolling
por: Mehmood, Sheheryar, et al.
Publicado: (2026)

Auto-Unrolled Proximal Gradient Descent: An AutoML Approach to Interpretable Waveform Optimization
por: Kaplan, Ahmet
Publicado: (2026)

Unrolled Neural Networks for Constrained Optimization
por: Hadou, Samar, et al.
Publicado: (2026)

Stochastic Unrolled Federated Learning
por: Hadou, Samar, et al.
Publicado: (2023)

Unrolled Graph Neural Networks for Constrained Optimization
por: Hadou, Samar, et al.
Publicado: (2025)

Transformer-like Inference from Optimal Control
por: Kudre, Aditya, et al.
Publicado: (2026)

Robust Stochastically-Descending Unrolled Networks
por: Hadou, Samar, et al.
Publicado: (2023)

Training Data Attribution via Approximate Unrolled Differentiation
por: Bae, Juhan, et al.
Publicado: (2024)

Probabilistic Shapley Value Modeling and Inference
por: Ketenci, Mert, et al.
Publicado: (2024)

On Hardware-efficient Inference in Probabilistic Circuits
por: Yao, Lingyun, et al.
Publicado: (2024)

Probabilistic Scoring Lists for Interpretable Machine Learning
por: Hanselle, Jonas, et al.
Publicado: (2024)

Supra-Laplacian Encoding for Transformer on Dynamic Graphs
por: Karmim, Yannis, et al.
Publicado: (2024)

Clustering Inductive Biases with Unrolled Networks
por: Huml, Jonathan, et al.
Publicado: (2023)

Analyzing and Enhancing the Backward-Pass Convergence of Unrolled Optimization
por: Kotary, James, et al.
Publicado: (2023)

Amortized Probabilistic Conditioning for Optimization, Simulation and Inference
por: Chang, Paul E., et al.
Publicado: (2024)

Probabilistic Modelling is Sufficient for Causal Inference
por: Mlodozeniec, Bruno, et al.
Publicado: (2025)

Revisiting Deep AC-OPF
por: Dada, Oluwatomisin I., et al.
Publicado: (2025)

Laplacian Heads Improve Transformers by Smoothing Token Representations
por: Zhang, Yuchong, et al.
Publicado: (2026)

Improving Equivariant Networks with Probabilistic Symmetry Breaking
por: Lawrence, Hannah, et al.
Publicado: (2025)

Cost Function Unrolling in Unsupervised Optical Flow
por: Lifshitz, Gal, et al.
Publicado: (2020)

STOAT: Spatial-Temporal Probabilistic Causal Inference Network
por: Yang, Yang, et al.
Publicado: (2025)

Discrete Probabilistic Inference as Control in Multi-path Environments
por: Deleu, Tristan, et al.
Publicado: (2024)

Attention-Refined Unrolling for Sparse Sequential micro-Doppler Reconstruction
por: Mazzieri, Riccardo, et al.
Publicado: (2023)

Differentiability in Unrolled Training of Neural Physics Simulators on Transient Dynamics
por: List, Bjoern, et al.
Publicado: (2024)