Cover Image

Transformers as Unrolled Inference in Probabilistic Laplacian Eigenmaps: An Interpretation and Potential Improvements

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ravuri, Aditya, Lawrence, Neil D.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE
by: Ravuri, Aditya, et al.
Published: (2024)

Protein Language Model Zero-Shot Fitness Predictions are Improved by Inference-only Dropout
by: Ravuri, Aditya, et al.
Published: (2025)

Scalable Amortized GPLVMs for Single Cell Transcriptomics Data
by: Zhao, Sarah, et al.
Published: (2024)

Hypergraph Laplacian Eigenmaps and Face Recognition Problems
by: Tran, Loc Hoang
Published: (2024)

Nonsmooth Nonparametric Regression via Fractional Laplacian Eigenmaps
by: Shi, Zhaoyang, et al.
Published: (2024)

A kernel-based analysis of Laplacian Eigenmaps
by: Wahl, Martin
Published: (2024)

A Constrained Optimization Perspective of Unrolled Transformers
by: Porras-Valenzuela, Javier, et al.
Published: (2026)

Lightweight and Interpretable Transformer via Mixed Graph Algorithm Unrolling for Traffic Forecast
by: Qi, Ji, et al.
Published: (2025)

Attention-Only Transformers via Unrolled Subspace Denoising
by: Wang, Peng, et al.
Published: (2025)

Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness Priors
by: Do, Tam Thuc, et al.
Published: (2024)

Joint Data Inpainting and Graph Learning via Unrolled Neural Networks
by: Batreddy, Subbareddy, et al.
Published: (2024)

Efficient Autoregressive Inference for Transformer Probabilistic Models
by: Hassan, Conor, et al.
Published: (2025)

On Feature Learning for Titi Monkey Activity Detection
by: Ravuri, Aditya, et al.
Published: (2024)

Entropic Optimal Transport Eigenmaps for Nonlinear Alignment and Joint Embedding of High-Dimensional Datasets
by: Landa, Boris, et al.
Published: (2024)

Multi-Omics Analysis for Cancer Subtype Inference via Unrolling Graph Smoothness Priors
by: Lu, Jielong, et al.
Published: (2025)

Lightweight Transformer for EEG Classification via Balanced Signed Graph Algorithm Unrolling
by: Yao, Junyi, et al.
Published: (2025)

Understanding the Curse of Unrolling
by: Mehmood, Sheheryar, et al.
Published: (2026)

Auto-Unrolled Proximal Gradient Descent: An AutoML Approach to Interpretable Waveform Optimization
by: Kaplan, Ahmet
Published: (2026)

Unrolled Neural Networks for Constrained Optimization
by: Hadou, Samar, et al.
Published: (2026)

Stochastic Unrolled Federated Learning
by: Hadou, Samar, et al.
Published: (2023)

Unrolled Graph Neural Networks for Constrained Optimization
by: Hadou, Samar, et al.
Published: (2025)

Transformer-like Inference from Optimal Control
by: Kudre, Aditya, et al.
Published: (2026)

Robust Stochastically-Descending Unrolled Networks
by: Hadou, Samar, et al.
Published: (2023)

Training Data Attribution via Approximate Unrolled Differentiation
by: Bae, Juhan, et al.
Published: (2024)

Probabilistic Shapley Value Modeling and Inference
by: Ketenci, Mert, et al.
Published: (2024)

On Hardware-efficient Inference in Probabilistic Circuits
by: Yao, Lingyun, et al.
Published: (2024)

Probabilistic Scoring Lists for Interpretable Machine Learning
by: Hanselle, Jonas, et al.
Published: (2024)

Supra-Laplacian Encoding for Transformer on Dynamic Graphs
by: Karmim, Yannis, et al.
Published: (2024)

Clustering Inductive Biases with Unrolled Networks
by: Huml, Jonathan, et al.
Published: (2023)

Analyzing and Enhancing the Backward-Pass Convergence of Unrolled Optimization
by: Kotary, James, et al.
Published: (2023)

Amortized Probabilistic Conditioning for Optimization, Simulation and Inference
by: Chang, Paul E., et al.
Published: (2024)

Probabilistic Modelling is Sufficient for Causal Inference
by: Mlodozeniec, Bruno, et al.
Published: (2025)

Revisiting Deep AC-OPF
by: Dada, Oluwatomisin I., et al.
Published: (2025)

Laplacian Heads Improve Transformers by Smoothing Token Representations
by: Zhang, Yuchong, et al.
Published: (2026)

Improving Equivariant Networks with Probabilistic Symmetry Breaking
by: Lawrence, Hannah, et al.
Published: (2025)

Cost Function Unrolling in Unsupervised Optical Flow
by: Lifshitz, Gal, et al.
Published: (2020)

STOAT: Spatial-Temporal Probabilistic Causal Inference Network
by: Yang, Yang, et al.
Published: (2025)

Discrete Probabilistic Inference as Control in Multi-path Environments
by: Deleu, Tristan, et al.
Published: (2024)

Attention-Refined Unrolling for Sparse Sequential micro-Doppler Reconstruction
by: Mazzieri, Riccardo, et al.
Published: (2023)

Differentiability in Unrolled Training of Neural Physics Simulators on Transient Dynamics
by: List, Bjoern, et al.
Published: (2024)