Cover Image

Clustering by Attention: Leveraging Prior Fitted Transformers for Data Partitioning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shokry, Ahmed, Khalafallah, Ayman
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Leveraging Foundational Models and Simple Fusion for Multi-modal Physiological Signal Analysis
by: Ghallab, Youssef, et al.
Published: (2025)

Bayesian Neural Scaling Law Extrapolation with Prior-Data Fitted Networks
by: Lee, Dongwoo, et al.
Published: (2025)

Position: The Future of Bayesian Prediction Is Prior-Fitted
by: Müller, Samuel, et al.
Published: (2025)

MultiModalPFN: Extending Prior-Data Fitted Networks for Multimodal Tabular Learning
by: Kim, Wall, et al.
Published: (2026)

Leveraging Skills from Unlabeled Prior Data for Efficient Online Exploration
by: Wilcoxson, Max, et al.
Published: (2024)

Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs
by: Zhu, Kan, et al.
Published: (2025)

Uncertainty Quantification for Prior-Data Fitted Networks using Martingale Posteriors
by: Nagler, Thomas, et al.
Published: (2025)

B-TGAT: A Bi-directional Temporal Graph Attention Transformer for Clustering Multivariate Spatiotemporal Data
by: Nji, Francis Ndikum, et al.
Published: (2025)

Attention Mechanism, Max-Affine Partition, and Universal Approximation
by: Liu, Hude, et al.
Published: (2025)

EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks
by: Arbel, Michael, et al.
Published: (2025)

Redefining Data Pairing for Motion Retargeting Leveraging a Human Body Prior
by: Figuera, Xiyana, et al.
Published: (2024)

VSFormer: Value and Shape-Aware Transformer with Prior-Enhanced Self-Attention for Multivariate Time Series Classification
by: Xi, Wenjie, et al.
Published: (2024)

Gradient Inversion Transcript: Leveraging Robust Generative Priors to Reconstruct Training Data from Gradient Leakage
by: Chen, Xinping, et al.
Published: (2025)

Zero-shot Multivariate Time Series Forecasting Using Tabular Prior Fitted Networks
by: Jayawardhana, Mayuka, et al.
Published: (2026)

Multi-Layer Attention-Based Explainability via Transformers for Tabular Data
by: Gavito, Andrea Treviño, et al.
Published: (2023)

Cluster Attention for Graph Machine Learning
by: Platonov, Oleg, et al.
Published: (2026)

Attention Beyond Neighborhoods: Reviving Transformer for Graph Clustering
by: Xie, Xuanting, et al.
Published: (2025)

GEM-T: Generative Tabular Data via Fitting Moments
by: Li, Miao, et al.
Published: (2025)

Domain Knowledge is Power: Leveraging Physiological Priors for Self Supervised Representation Learning in Electrocardiography
by: Maghsoodi, Nooshin, et al.
Published: (2025)

The Bayesian Geometry of Transformer Attention
by: Agarwal, Naman, et al.
Published: (2025)

ZETA: Leveraging Z-order Curves for Efficient Top-k Attention
by: Zeng, Qiuhao, et al.
Published: (2025)

KD-GAT: Combining Knowledge Distillation and Graph Attention Transformer for a Controller Area Network Intrusion Detection System
by: Frenken, Robert, et al.
Published: (2025)

From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields
by: Kofinas, Miltiadis, et al.
Published: (2024)

Robustness is Important: Limitations of LLMs for Data Fitting
by: Liu, Hejia, et al.
Published: (2025)

Comparing Prior and Learned Time Representations in Transformer Models of Timeseries
by: Koliou, Natalia, et al.
Published: (2024)

Verifying Shortest Paths in Linear Time
by: Shokry, Ahmed, et al.
Published: (2024)

Transformers can do Bayesian Clustering
by: Bhaskaran, Prajit, et al.
Published: (2025)

Finding Clustering Algorithms in the Transformer Architecture
by: Clarkson, Kenneth L., et al.
Published: (2025)

XicorAttention: Time Series Transformer Using Attention with Nonlinear Correlation
by: Kimura, Daichi, et al.
Published: (2025)

Geometric Attention: A Regime-Explicit Operator Semantics for Transformer Attention
by: Freytes, Luis Rosario
Published: (2026)

Simulation Priors for Data-Efficient Deep Learning
by: Treven, Lenart, et al.
Published: (2025)

PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity
by: Kim, Kwanyoung, et al.
Published: (2025)

scASDC: Attention Enhanced Structural Deep Clustering for Single-cell RNA-seq Data
by: Min, Wenwen, et al.
Published: (2024)

Attention Schema-based Attention Control (ASAC): A Cognitive-Inspired Approach for Attention Management in Transformers
by: Saxena, Krati, et al.
Published: (2025)

Leveraging Manifold Embeddings for Enhanced Graph Transformer Representations and Learning
by: Jyothish, Ankit, et al.
Published: (2025)

GraphDiffMed: Knowledge-Constrained Differential Attention with Pharmacological Graph Priors for Medication Recommendation
by: Saxena, Krati, et al.
Published: (2026)

Unveiling and Controlling Anomalous Attention Distribution in Transformers
by: Yan, Ruiqing, et al.
Published: (2024)

Exact Attention Sensitivity and the Geometry of Transformer Stability
by: Emadi, Seyed Morteza
Published: (2026)

Graph Convolutions Enrich the Self-Attention in Transformers!
by: Choi, Jeongwhan, et al.
Published: (2023)

Higher-Order Transformers With Kronecker-Structured Attention
by: Omranpour, Soroush, et al.
Published: (2024)