From Tables to Signals: Revealing Spectral Adaptivity in TabPFN
Fuente:
arXiv
Saved in:
| Main Authors: | Zheng, Jianqiao, Gordon, Cameron, Ji, Yiping, Saratchandran, Hemanth, Lucey, Simon |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Rethinking Attention: Polynomial Alternatives to Softmax in Transformers
by: Saratchandran, Hemanth, et al.
Published: (2024)
by: Saratchandran, Hemanth, et al.
Published: (2024)
Efficient Learning With Sine-Activated Low-rank Matrices
by: Ji, Yiping, et al.
Published: (2024)
by: Ji, Yiping, et al.
Published: (2024)
Always Skip Attention
by: Ji, Yiping, et al.
Published: (2025)
by: Ji, Yiping, et al.
Published: (2025)
From Activation to Initialization: Scaling Insights for Optimizing Neural Fields
by: Saratchandran, Hemanth, et al.
Published: (2024)
by: Saratchandran, Hemanth, et al.
Published: (2024)
D'OH: Decoder-Only Random Hypernetworks for Implicit Neural Representations
by: Gordon, Cameron, et al.
Published: (2024)
by: Gordon, Cameron, et al.
Published: (2024)
Leaner Transformers: More Heads, Less Depth
by: Saratchandran, Hemanth, et al.
Published: (2025)
by: Saratchandran, Hemanth, et al.
Published: (2025)
Preconditioners for the Stochastic Training of Neural Fields
by: Chng, Shin-Fang, et al.
Published: (2024)
by: Chng, Shin-Fang, et al.
Published: (2024)
Structured Initialization for Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2025)
by: Zheng, Jianqiao, et al.
Published: (2025)
Enhancing Transformers Through Conditioned Embedded Tokens
by: Saratchandran, Hemanth, et al.
Published: (2025)
by: Saratchandran, Hemanth, et al.
Published: (2025)
TIME: TabPFN-Integrated Multimodal Engine for Robust Tabular-Image Learning
by: Luo, Jiaqi, et al.
Published: (2025)
by: Luo, Jiaqi, et al.
Published: (2025)
SineProject: Machine Unlearning for Stable Vision Language Alignment
by: Garg, Arpit, et al.
Published: (2025)
by: Garg, Arpit, et al.
Published: (2025)
Weight Conditioning for Smooth Optimization of Neural Networks
by: Saratchandran, Hemanth, et al.
Published: (2024)
by: Saratchandran, Hemanth, et al.
Published: (2024)
The Inlet Rank Collapse in Implicit Neural Representations: Diagnosis and Unified Remedy
by: Zheng, Jianqiao, et al.
Published: (2026)
by: Zheng, Jianqiao, et al.
Published: (2026)
Gradient Descent as a Shrinkage Operator for Spectral Bias
by: Lucey, Simon
Published: (2025)
by: Lucey, Simon
Published: (2025)
Spectral Conditioning of Attention Improves Transformer Performance
by: Saratchandran, Hemanth, et al.
Published: (2026)
by: Saratchandran, Hemanth, et al.
Published: (2026)
Mask the Target: A Plug-and-Play Regularizer Against LoRA Forgetting
by: Xu, Runze, et al.
Published: (2026)
by: Xu, Runze, et al.
Published: (2026)
SineLoRA$Δ$: Sine-Activated Delta Compression
by: Gordon, Cameron, et al.
Published: (2025)
by: Gordon, Cameron, et al.
Published: (2025)
Invertible Neural Warp for NeRF
by: Chng, Shin-Fang, et al.
Published: (2024)
by: Chng, Shin-Fang, et al.
Published: (2024)
Images as Tables: In-Context Learning with TabPFN for Low-Data Detection of AI-Generated Images
by: Walter, Jan Philip, et al.
Published: (2026)
by: Walter, Jan Philip, et al.
Published: (2026)
Structured Initialization for Attention in Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2024)
by: Zheng, Jianqiao, et al.
Published: (2024)
Convolutional Initialization for Data-Efficient Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2024)
by: Zheng, Jianqiao, et al.
Published: (2024)
Interpretable Machine Learning for TabPFN
by: Rundel, David, et al.
Published: (2024)
by: Rundel, David, et al.
Published: (2024)
TabMGP: Martingale Posterior with TabPFN
by: Ng, Kenyon, et al.
Published: (2025)
by: Ng, Kenyon, et al.
Published: (2025)
Towards Higher Effective Rank in Parameter-efficient Fine-tuning using Khatri--Rao Product
by: Albert, Paul, et al.
Published: (2025)
by: Albert, Paul, et al.
Published: (2025)
Rethinking the Role of Spatial Mixing
by: Cazenavette, George, et al.
Published: (2025)
by: Cazenavette, George, et al.
Published: (2025)
TabPFN Through The Looking Glass: An interpretability study of TabPFN and its internal representations
by: Gupta, Aviral, et al.
Published: (2026)
by: Gupta, Aviral, et al.
Published: (2026)
Trading Positional Complexity vs. Deepness in Coordinate Networks
by: Zheng, Jianqiao, et al.
Published: (2022)
by: Zheng, Jianqiao, et al.
Published: (2022)
TabPFN Extensions for Interpretable Geotechnical Modelling
by: Saito, Taiga, et al.
Published: (2026)
by: Saito, Taiga, et al.
Published: (2026)
The Quantization Benefits of Residual-Free Transformers
by: Ji, Yiping, et al.
Published: (2026)
by: Ji, Yiping, et al.
Published: (2026)
uLEAD-TabPFN: Uncertainty-aware Dependency-based Anomaly Detection with TabPFN
by: Lu, Sha, et al.
Published: (2026)
by: Lu, Sha, et al.
Published: (2026)
TabPFN-3: Technical Report
by: Grinsztajn, Léo, et al.
Published: (2026)
by: Grinsztajn, Léo, et al.
Published: (2026)
nanoTabPFN: A Lightweight and Educational Reimplementation of TabPFN
by: Pfefferle, Alexander, et al.
Published: (2025)
by: Pfefferle, Alexander, et al.
Published: (2025)
Cutting the Skip: Training Residual-Free Transformers
by: Ji, Yiping, et al.
Published: (2025)
by: Ji, Yiping, et al.
Published: (2025)
In-Context Data Distillation with TabPFN
by: Ma, Junwei, et al.
Published: (2024)
by: Ma, Junwei, et al.
Published: (2024)
TabPFGen -- Tabular Data Generation with TabPFN
by: Ma, Junwei, et al.
Published: (2024)
by: Ma, Junwei, et al.
Published: (2024)
3D-LFM: Lifting Foundation Model
by: Dabhi, Mosam, et al.
Published: (2023)
by: Dabhi, Mosam, et al.
Published: (2023)
Does TabPFN Understand Causal Structures?
by: Swelam, Omar, et al.
Published: (2025)
by: Swelam, Omar, et al.
Published: (2025)
On Quantizing Implicit Neural Representations
by: Gordon, Cameron, et al.
Published: (2022)
by: Gordon, Cameron, et al.
Published: (2022)
Is TabPFN the Silver Bullet for Insurance Pricing?
by: Deprez, Bruno, et al.
Published: (2026)
by: Deprez, Bruno, et al.
Published: (2026)
Analyzing the Neural Tangent Kernel of Periodically Activated Coordinate Networks
by: Saratchandran, Hemanth, et al.
Published: (2024)
by: Saratchandran, Hemanth, et al.
Published: (2024)
Similar Items
-
Rethinking Attention: Polynomial Alternatives to Softmax in Transformers
by: Saratchandran, Hemanth, et al.
Published: (2024) -
Efficient Learning With Sine-Activated Low-rank Matrices
by: Ji, Yiping, et al.
Published: (2024) -
Always Skip Attention
by: Ji, Yiping, et al.
Published: (2025) -
From Activation to Initialization: Scaling Insights for Optimizing Neural Fields
by: Saratchandran, Hemanth, et al.
Published: (2024) -
D'OH: Decoder-Only Random Hypernetworks for Implicit Neural Representations
by: Gordon, Cameron, et al.
Published: (2024)