Cover Image

Prompting a Pretrained Transformer Can Be a Universal Approximator

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Petrov, Aleksandar, Torr, Philip H. S., Bibi, Adel
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Functional Analysis
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Universal In-Context Approximation By Prompting Fully Recurrent Models
by: Petrov, Aleksandar, et al.
Published: (2024)

When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations
by: Petrov, Aleksandar, et al.
Published: (2023)

Approximation analysis of CNNs from a feature extraction view
by: Li, Jianfei, et al.
Published: (2022)

Universal Approximation of Nonlinear Operators and Their Derivatives
by: de Feo, Filippo
Published: (2026)

Bridging Smoothness and Approximation: Theoretical Insights into Over-Smoothing in Graph Neural Networks
by: Yang, Guangrui, et al.
Published: (2024)

Bi-Factorial Preference Optimization: Balancing Safety-Helpfulness in Language Models
by: Zhang, Wenxuan, et al.
Published: (2024)

Kolmogorov--Arnold stability
by: Dzhenzher, Sviatoslav V., et al.
Published: (2025)

On Pretraining Data Diversity for Self-Supervised Learning
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

Sparse-Aware Neural Networks for Nonlinear Functionals: Mitigating the Exponential Dependence on Dimension
by: Li, Jianfei, et al.
Published: (2026)

Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learning
by: Berner, Julius, et al.
Published: (2025)

Equipment Health Assessment: Time Series Analysis for Wind Turbine Performance
by: Backhus, Jana, et al.
Published: (2024)

On the Coexistence and Ensembling of Watermarks
by: Petrov, Aleksandar, et al.
Published: (2025)

Do as I do (Safely): Mitigating Task-Specific Fine-tuning Risks in Large Language Models
by: Eiras, Francisco, et al.
Published: (2024)

Approximation of Permutation Invariant Polynomials by Transformers: Efficient Construction in Column-Size
by: Takeshita, Naoki, et al.
Published: (2025)

Topological Foundations of Reinforcement Learning
by: Kadurha, David Krame
Published: (2024)

Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
by: Kim, Minseon, et al.
Published: (2025)

Projection Methods for Operator Learning and Universal Approximation
by: Zappala, Emanuele
Published: (2024)

SynthCLIP: Are We Ready for a Fully Synthetic CLIP Training?
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

Approximation by Steklov Neural Network Operators
by: Karaman, S. N., et al.
Published: (2024)

Fitting Auditory Filterbanks with Multiresolution Neural Networks
by: Lostanlen, Vincent, et al.
Published: (2023)

Universal Approximation Theorem for Input-Connected Multilayer Perceptrons
by: Ismailov, Vugar
Published: (2026)

Quantitative Sobolev Approximation Bounds for Neural Operators with Empirical Validation on Burgers Equation
by: Hao, Nicole
Published: (2026)

Model Merging and Safety Alignment: One Bad Model Spoils the Bunch
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

How Analysis Can Teach Us the Optimal Way to Design Neural Operators
by: Le, Vu-Anh, et al.
Published: (2024)

On Rank-Dependent Generalisation Error Bounds for Transformers
by: Truong, Lan V.
Published: (2024)

Universal Approximation of Continuous Functionals on Compact Subsets via Linear Measurements and Scalar Nonlinearities
by: Krylov, Andrey, et al.
Published: (2026)

Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solvers
by: Zhou, Hang, et al.
Published: (2024)

Universal approximation with complex-valued deep narrow neural networks
by: Geuchen, Paul, et al.
Published: (2023)

Low-Rank Compression of Pretrained Models via Randomized Subspace Iteration
by: Pourkamali-Anaraki, Farhad
Published: (2026)

Universal Approximation Theorem for a Single-Layer Transformer
by: Gumaan, Esmail
Published: (2025)

Upper Approximation Bounds for Neural Oscillators
by: Huang, Zifeng, et al.
Published: (2025)

Orthogonal Polynomials Approximation Algorithm (OPAA):a functional analytic approach to estimating probability densities
by: Bialokozowicz, Lilian W.
Published: (2022)

Shh, don't say that! Domain Certification in LLMs
by: Emde, Cornelius, et al.
Published: (2025)

A Mathematical Explanation of Transformers
by: Tai, Xue-Cheng, et al.
Published: (2025)

A Kernel-based Stochastic Approximation Framework for Nonlinear Operator Learning
by: Yang, Jia-Qi, et al.
Published: (2025)

Transformers Can Implement Preconditioned Richardson Iteration for In-Context Gaussian Kernel Regression
by: Yan, Mingsong, et al.
Published: (2026)

AutoOR: Scalably Post-training LLMs to Autoformalize Operations Research Problems
by: Motwani, Sumeet Ramesh, et al.
Published: (2026)

Long Context In-Context Compression by Getting to the Gist of Gisting
by: Petrov, Aleksandar, et al.
Published: (2025)

Message-Passing GNNs Fail to Approximate Sparse Triangular Factorizations
by: Trifonov, Vladislav, et al.
Published: (2025)

An Interpretable Approach to Load Profile Forecasting in Power Grids using Galerkin-Approximated Koopman Pseudospectra
by: Tavasoli, Ali, et al.
Published: (2023)