Cover Image

A Theoretical Survey on Foundation Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fu, Shi, Chen, Yuzhu, Wang, Yingjie, Tao, Dacheng
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Theoretical Perspective: How to Prevent Model Collapse in Self-consuming Training Loops
by: Fu, Shi, et al.
Published: (2025)

Towards Theoretical Understandings of Self-Consuming Generative Models
by: Fu, Shi, et al.
Published: (2024)

CoVeR: Conformal Calibration for Versatile and Reliable Autoregressive Next-Token Prediction
by: Chen, Yuzhu, et al.
Published: (2025)

Drawback of Enforcing Equivariance and its Compensation via the Lens of Expressive Power
by: Chen, Yuzhu, et al.
Published: (2025)

Why Self-Rewarding Works: Theoretical Guarantees for Iterative Alignment of Language Models
by: Fu, Shi, et al.
Published: (2026)

InfoRM: Mitigating Reward Hacking in RLHF via Information-Theoretic Reward Modeling
by: Miao, Yuchun, et al.
Published: (2024)

A Time-Series Foundation Model by Universal Delay Embedding
by: Wang, Zijian, et al.
Published: (2025)

Physics-Guided Multimodal Transformers are the Necessary Foundation for the Next Generation of Meteorological Science
by: Han, Jing, et al.
Published: (2025)

Diffusion Models for Reinforcement Learning: Foundations, Taxonomy, and Development
by: Xu, Changfu, et al.
Published: (2025)

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models
by: Tang, Anke, et al.
Published: (2024)

Foundation Models for Time Series: A Survey
by: Kottapalli, Siva Rama Krishna, et al.
Published: (2025)

A Step Back: Prefix Importance Ratio Stabilizes Policy Optimization
by: Lei, Shiye, et al.
Published: (2026)

Data-Centric Foundation Models in Computational Healthcare: A Survey
by: Zhang, Yunkun, et al.
Published: (2024)

Diffusion Model-Based Video Editing: A Survey
by: Sun, Wenhao, et al.
Published: (2024)

Graph Foundation Models for Recommendation: A Comprehensive Survey
by: Wu, Bin, et al.
Published: (2025)

Synergizing Foundation Models and Federated Learning: A Survey
by: Li, Shenghui, et al.
Published: (2024)

Foundation Models and Transformers for Anomaly Detection: A Survey
by: Ammar, Mouïn Ben, et al.
Published: (2025)

Hyperbolic Deep Learning for Foundation Models: A Survey
by: He, Neil, et al.
Published: (2025)

Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
by: Ye, Jiexia, et al.
Published: (2024)

A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models
by: Lin, Zihao, et al.
Published: (2025)

Adaptive Defense against Harmful Fine-Tuning for Large Language Models via Bayesian Data Scheduler
by: Hu, Zixuan, et al.
Published: (2025)

Information-Theoretic Foundations for Machine Learning
by: Jeon, Hong Jun, et al.
Published: (2024)

Graph Foundation Models: A Comprehensive Survey
by: Wang, Zehong, et al.
Published: (2025)

Offline Behavior Distillation
by: Lei, Shiye, et al.
Published: (2024)

Continual Learning on Graphs: Challenges, Solutions, and Opportunities
by: Zhang, Xikun, et al.
Published: (2024)

Offline Behavioral Data Selection
by: Lei, Shiye, et al.
Published: (2025)

A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning
by: Bian, Jieming, et al.
Published: (2025)

Efficient Differentiable Causal Discovery via Reliable Super-Structure Learning
by: Ma, Pingchuan, et al.
Published: (2026)

Foundation Model in Biomedicine
by: Liu, Xiangrui, et al.
Published: (2025)

Distillation Traps and Guards: A Calibration Knob for LLM Distillability
by: Zhan, Weixiao, et al.
Published: (2026)

Information-Theoretic Foundations for Neural Scaling Laws
by: Jeon, Hong Jun, et al.
Published: (2024)

Generalisation of RLHF under Reward Shift and Clipped KL Regularisation
by: Tang, Kenton, et al.
Published: (2026)

A Survey of Personalized Federated Foundation Models for Privacy-Preserving Recommendation
by: Li, Zhiwei, et al.
Published: (2025)

RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation
by: Yuan, Haonan, et al.
Published: (2026)

Theoretical Foundations of Scaling Law in Familial Models
by: Song, Huan, et al.
Published: (2025)

Kronos: A Foundation Model for the Language of Financial Markets
by: Shi, Yu, et al.
Published: (2025)

Unlocking Tuning-Free Few-Shot Adaptability in Visual Foundation Models by Recycling Pre-Tuned LoRAs
by: Hu, Zixuan, et al.
Published: (2024)

Improving Large Language Models with Concept-Aware Fine-Tuning
by: Chen, Michael K., et al.
Published: (2025)

HRP: High-Rank Preheating for Superior LoRA Initialization
by: Chen, Yuzhu, et al.
Published: (2025)

Intra-Trajectory Consistency for Reward Modeling
by: Zhou, Chaoyang, et al.
Published: (2025)