Saved in:
| Main Authors: | Schlotthauer, Joel, Kroos, Christian, Hinze, Chris, Hangya, Viktor, Hahn, Luzian, Küch, Fabian |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.08472 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
CEDAR: Context Engineering for Agentic Data Science
by: Roy, Rishiraj Saha, et al.
Published: (2026)
by: Roy, Rishiraj Saha, et al.
Published: (2026)
RAGONITE: Iterative Retrieval on Induced Databases and Verbalized RDF for Conversational QA over KGs with RAG
by: Roy, Rishiraj Saha, et al.
Published: (2024)
by: Roy, Rishiraj Saha, et al.
Published: (2024)
Introducing Echo Networks for Computational Neuroevolution
by: Kroos, Christian, et al.
Published: (2026)
by: Kroos, Christian, et al.
Published: (2026)
Evidence Contextualization and Counterfactual Attribution for Conversational QA over Heterogeneous Data with RAG Systems
by: Roy, Rishiraj Saha, et al.
Published: (2024)
by: Roy, Rishiraj Saha, et al.
Published: (2024)
From Understanding to Generation: An Efficient Shortcut for Evaluating Language Models
by: Hangya, Viktor, et al.
Published: (2025)
by: Hangya, Viktor, et al.
Published: (2025)
Efficient Pre-Training of LLMs through Truncated SVD Layers
by: Kamali, Kaivan, et al.
Published: (2026)
by: Kamali, Kaivan, et al.
Published: (2026)
CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
by: Liu, Ziyue, et al.
Published: (2025)
by: Liu, Ziyue, et al.
Published: (2025)
LLMs Encode Their Failures: Predicting Success from Pre-Generation Activations
by: Lugoloobi, William, et al.
Published: (2026)
by: Lugoloobi, William, et al.
Published: (2026)
AutoScale: Scale-Aware Data Mixing for Pre-Training LLMs
by: Kang, Feiyang, et al.
Published: (2024)
by: Kang, Feiyang, et al.
Published: (2024)
Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training
by: Ostapenko, Oleksiy, et al.
Published: (2025)
by: Ostapenko, Oleksiy, et al.
Published: (2025)
Predicting Training Re-evaluation Curves Enables Effective Data Curriculums for LLMs
by: Bergsma, Shane, et al.
Published: (2025)
by: Bergsma, Shane, et al.
Published: (2025)
LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs
by: Kim, Taeho, et al.
Published: (2024)
by: Kim, Taeho, et al.
Published: (2024)
A Survey on Time-Series Pre-Trained Models
by: Ma, Qianli, et al.
Published: (2023)
by: Ma, Qianli, et al.
Published: (2023)
Junk DNA Hypothesis: Pruning Small Pre-Trained Weights Irreversibly and Monotonically Impairs "Difficult" Downstream Tasks in LLMs
by: Yin, Lu, et al.
Published: (2023)
by: Yin, Lu, et al.
Published: (2023)
Analyzing Generalization in Pre-Trained Symbolic Regression
by: Voigt, Henrik, et al.
Published: (2025)
by: Voigt, Henrik, et al.
Published: (2025)
Value-Based Pre-Training with Downstream Feedback
by: Ke, Shuqi, et al.
Published: (2026)
by: Ke, Shuqi, et al.
Published: (2026)
ADAPTive Input Training for Many-to-One Pre-Training on Time-Series Classification
by: Quinlan, Paul, et al.
Published: (2026)
by: Quinlan, Paul, et al.
Published: (2026)
A Theory of Training Profit-Optimal LLMs
by: Hao, Sophie, et al.
Published: (2026)
by: Hao, Sophie, et al.
Published: (2026)
Improving Rule-based Reasoning in LLMs using Neurosymbolic Representations
by: Dhanraj, Varun, et al.
Published: (2025)
by: Dhanraj, Varun, et al.
Published: (2025)
Self-Supervised Pre-Training for Precipitation Post-Processor
by: An, Sojung, et al.
Published: (2023)
by: An, Sojung, et al.
Published: (2023)
Practical Insights into Knowledge Distillation for Pre-Trained Models
by: Alballa, Norah, et al.
Published: (2024)
by: Alballa, Norah, et al.
Published: (2024)
Layer Importance for Mathematical Reasoning is Forged in Pre-Training and Invariant after Post-Training
by: Nepal, Aadim, et al.
Published: (2025)
by: Nepal, Aadim, et al.
Published: (2025)
Toward a Graph Foundation Model: Pre-Training Transformers With Random Walks
by: Tang, Ziyuan, et al.
Published: (2025)
by: Tang, Ziyuan, et al.
Published: (2025)
Training LLMs for Honesty via Confessions
by: Joglekar, Manas, et al.
Published: (2025)
by: Joglekar, Manas, et al.
Published: (2025)
A Framework for Quantifying How Pre-Training and Context Benefit In-Context Learning
by: Song, Bingqing, et al.
Published: (2025)
by: Song, Bingqing, et al.
Published: (2025)
Ensemble of Pre-Trained Models for Long-Tailed Trajectory Prediction
by: Thuremella, Divya, et al.
Published: (2025)
by: Thuremella, Divya, et al.
Published: (2025)
On the Surprising Efficacy of Distillation as an Alternative to Pre-Training Small Models
by: Farhat, Sean, et al.
Published: (2024)
by: Farhat, Sean, et al.
Published: (2024)
Evaluation of Real-Time Preprocessing Methods in AI-Based ECG Signal Analysis
by: Freudenberg, Jasmin, et al.
Published: (2025)
by: Freudenberg, Jasmin, et al.
Published: (2025)
A Comedy of Estimators: On KL Regularization in RL Training of LLMs
by: Shah, Vedant, et al.
Published: (2025)
by: Shah, Vedant, et al.
Published: (2025)
Relational Learning in Pre-Trained Models: A Theory from Hypergraph Recovery Perspective
by: Chen, Yang, et al.
Published: (2024)
by: Chen, Yang, et al.
Published: (2024)
CyclicFL: A Cyclic Model Pre-Training Approach to Efficient Federated Learning
by: Zhang, Pengyu, et al.
Published: (2023)
by: Zhang, Pengyu, et al.
Published: (2023)
TiCT: A Synthetically Pre-Trained Foundation Model for Time Series Classification
by: Yeh, Chin-Chia Michael, et al.
Published: (2025)
by: Yeh, Chin-Chia Michael, et al.
Published: (2025)
Removing Sandbagging in LLMs by Training with Weak Supervision
by: Ryd, Emil, et al.
Published: (2026)
by: Ryd, Emil, et al.
Published: (2026)
Reinforcement Learning on Pre-Training Data
by: Li, Siheng, et al.
Published: (2025)
by: Li, Siheng, et al.
Published: (2025)
Combining Pre-Trained Models for Enhanced Feature Representation in Reinforcement Learning
by: Piccoli, Elia, et al.
Published: (2025)
by: Piccoli, Elia, et al.
Published: (2025)
Pre-Training Graph Contrastive Masked Autoencoders are Strong Distillers for EEG
by: Wei, Xinxu, et al.
Published: (2024)
by: Wei, Xinxu, et al.
Published: (2024)
Zero-Sacrifice Persistent-Robustness Adversarial Defense for Pre-Trained Encoders
by: Lei, Zhuxin, et al.
Published: (2026)
by: Lei, Zhuxin, et al.
Published: (2026)
PTMs-TSCIL Pre-Trained Models Based Class-Incremental Learning
by: Wu, Yuanlong, et al.
Published: (2025)
by: Wu, Yuanlong, et al.
Published: (2025)
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
by: Fujii, Kazuki, et al.
Published: (2025)
by: Fujii, Kazuki, et al.
Published: (2025)
Provably Robust Pre-Trained Ensembles for Biomarker-Based Cancer Classification
by: Lee, Chongmin, et al.
Published: (2024)
by: Lee, Chongmin, et al.
Published: (2024)
Similar Items
-
CEDAR: Context Engineering for Agentic Data Science
by: Roy, Rishiraj Saha, et al.
Published: (2026) -
RAGONITE: Iterative Retrieval on Induced Databases and Verbalized RDF for Conversational QA over KGs with RAG
by: Roy, Rishiraj Saha, et al.
Published: (2024) -
Introducing Echo Networks for Computational Neuroevolution
by: Kroos, Christian, et al.
Published: (2026) -
Evidence Contextualization and Counterfactual Attribution for Conversational QA over Heterogeneous Data with RAG Systems
by: Roy, Rishiraj Saha, et al.
Published: (2024) -
From Understanding to Generation: An Efficient Shortcut for Evaluating Language Models
by: Hangya, Viktor, et al.
Published: (2025)