Saved in:
| Main Authors: | Lion, Kai, Noci, Lorenzo, Hofmann, Thomas, Bachmann, Gregor |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2402.03187 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Thinking into the Future: Latent Lookahead Training for Transformers
by: Noci, Lorenzo, et al.
Published: (2026)
by: Noci, Lorenzo, et al.
Published: (2026)
Super Consistency of Neural Network Landscapes and Learning Rate Transfer
by: Noci, Lorenzo, et al.
Published: (2024)
by: Noci, Lorenzo, et al.
Published: (2024)
Understanding and Minimising Outlier Features in Neural Network Training
by: He, Bobby, et al.
Published: (2024)
by: He, Bobby, et al.
Published: (2024)
Universal Dynamics of Warmup Stable Decay: understanding WSD beyond Transformers
by: Belloni, Annalisa, et al.
Published: (2026)
by: Belloni, Annalisa, et al.
Published: (2026)
The Importance of Being Lazy: Scaling Limits of Continual Learning
by: Graldi, Jacopo, et al.
Published: (2025)
by: Graldi, Jacopo, et al.
Published: (2025)
Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers
by: Anagnostidis, Sotiris, et al.
Published: (2023)
by: Anagnostidis, Sotiris, et al.
Published: (2023)
Is Random Attention Sufficient for Sequence Modeling? Disentangling Trainable Components in the Transformer
by: Dong, Yihe, et al.
Published: (2025)
by: Dong, Yihe, et al.
Published: (2025)
Navigating Scaling Laws: Compute Optimality in Adaptive Model Training
by: Anagnostidis, Sotiris, et al.
Published: (2023)
by: Anagnostidis, Sotiris, et al.
Published: (2023)
The pitfalls of next-token prediction
by: Bachmann, Gregor, et al.
Published: (2024)
by: Bachmann, Gregor, et al.
Published: (2024)
Interpolated-MLPs: Controllable Inductive Bias
by: Wu, Sean, et al.
Published: (2024)
by: Wu, Sean, et al.
Published: (2024)
Muown: Row-Norm Control for Muon Optimization
by: Lion, Kai, et al.
Published: (2026)
by: Lion, Kai, et al.
Published: (2026)
PoLAR: Polar-Decomposed Low-Rank Adapter Representation
by: Lion, Kai, et al.
Published: (2025)
by: Lion, Kai, et al.
Published: (2025)
Don't be lazy: CompleteP enables compute-efficient deep transformers
by: Dey, Nolan, et al.
Published: (2025)
by: Dey, Nolan, et al.
Published: (2025)
What Makes a Representation Good for Single-Cell Perturbation Prediction?
by: Jiang, Wenkang, et al.
Published: (2026)
by: Jiang, Wenkang, et al.
Published: (2026)
MST-Direct: Matching via Sinkhorn Transport for Multivariate Geostatistical Simulation with Complex Non-Linear Dependencies
by: Schmitz, Tchalies Bachmann
Published: (2026)
by: Schmitz, Tchalies Bachmann
Published: (2026)
How Good Are LLMs at Processing Tool Outputs?
by: Kate, Kiran, et al.
Published: (2025)
by: Kate, Kiran, et al.
Published: (2025)
Adaptive Spatial Goodness Encoding: Advancing and Scaling Forward-Forward Learning Without Backpropagation
by: Gong, Qingchun, et al.
Published: (2025)
by: Gong, Qingchun, et al.
Published: (2025)
Integrated electro-optic attention nonlinearities for transformers
by: Mickeler, Luis, et al.
Published: (2026)
by: Mickeler, Luis, et al.
Published: (2026)
Rescaling-Aware Training for Efficient Deployment of Deep Learning Models on Full-Integer Hardware
by: Mueller, Lion, et al.
Published: (2025)
by: Mueller, Lion, et al.
Published: (2025)
A Good Score Does not Lead to A Good Generative Model
by: Li, Sixu, et al.
Published: (2024)
by: Li, Sixu, et al.
Published: (2024)
Covariance-Aware Goodness for Scalable Forward-Forward Learning
by: Jiang, Xiaoyi, et al.
Published: (2026)
by: Jiang, Xiaoyi, et al.
Published: (2026)
AfroBench: How Good are Large Language Models on African Languages?
by: Ojo, Jessica, et al.
Published: (2023)
by: Ojo, Jessica, et al.
Published: (2023)
In Search of Goodness: Large Scale Benchmarking of Goodness Functions for the Forward-Forward Algorithm
by: Shah, Arya, et al.
Published: (2025)
by: Shah, Arya, et al.
Published: (2025)
Acoustic Sensing for Universal Jamming Grippers
by: Weber, Lion, et al.
Published: (2026)
by: Weber, Lion, et al.
Published: (2026)
Update Your Transformer to the Latest Release: Re-Basin of Task Vectors
by: Rinaldi, Filippo, et al.
Published: (2025)
by: Rinaldi, Filippo, et al.
Published: (2025)
dynActivation: A Trainable Activation Family for Adaptive Nonlinearity
by: Bachmann, Alois
Published: (2026)
by: Bachmann, Alois
Published: (2026)
Auto-Encoding Goodness of Fit
by: Palmer, Aaron, et al.
Published: (2022)
by: Palmer, Aaron, et al.
Published: (2022)
Differential Good Arm Identification
by: Tsai, Yun-Da, et al.
Published: (2023)
by: Tsai, Yun-Da, et al.
Published: (2023)
Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment
by: Bachmann, Gregor, et al.
Published: (2025)
by: Bachmann, Gregor, et al.
Published: (2025)
Encouraging Good Processes Without the Need for Good Answers: Reinforcement Learning for LLM Agent Planning
by: Li, Zhiwei, et al.
Published: (2025)
by: Li, Zhiwei, et al.
Published: (2025)
It Takes a Good Model to Train a Good Model: Generalized Gaussian Priors for Optimized LLMs
by: Wu, Jun, et al.
Published: (2025)
by: Wu, Jun, et al.
Published: (2025)
Logic Gate Neural Networks are Good for Verification
by: Kresse, Fabian, et al.
Published: (2025)
by: Kresse, Fabian, et al.
Published: (2025)
Wasserstein t-SNE
by: Bachmann, Fynn, et al.
Published: (2022)
by: Bachmann, Fynn, et al.
Published: (2022)
HemaGraph: Breaking Barriers in Hematologic Single Cell Classification with Graph Attention
by: Bini, Lorenzo, et al.
Published: (2024)
by: Bini, Lorenzo, et al.
Published: (2024)
Good Reasoning Makes Good Demonstrations: Implicit Reasoning Quality Supervision via In-Context Reinforcement Learning
by: Mei, Tiehua, et al.
Published: (2026)
by: Mei, Tiehua, et al.
Published: (2026)
How to Square Tensor Networks and Circuits Without Squaring Them
by: Loconte, Lorenzo, et al.
Published: (2025)
by: Loconte, Lorenzo, et al.
Published: (2025)
Predictive Churn with the Set of Good Models
by: Watson-Daniels, Jamelle, et al.
Published: (2024)
by: Watson-Daniels, Jamelle, et al.
Published: (2024)
LEGATO: Good Identity Unlearning Is Continuous
by: Chen, Qiang, et al.
Published: (2026)
by: Chen, Qiang, et al.
Published: (2026)
An Anytime Algorithm for Good Arm Identification
by: Jourdan, Marc, et al.
Published: (2023)
by: Jourdan, Marc, et al.
Published: (2023)
Convex Basins in Single-Index Model Loss Landscapes: Applications to Robust Recovery under Strong Adversarial Corruption
by: Das, Santanu, et al.
Published: (2026)
by: Das, Santanu, et al.
Published: (2026)
Similar Items
-
Thinking into the Future: Latent Lookahead Training for Transformers
by: Noci, Lorenzo, et al.
Published: (2026) -
Super Consistency of Neural Network Landscapes and Learning Rate Transfer
by: Noci, Lorenzo, et al.
Published: (2024) -
Understanding and Minimising Outlier Features in Neural Network Training
by: He, Bobby, et al.
Published: (2024) -
Universal Dynamics of Warmup Stable Decay: understanding WSD beyond Transformers
by: Belloni, Annalisa, et al.
Published: (2026) -
The Importance of Being Lazy: Scaling Limits of Continual Learning
by: Graldi, Jacopo, et al.
Published: (2025)