Cover Image

Spectral Compact Training: Pre-Training Large Language Models via Permanent Truncated SVD and Stiefel QR Retraction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Kohlberger, Björn Roman
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence I.2.6
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Large Language Models as Attribution Regularizers for Efficient Model Training
by: Vukadin, Davor, et al.
Published: (2025)

Post-Training Probability Manifold Correction via Structured SVD Pruning and Self-Referential Distillation
by: Flouro, Aaron R., et al.
Published: (2026)

Architectural Proprioception in State Space Models: Thermodynamic Training Induces Anticipatory Halt Detection
by: Noon, Jay
Published: (2026)

Painless Activation Steering: An Automated, Lightweight Approach for Post-Training Large Language Models
by: Cui, Sasha, et al.
Published: (2025)

Training Artificial Neural Networks by Coordinate Search Algorithm
by: Rokhsatyazdi, Ehsan, et al.
Published: (2024)

Deep Memory Search: A Metaheuristic Approach for Optimizing Heuristic Search
by: Hedar, Abdel-Rahman, et al.
Published: (2024)

Entropy-Based Measurement of Value Drift and Alignment Work in Large Language Models
by: Fadli, Samih
Published: (2025)

The Geometry of Thought: How Scale Restructures Reasoning In Large Language Models
by: Anderson, Samuel Cyrenius
Published: (2026)

How Does Unfaithful Reasoning Emerge from Autoregressive Training? A Study of Synthetic Experiments
by: Wang, Fuxin, et al.
Published: (2026)

On the Role of Pre-trained Embeddings in Binary Code Analysis
by: Maier, Alwin, et al.
Published: (2025)

Reasoning Large Language Model Errors Arise from Hallucinating Critical Problem Features
by: Heyman, Alex, et al.
Published: (2025)

The Anti-Ouroboros Effect: Emergent Resilience in Large Language Models from Recursive Selective Feedback
by: Adapala, Sai Teja Reddy
Published: (2025)

Approximate Domain Unlearning for Vision-Language Models
by: Kawamura, Kodai, et al.
Published: (2025)

Leveraging KANs for Expedient Training of Multichannel MLPs via Preconditioning and Geometric Refinement
by: Actor, Jonas A., et al.
Published: (2025)

Combining Trained Models in Reinforcement Learning
by: Patil, Ujjwal, et al.
Published: (2026)

Scaling Offline RL via Efficient and Expressive Shortcut Models
by: Espinosa-Dice, Nicolas, et al.
Published: (2025)

Self-Training Doesn't Flatten Language -- It Restructures It: Surface Markers Amplify While Deep Syntax Dies
by: Liu, Ming
Published: (2026)

Model Fusion via Retrofitting
by: Luenam, Phoomraphee, et al.
Published: (2025)

Physics-Informed Spectral Modeling for Hyperspectral Imaging
by: Gawrysiak, Zuzanna, et al.
Published: (2025)

Dynamical Priors as a Training Objective in Reinforcement Learning
by: Subaharan, Sukesh
Published: (2026)

Better Schedules for Low Precision Training of Deep Neural Networks
by: Wolfe, Cameron R., et al.
Published: (2024)

Multi-Task Reinforcement Learning with Language-Encoded Gated Policy Networks
by: Arora, Rushiv
Published: (2025)

Democratic Preference Alignment via Sortition-Weighted RLHF
by: Sana, Suvadip, et al.
Published: (2026)

DPO Unchained: Your Training Algorithm is Secretly Disentangled in Human Choice Theory
by: Zhou, Wenxuan, et al.
Published: (2025)

Unlearning at Scale: Implementing the Right to be Forgotten in Large Language Models
by: X, Abdullah
Published: (2025)

Turning the TIDE: Cross-Architecture Distillation for Diffusion Large Language Models
by: Zhang, Gongbo, et al.
Published: (2026)

Evaluating Model Explanations without Ground Truth
by: Rawal, Kaivalya, et al.
Published: (2025)

Grokking Beyond the Euclidean Norm of Model Parameters
by: Notsawo, Pascal Jr Tikeng, et al.
Published: (2025)

Cognitive Load Limits in Large Language Models: Benchmarking Multi-Hop Reasoning
by: Adapala, Sai Teja Reddy
Published: (2025)

Alif: Advancing Urdu Large Language Models via Multilingual Synthetic Data Distillation
by: Shafique, Muhammad Ali, et al.
Published: (2025)

Black Box Model Explanations and the Human Interpretability Expectations -- An Analysis in the Context of Homicide Prediction
by: Ribeiro, José, et al.
Published: (2022)

A Practical Approach to using Supervised Machine Learning Models to Classify Aviation Safety Occurrences
by: Siow, Bryan Y.
Published: (2025)

A Framework for Neurosymbolic Robot Action Planning using Large Language Models
by: Capitanelli, Alessio, et al.
Published: (2023)

Beyond Hallucinations: A Composite Score for Measuring Reliability in Open-Source Large Language Models
by: Salla, Rohit Kumar, et al.
Published: (2025)

Ground-Compose-Reinforce: Grounding Language in Agentic Behaviours using Limited Data
by: Li, Andrew C., et al.
Published: (2025)

BLOCK-EM: Preventing Emergent Misalignment via Latent Blocking
by: Ustaomeroglu, Muhammed, et al.
Published: (2026)

Closing the Distribution Gap in Adversarial Training for LLMs
by: Hu, Chengzhi, et al.
Published: (2026)

Embedded Safety-Aligned Intelligence via Differentiable Internal Alignment Embeddings
by: Rathva, Harsh, et al.
Published: (2025)

Reducing the Sensitivity of Neural Physics Simulators to Mesh Topology via Pretraining
by: Vaska, Nathan, et al.
Published: (2025)

Training AI to be Loyal
by: Oh, Sewoong, et al.
Published: (2025)