Imagen de Portada

Has LLM Reached the Scaling Ceiling Yet? Unified Insights into LLM Regularities and Constraints

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Luo, Charles
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Breaking the Capability Ceiling of LLM Post-Training by Reintroducing Markov States
por: Yuan, Yurun, et al.
Publicado: (2026)

Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks
por: Li, Ang, et al.
Publicado: (2025)

Ratio-Variance Regularized Policy Optimization for Efficient LLM Fine-tuning
por: Luo, Yu, et al.
Publicado: (2026)

Breaking the Blocks: Continuous Low-Rank Decomposed Scaling for Unified LLM Quantization and Adaptation
por: Tang, Pingzhi, et al.
Publicado: (2026)

When the Domain Expert Has No Time and the LLM Developer Has No Clinical Expertise: Real-World Lessons from LLM Co-Design in a Safety-Net Hospital
por: Kothari, Avni, et al.
Publicado: (2025)

Simple Yet Effective: An Information-Theoretic Approach to Multi-LLM Uncertainty Quantification
por: Kruse, Maya, et al.
Publicado: (2025)

Putting the Value Back in RL: Better Test-Time Scaling by Unifying LLM Reasoners With Verifiers
por: Sareen, Kusha, et al.
Publicado: (2025)

Graph-Regularized Sparse Autoencoders for LLM Safety Steering
por: Yeon, Jehyeok, et al.
Publicado: (2025)

The LLM Has Left The Chat: Evidence of Bail Preferences in Large Language Models
por: Ensign, Danielle, et al.
Publicado: (2025)

Diagnosing Spectral Ceilings in Equivariant Neural Force Fields
por: Kim, Hyunmog
Publicado: (2026)

Yet Unnoticed in LSTM: Binary Tree Based Input Reordering, Weight Regularization, and Gate Nonlinearization
por: Moattari, Mojtaba
Publicado: (2025)

MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale Deployment
por: Huang, Hanxian, et al.
Publicado: (2026)

Dr. Post-Training: A Data Regularization Perspective on LLM Post-Training
por: Hu, Pingbang, et al.
Publicado: (2026)

A Unified Framework for LLM Watermarks
por: Gloaguen, Thibaud, et al.
Publicado: (2026)

UltraSketchLLM: Saliency-Driven Sketching for Ultra-Low Bit LLM Compression
por: Zou, Sunan, et al.
Publicado: (2025)

Reinforcement Learning with $ω$-Regular Objectives and Constraints
por: Wagner, Dominik, et al.
Publicado: (2025)

Adaptive Layerwise Perturbation: Unifying Off-Policy Corrections for LLM RL
por: Ye, Chenlu, et al.
Publicado: (2026)

Ensembling Tabular Foundation Models - A Diversity Ceiling And A Calibration Trap
por: Tanna, Aditya, et al.
Publicado: (2026)

Atom of Thoughts for Markov LLM Test-Time Scaling
por: Teng, Fengwei, et al.
Publicado: (2025)

Demystifying Manifold Constraints in LLM Pre-training
por: An, Kang, et al.
Publicado: (2026)

Scaling-Aware Adapter for Structure-Grounded LLM Reasoning
por: Jing, Zihao, et al.
Publicado: (2026)

Astro: Activation-guided Structured Regularization for Outlier-Robust LLM Post-Training Quantization
por: Chen, Xi, et al.
Publicado: (2026)

When Your LLM Reaches End-of-Life: A Framework for Confident Model Migration in Production Systems
por: Casey, Emma, et al.
Publicado: (2026)

Dynamic Intelligence Ceilings: Measuring Long-Horizon Limits of Planning and Creativity in Artificial Systems
por: Khanh, Truong Xuan, et al.
Publicado: (2026)

Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights
por: Parashar, Shubham, et al.
Publicado: (2025)

InsightBuild: LLM-Powered Causal Reasoning in Smart Building Systems
por: Neogi, Pinaki Prasad Guha, et al.
Publicado: (2025)

Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint
por: Liu, Zhihao, et al.
Publicado: (2025)

Policy Split: Incentivizing Dual-Mode Exploration in LLM Reinforcement with Dual-Mode Entropy Regularization
por: Yao, Jiashu, et al.
Publicado: (2026)

LLM-Based Scientific Equation Discovery via Physics-Informed Token-Regularized Policy Optimization
por: Wang, Boxiao, et al.
Publicado: (2026)

SparseSwaps: Tractable LLM Pruning Mask Refinement at Scale
por: Zimmer, Max, et al.
Publicado: (2025)

Online Scheduling for LLM Inference with KV Cache Constraints
por: Jaillet, Patrick, et al.
Publicado: (2025)

On the Design of KL-Regularized Policy Gradient Algorithms for LLM Reasoning
por: Zhang, Yifan, et al.
Publicado: (2025)

Adaptive Regularization of Representation Rank as an Implicit Constraint of Bellman Equation
por: He, Qiang, et al.
Publicado: (2024)

Controlled LLM Training on Spectral Sphere
por: Xie, Tian, et al.
Publicado: (2026)

Improving LLM Reasoning through Scaling Inference Computation with Collaborative Verification
por: Liang, Zhenwen, et al.
Publicado: (2024)

IsoCompute Playbook: Optimally Scaling Sampling Compute for LLM RL
por: Cheng, Zhoujun, et al.
Publicado: (2026)

LLM-Inspired Pretrain-Then-Finetune for Small-Data, Large-Scale Optimization
por: Zhang, Zishi, et al.
Publicado: (2026)

Robust Yet Efficient Conformal Prediction Sets
por: Zargarbashi, Soroush H., et al.
Publicado: (2024)

Breaking the Performance Ceiling in Reinforcement Learning requires Inference Strategies
por: Chalumeau, Felix, et al.
Publicado: (2025)

Loquetier: A Virtualized Multi-LoRA Framework for Unified LLM Fine-tuning and Serving
por: Zhang, Yuchen, et al.
Publicado: (2025)