Imagen de Portada

SLaNC: Static LayerNorm Calibration

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Salmani, Mahsa, Trukhanov, Nikita, Soloveychik, Ilya
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

LLM Inference Acceleration via Efficient Operation Fusion
por: Salmani, Mahsa, et al.
Publicado: (2025)

Accurate Block Quantization in LLMs with Outliers
por: Trukhanov, Nikita, et al.
Publicado: (2024)

LayerNorm Induces Recency Bias in Transformer Decoders
por: Kim, Junu, et al.
Publicado: (2025)

Post-LayerNorm Is Back: Stable, ExpressivE, and Deep
por: Chen, Chen, et al.
Publicado: (2026)

You can remove GPT2's LayerNorm by fine-tuning
por: Heimersheim, Stefan
Publicado: (2024)

LayerNorm: A key component in parameter-efficient fine-tuning
por: ValizadehAslani, Taha, et al.
Publicado: (2024)

MoETTA: Test-Time Adaptation Under Mixed Distribution Shifts with MoE-LayerNorm
por: Fan, Xiao, et al.
Publicado: (2025)

Calibration Across Layers: Understanding Calibration Evolution in LLMs
por: Joshi, Abhinav, et al.
Publicado: (2025)

SLaVA-CXR: Small Language and Vision Assistant for Chest X-ray Report Automation
por: Wu, Jinge, et al.
Publicado: (2024)

When Does Removing LayerNorm Help? Activation Bounding as a Regime-Dependent Implicit Regularizer
por: Verma, Lucky
Publicado: (2026)

Impact of Layer Norm on Memorization and Generalization in Transformers
por: Singhal, Rishi, et al.
Publicado: (2025)

SpecBound: Adaptive Bounded Self-Speculation with Layer-wise Confidence Calibration
por: Wen, Zhuofan, et al.
Publicado: (2026)

Early Stopping for Large Reasoning Models via Confidence Dynamics
por: Hosseini, Parsa, et al.
Publicado: (2026)

Rethinking Layer Redundancy: Calibration Matters More Than Search in LLM Depth Pruning
por: Kim, Minkyu, et al.
Publicado: (2026)

Geometry and Dynamics of LayerNorm
por: Riechers, Paul M.
Publicado: (2024)

Measuring Social Norms of Large Language Models
por: Yuan, Ye, et al.
Publicado: (2024)

An Isotropic Approach to Efficient Uncertainty Quantification with Gradient Norms
por: Grünefeld, Nils, et al.
Publicado: (2026)

Where Norms and References Collide: Evaluating LLMs on Normative Reasoning
por: Abrams, Mitchell, et al.
Publicado: (2026)

SpanNorm: Reconciling Training Stability and Performance in Deep Transformers
por: Wang, Chao, et al.
Publicado: (2026)

Static Word Embeddings for Sentence Semantic Representation
por: Wada, Takashi, et al.
Publicado: (2025)

Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering
por: Zhou, Han, et al.
Publicado: (2023)

Heuristics and Biases in AI Decision-Making: Implications for Responsible AGI
por: Saeedi, Payam, et al.
Publicado: (2024)

A Family of LLMs Liberated from Static Vocabularies
por: Alpha, Aleph, et al.
Publicado: (2026)

HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization
por: Zhuo, Zhijian, et al.
Publicado: (2025)

VerAs: Verify then Assess STEM Lab Reports
por: Atil, Berk, et al.
Publicado: (2024)

Teach Old SAEs New Domain Tricks with Boosting
por: Koriagin, Nikita, et al.
Publicado: (2025)

On the Entropy Calibration of Language Models
por: Cao, Steven, et al.
Publicado: (2025)

Modern Hopfield Networks Require Chain-of-Thought to Solve $\mathsf{NC}^1$-Hard Problems
por: Cao, Yang, et al.
Publicado: (2024)

Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inference
por: Adnan, Muhammad, et al.
Publicado: (2024)

Linguistic Calibration of Long-Form Generations
por: Band, Neil, et al.
Publicado: (2024)

A Study on the Calibration of In-context Learning
por: Zhang, Hanlin, et al.
Publicado: (2023)

Probing the contents of semantic representations from text, behavior, and brain data using the psychNorms metabase
por: Hussain, Zak, et al.
Publicado: (2024)

Layer by Layer: Uncovering Hidden Representations in Language Models
por: Skean, Oscar, et al.
Publicado: (2025)

Calibrating Language Models with Adaptive Temperature Scaling
por: Xie, Johnathan, et al.
Publicado: (2024)

Post Training Quantization of Large Language Models with Microscaling Formats
por: Sharify, Sayeh, et al.
Publicado: (2024)

Adaptive Layer Selection for Layer-Wise Token Pruning in LLM Inference
por: Taniguchi, Rei, et al.
Publicado: (2026)

Beware of Calibration Data for Pruning Large Language Models
por: Ji, Yixin, et al.
Publicado: (2024)

Fill In The Gaps: Model Calibration and Generalization with Synthetic Data
por: Ba, Yang, et al.
Publicado: (2024)

Calibrating Large Language Models Using Their Generations Only
por: Ulmer, Dennis, et al.
Publicado: (2024)

Enhancing In-context Learning via Linear Probe Calibration
por: Abbas, Momin, et al.
Publicado: (2024)