Cover Image

S2D: Selective Spectral Decay for Quantization-Friendly Conditioning of Neural Activations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chavan, Arnav, Lele, Nahush, Bamba, Udbhav, Dayal, Sankalp, Raghunathan, Aditi, Gupta, Deepak
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Surgical Feature-Space Decomposition of LLMs: Why, When and How?
by: Chavan, Arnav, et al.
Published: (2024)

DOT-MoE: Differentiable Optimal Transport for MoEfication
by: Bamba, Udbhav, et al.
Published: (2026)

Beyond Uniform Scaling: Exploring Depth Heterogeneity in Neural Architectures
by: T, Akash Guna R., et al.
Published: (2024)

Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward
by: Chavan, Arnav, et al.
Published: (2024)

Mode-Conditioning Unlocks Superior Test-Time Scaling
by: Wu, Chen Henry, et al.
Published: (2025)

Turning LLM Activations Quantization-Friendly
by: Czakó, Patrik, et al.
Published: (2025)

Self-Trained Verification for Training- and Test-Time Self-Improvement
by: Wu, Chen Henry, et al.
Published: (2026)

Memorization Sinks: Isolating Memorization during LLM Training
by: Ghosal, Gaurav R., et al.
Published: (2025)

Reasoning as an Adaptive Defense for Safety
by: Kim, Taeyoun, et al.
Published: (2025)

Thermodynamic Diffusion Inference with Minimal Digital Conditioning
by: De, Aditi
Published: (2026)

GradientSpace: Unsupervised Data Clustering for Improved Instruction Tuning
by: Sridharan, Shrihari, et al.
Published: (2025)

XAMBA: Enabling Efficient State Space Models on Resource-Constrained Neural Processing Units
by: Das, Arghadip, et al.
Published: (2025)

GraNNite: Enabling High-Performance Execution of Graph Neural Networks on Resource-Constrained Neural Processing Units
by: Das, Arghadip, et al.
Published: (2025)

Weight Ensembling Improves Reasoning in Language Models
by: Dang, Xingyu, et al.
Published: (2025)

Pando: Do Interpretability Methods Work When Models Won't Explain Themselves?
by: Zhong, Ziqian, et al.
Published: (2026)

Hierarchical Sparse Plus Low Rank Compression of LLM
by: Kumar, Pawan, et al.
Published: (2025)

Ray-Tracing for Conditionally Activated Neural Networks
by: Gallicchio, Claudio, et al.
Published: (2025)

Test-Time Adaptation Induces Stronger Accuracy and Agreement-on-the-Line
by: Kim, Eungyeup, et al.
Published: (2023)

Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
by: Nagarajan, Vaishnavh, et al.
Published: (2025)

When Less is More: 8-bit Quantization Improves Continual Learning in Large Language Models
by: Zhang, Michael S., et al.
Published: (2025)

Hodoscope: Unsupervised Monitoring for AI Misbehaviors
by: Zhong, Ziqian, et al.
Published: (2026)

Deep Conditional Measure Quantization
by: Turinici, Gabriel
Published: (2023)

Base Models Look Human To AI Detectors
by: Xu, Yixuan Even, et al.
Published: (2026)

Persona-Conditioned Risk Behavior in Large Language Models: A Simulated Gambling Study with GPT-4.1
by: Dubedy, Sankalp
Published: (2026)

Structured Abductive-Deductive-Inductive Reasoning for LLMs via Algebraic Invariants
by: Gilda, Sankalp, et al.
Published: (2026)

Activation Sensitivity as a Unifying Principle for Post-Training Quantization
by: Xu, Bruce Changlong
Published: (2026)

SmoothRot: Combining Channel-Wise Scaling and Rotation for Quantization-Friendly LLMs
by: Czakó, Patrik, et al.
Published: (2025)

Proactively Detecting Threats: A Novel Approach Using LLMs
by: Chawla, Aniesh, et al.
Published: (2026)

A Decompilation-Driven Framework for Malware Detection with Large Language Models
by: Chawla, Aniesh, et al.
Published: (2026)

A Unified Evaluation of Learning-Based Similarity Techniques for Malware Detection
by: Prasad, Udbhav, et al.
Published: (2026)

Mitigating Modal Imbalance in Multimodal Reasoning
by: Wu, Chen Henry, et al.
Published: (2025)

Activation Outliers in Transformer Quantization: Reproduction, Statistical Analysis, and Deployment Tradeoffs
by: Kaliaperumal, Pranav Kumar
Published: (2026)

InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization
by: Li, Ke, et al.
Published: (2026)

ASER: Activation Smoothing and Error Reconstruction for Large Language Model Quantization
by: Zhao, Weibo, et al.
Published: (2024)

SAP: Corrective Machine Unlearning with Scaled Activation Projection for Label Noise Robustness
by: Kodge, Sangamesh, et al.
Published: (2024)

Training Verification-Friendly Neural Networks via Neuron Behavior Consistency
by: Liu, Zongxin, et al.
Published: (2024)

Robust Calibration For Improved Weather Prediction Under Distributional Shift
by: Gilda, Sankalp, et al.
Published: (2024)

Beacon: Post-Training Quantization with Integrated Grid Selection
by: Zhang, Shihao, et al.
Published: (2025)

Symmetric Equilibrium Propagation for Thermodynamic Diffusion Training
by: De, Aditi
Published: (2026)

Gradient-Free Training of Quantized Neural Networks
by: Cohen, Noa, et al.
Published: (2024)