Cover Image

Getting Free Bits Back from Rotational Symmetries in LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	He, Jiajun, Flamich, Gergely, Hernández-Lobato, José Miguel
Format:	Preprint
Published:	2024
Subjects:	Information Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Accelerating Relative Entropy Coding with Space Partitioning
by: He, Jiajun, et al.
Published: (2024)

Singular Relative Entropy Coding with Bits-Back Rejection Sampling
by: Flamich, Gergely, et al.
Published: (2026)

RECOMBINER: Robust and Enhanced Compression with Bayesian Implicit Neural Representations
by: He, Jiajun, et al.
Published: (2023)

Some Notes on the Sample Complexity of Approximate Channel Simulation
by: Flamich, Gergely, et al.
Published: (2024)

Data Compression with Relative Entropy Coding
by: Flamich, Gergely
Published: (2025)

Data Compression with Stochastic Codes
by: Flamich, Gergely, et al.
Published: (2026)

A Parameter-Free Two-Bit Covariance Estimator with Improved Operator Norm Error Rate
by: Chen, Junren, et al.
Published: (2023)

On Channel Simulation with Causal Rejection Samplers
by: Goc, Daniel, et al.
Published: (2024)

Greedy Poisson Rejection Sampling
by: Flamich, Gergely
Published: (2023)

The Redundancy of Non-Singular Channel Simulation
by: Flamich, Gergely, et al.
Published: (2025)

Rejection Sampling is Optimal for Relative Entropy Coding
by: Hill, Spencer, et al.
Published: (2026)

Multi-Marginal Couplings for Metropolis-Hastings
by: Phan, Buu, et al.
Published: (2026)

Order-Optimal Sequential 1-Bit Mean Estimation in General Tail Regimes
by: Lau, Ivan, et al.
Published: (2026)

Adaptive Greedy Rejection Sampling
by: Flamich, Gergely, et al.
Published: (2023)

Unifying AMP Algorithms for Rotationally-Invariant Models
by: Liu, Songbin, et al.
Published: (2024)

Orthogonal Approximate Message Passing Algorithms for Rectangular Spiked Matrix Models with Rotationally Invariant Noise
by: Chen, Haohua, et al.
Published: (2026)

Prompt Fairness: Sub-group Disparities in LLMs
by: Zhong, Meiyu, et al.
Published: (2025)

Robust Precoding for Resilient Cell-Free Networks
by: Mashdour, Saeed, et al.
Published: (2025)

Training-Free Rate-Distortion-Perception Traversal With Diffusion
by: Wang, Yuhan, et al.
Published: (2026)

Regret Bounds for Noise-Free Cascaded Kernelized Bandits
by: Li, Zihan, et al.
Published: (2022)

Optimality of Approximate Message Passing Algorithms for Spiked Matrix Models with Rotationally Invariant Noise
by: Dudeja, Rishabh, et al.
Published: (2024)

Variational Inference Optimized Using the Curved Geometry of Coupled Free Energy
by: Nelson, Kenric, et al.
Published: (2025)

Entropy-Based Dimension-Free Convergence and Loss-Adaptive Schedules for Diffusion Models
by: Aghapour, Ahmad, et al.
Published: (2026)

Refined Differentially Private Linear Regression via Extension of a Free Lunch Result
by: S, Sasmita Harini, et al.
Published: (2026)

Pilot Contamination Aware Transformer for Downlink Power Control in Cell-Free Massive MIMO Networks
by: Kocharlakota, Atchutaram K., et al.
Published: (2024)

Generative AI-Driven Phase Control for RIS-Aided Cell-Free Massive MIMO Systems
by: Patel, Kalpesh K., et al.
Published: (2026)

Efficient Gradient Estimation for Parameterized Quantum Systems with Lie Algebraic Symmetries
by: Heidari, Mohsen, et al.
Published: (2024)

QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
by: Ashkboos, Saleh, et al.
Published: (2024)

5G LDPC Linear Transformer for Channel Decoding
by: Hernandez, Mario, et al.
Published: (2025)

Generative Actor-Critic with Soft Bridge Policies
by: He, Ke, et al.
Published: (2026)

Channel-Feedback-Free Transmission for Downlink FD-RAN: A Radio Map based Complex-valued Precoding Network Approach
by: Zhao, Jiwei, et al.
Published: (2023)

Information-Theoretic Generalization Bounds for Deep Neural Networks
by: He, Haiyun, et al.
Published: (2024)

Beam-aware Kernelized Contextual Bandits for User Association and Beamforming in mmWave Vehicular Networks
by: He, Xiaoyang, et al.
Published: (2026)

On the Generalization of Knowledge Distillation: An Information-Theoretic View
by: Li, Bingying, et al.
Published: (2026)

A PAC-Bayesian Analysis of Channel-Induced Degradation in Edge Inference
by: He, Yangshuo, et al.
Published: (2026)

Deep-Unfolded Massive Grant-Free Transmission in Cell-Free Wireless Communication Systems
by: Sun, Gangle, et al.
Published: (2025)

SCA-LLM: Spectral-Attentive LLM-Based Wireless World Modeling for Agentic Communications
by: He, Ke, et al.
Published: (2025)

Learning Algorithm Generalization Error Bounds via Auxiliary Distributions
by: Aminian, Gholamali, et al.
Published: (2022)

A Unified Fractional Regularization Framework for Sparse Recovery
by: Zhao, Yinhao, et al.
Published: (2026)

Deep Semantic Inference over the Air: An Efficient Task-Oriented Communication System
by: Wang, Chenyang, et al.
Published: (2025)