Cover Image

On the Spectral Flattening of Quantized Embeddings

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huang, Junlin, Fang, Wenyi, Tang, Zhenheng, Wang, Yuxin, Kang, Xueze, Zheng, Yang, Li, Bo, Chu, Xiaowen
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Bandwidth-Aware and Overlap-Weighted Compression for Communication-Efficient Federated Learning
by: Tang, Zichen, et al.
Published: (2024)

Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression
by: Dong, Peijie, et al.
Published: (2025)

FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression
by: Tang, Zhenheng, et al.
Published: (2024)

Rethinking Deep Research from the Perspective of Web Content Distribution Matching
by: Yu, Zixuan, et al.
Published: (2026)

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models
by: Pan, Xinglin, et al.
Published: (2025)

Reasoning Language Model Inference Serving Unveiled: An Empirical Study
by: Li, Qi, et al.
Published: (2025)

PatternKV: Flattening KV Representation Expands Quantization Headroom
by: Zhang, Ji, et al.
Published: (2025)

The Lottery LLM Hypothesis, Rethinking What Abilities Should LLM Compression Preserve?
by: Tang, Zhenheng, et al.
Published: (2025)

FedImpro: Measuring and Improving Client Update in Federated Learning
by: Tang, Zhenheng, et al.
Published: (2024)

Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models
by: Dong, Peijie, et al.
Published: (2024)

RouteMark: A Fingerprint for Intellectual Property Attribution in Routing-based Model Merging
by: He, Xin, et al.
Published: (2025)

Mediator: Memory-efficient LLM Merging with Less Parameter Conflicts and Uncertainty Based Routing
by: Lai, Kunfeng, et al.
Published: (2025)

FlattenQuant: Breaking Through the Inference Compute-bound for Large Language Models with Per-tensor Quantization
by: Zhang, Yi, et al.
Published: (2024)

FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion
by: Tang, Zhenheng, et al.
Published: (2024)

Spectral Flattening Is All Muon Needs: How Orthogonalization Controls Learning Rate and Convergence
by: Nguyen, Tien-Phat, et al.
Published: (2026)

Dissecting Outlier Dynamics in LLM NVFP4 Pretraining
by: Dong, Peijie, et al.
Published: (2026)

Model Quantization and Hardware Acceleration for Vision Transformers: A Comprehensive Survey
by: Du, Dayou, et al.
Published: (2024)

STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs
by: Dong, Peijie, et al.
Published: (2024)

Flattening Hierarchies with Policy Bootstrapping
by: Zhou, John L., et al.
Published: (2025)

A Mechanism Study of Delayed Loss Spikes in Batch-Normalized Linear Models
by: Gao, Peifeng, et al.
Published: (2026)

Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing
by: Wang, Yuxin, et al.
Published: (2023)

Flatten Graphs as Sequences: Transformers are Scalable Graph Generators
by: Chen, Dexiong, et al.
Published: (2025)

Data-Driven Graph Filters via Adaptive Spectral Shaping
by: Sandfelder, Dylan, et al.
Published: (2026)

Scalable and Adaptive Spectral Embedding for Attributed Graph Clustering
by: Liu, Yunhui, et al.
Published: (2024)

DimGrow: Memory-Efficient Field-level Embedding Dimension Search
by: Huang, Yihong, et al.
Published: (2025)

Spectral Algorithms in Misspecified Regression: Convergence under Covariate Shift
by: Liu, Ren-Rui, et al.
Published: (2025)

Frequency-Guided Action Diffusion via Sub-Frequency Manifold Traversal
by: Wang, Junlin
Published: (2026)

Tree-Regularized Tabular Embeddings
by: Li, Xuan, et al.
Published: (2024)

SEF-MK: Speaker-Embedding-Free Voice Anonymization through Multi-k-means Quantization
by: Tang, Beilong, et al.
Published: (2025)

Stochastic Nonlinear Control via Finite-dimensional Spectral Dynamic Embedding
by: Ren, Zhaolin, et al.
Published: (2023)

Quantizing Text-attributed Graphs for Semantic-Structural Integration
by: Bo, Jianyuan, et al.
Published: (2025)

Theory-optimal Quantization Based on Flatness
by: Huang, Xiusheng, et al.
Published: (2026)

TempoGPT: Enhancing Time Series Reasoning via Quantizing Embedding
by: Zhang, Haochuan, et al.
Published: (2025)

Activity-aware Human Mobility Prediction with Hierarchical Graph Attention Recurrent Network
by: Tang, Yihong, et al.
Published: (2022)

Overcomplete Tensor Decomposition via Koszul-Young Flattenings
by: Kothari, Pravesh K., et al.
Published: (2024)

An Empirical Study of Qwen3 Quantization
by: Zheng, Xingyu, et al.
Published: (2025)

BurstGPT: A Real-world Workload Dataset to Optimize LLM Serving Systems
by: Wang, Yuxin, et al.
Published: (2024)

DreamDDP: Accelerating Data Parallel Distributed LLM Training with Layer-wise Scheduled Partial Synchronization
by: Tang, Zhenheng, et al.
Published: (2025)

LASE: Learned Adjacency Spectral Embeddings
by: Casulo, Sofía Pérez, et al.
Published: (2024)

Generalizable Spectral Embedding with an Application to UMAP
by: Ben-Ari, Nir, et al.
Published: (2025)