Saved in:
| Main Authors: | Wu, Ziyang, Ding, Tianjiao, Lu, Yifu, Pai, Druv, Zhang, Jingyuan, Wang, Weida, Yu, Yaodong, Ma, Yi, Haeffele, Benjamin D. |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.17810 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
by: Yu, Yaodong, et al.
Published: (2023)
by: Yu, Yaodong, et al.
Published: (2023)
Attention-Only Transformers via Unrolled Subspace Denoising
by: Wang, Peng, et al.
Published: (2025)
by: Wang, Peng, et al.
Published: (2025)
Masked Completion via Structured Diffusion with White-Box Transformers
by: Pai, Druv, et al.
Published: (2024)
by: Pai, Druv, et al.
Published: (2024)
Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models
by: Chu, Tianzhe, et al.
Published: (2023)
by: Chu, Tianzhe, et al.
Published: (2023)
A Global Geometric Analysis of Maximal Coding Rate Reduction
by: Wang, Peng, et al.
Published: (2024)
by: Wang, Peng, et al.
Published: (2024)
Simplifying DINO via Coding Rate Regularization
by: Wu, Ziyang, et al.
Published: (2025)
by: Wu, Ziyang, et al.
Published: (2025)
Scaling White-Box Transformers for Vision
by: Yang, Jinrui, et al.
Published: (2024)
by: Yang, Jinrui, et al.
Published: (2024)
Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs
by: Guo, Tianyu, et al.
Published: (2024)
by: Guo, Tianyu, et al.
Published: (2024)
On the Edge of Memorization in Diffusion Models
by: Buchanan, Sam, et al.
Published: (2025)
by: Buchanan, Sam, et al.
Published: (2025)
Independent and Decentralized Learning in Markov Potential Games
by: Maheshwari, Chinmay, et al.
Published: (2022)
by: Maheshwari, Chinmay, et al.
Published: (2022)
An Overview of Low-Rank Structures in the Training and Adaptation of Large Models
by: Balzano, Laura, et al.
Published: (2025)
by: Balzano, Laura, et al.
Published: (2025)
BLISS: Global Blind Identification of Linear Systems with Sparse Inputs
by: Poe, Kyle, et al.
Published: (2026)
by: Poe, Kyle, et al.
Published: (2026)
Congestion Pricing for Efficiency and Equity: Theory and Applications to the San Francisco Bay Area
by: Maheshwari, Chinmay, et al.
Published: (2024)
by: Maheshwari, Chinmay, et al.
Published: (2024)
Nonconvex Linear System Identification with Minimal State Representation
by: Tadipatri, Uday Kiran Reddy, et al.
Published: (2025)
by: Tadipatri, Uday Kiran Reddy, et al.
Published: (2025)
Measurement-Efficient Variational Quantum Linear Solver for Carleman-Linearized Nonlinear Dynamics
by: Liu, Yunya, et al.
Published: (2026)
by: Liu, Yunya, et al.
Published: (2026)
Joint Chance-constrained Game for Coordinating Renewable Microgrids with Service Delivery Risk: A Bayesian Optimization Approach
by: Ding, Yifu, et al.
Published: (2023)
by: Ding, Yifu, et al.
Published: (2023)
Consistent Time-of-Flight Depth Denoising via Graph-Informed Geometric Attention
by: Wang, Weida, et al.
Published: (2025)
by: Wang, Weida, et al.
Published: (2025)
Wave Physics-informed Matrix Factorizations
by: Tetali, Harsha Vardhan, et al.
Published: (2023)
by: Tetali, Harsha Vardhan, et al.
Published: (2023)
Ctrl123: Consistent Novel View Synthesis via Closed-Loop Transcription
by: Zhao, Hongxiang, et al.
Published: (2024)
by: Zhao, Hongxiang, et al.
Published: (2024)
Diagonal-Tiled Mixed-Precision Attention for Efficient Low-Bit MXFP Inference
by: Ding, Yifu, et al.
Published: (2026)
by: Ding, Yifu, et al.
Published: (2026)
Variational Linear Attention: Stable Associative Memory for Long-Context Transformers
by: Pandey, Vishal, et al.
Published: (2026)
by: Pandey, Vishal, et al.
Published: (2026)
Efectos de la musicoterapia integrativa en niños y niñas con autismo: un estudio de caso múltiple
by: Tianjiao Ma
Published: (2025)
by: Tianjiao Ma
Published: (2025)
Adaptive Stain Normalization for Cross-Domain Medical Histology
by: Xu, Tianyue, et al.
Published: (2025)
by: Xu, Tianyue, et al.
Published: (2025)
Resi-VidTok: An Efficient and Decomposed Progressive Tokenization Framework for Ultra-Low-Rate and Lightweight Video Transmission
by: Liu, Zhenyu, et al.
Published: (2025)
by: Liu, Zhenyu, et al.
Published: (2025)
A Convex Relaxation Approach to Generalization Analysis for Parallel Positively Homogeneous Networks
by: Tadipatri, Uday Kiran Reddy, et al.
Published: (2024)
by: Tadipatri, Uday Kiran Reddy, et al.
Published: (2024)
BWTA: Accurate and Efficient Binarized Transformer by Algorithm-Hardware Co-design
by: Ding, Yifu, et al.
Published: (2026)
by: Ding, Yifu, et al.
Published: (2026)
Dimension Reduction for Large-Scale Federated Data: Statistical Rate and Asymptotic Inference
by: Shen, Shuting, et al.
Published: (2023)
by: Shen, Shuting, et al.
Published: (2023)
Source data for article "High-throughput single-cell density measurements enable dynamic profiling of immune cell and drug response from patient samples"
by: Wu, Weida
Published: (2025)
by: Wu, Weida
Published: (2025)
On Statistical Rates of Conditional Diffusion Transformers: Approximation, Estimation and Minimax Optimality
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)
Attention Mechanism for LLM-based Agents Dynamic Diffusion under Information Asymmetry
by: Zhang, Yiwen, et al.
Published: (2025)
by: Zhang, Yiwen, et al.
Published: (2025)
MBTSAD: Mitigating Backdoors in Language Models Based on Token Splitting and Attention Distillation
by: Ding, Yidong, et al.
Published: (2025)
by: Ding, Yidong, et al.
Published: (2025)
Parallax: Parameterized Local Linear Attention for Language Modeling
by: Zuo, Yifei, et al.
Published: (2026)
by: Zuo, Yifei, et al.
Published: (2026)
Precipitation Nowcasting Using Diffusion Transformer with Causal Attention
by: Li, ChaoRong, et al.
Published: (2024)
by: Li, ChaoRong, et al.
Published: (2024)
SALAD: Achieve High-Sparsity Attention via Efficient Linear Attention Tuning for Video Diffusion Transformer
by: Fang, Tongcheng, et al.
Published: (2026)
by: Fang, Tongcheng, et al.
Published: (2026)
Neighbor-Aware Token Reduction via Hilbert Curve for Vision Transformers
by: Li, Yunge, et al.
Published: (2025)
by: Li, Yunge, et al.
Published: (2025)
Efficient Real-Time Aircraft ETA Prediction via Feature Tokenization Transformer
by: Huang, Liping, et al.
Published: (2025)
by: Huang, Liping, et al.
Published: (2025)
GT-SNT: A Linear-Time Transformer for Large-Scale Graphs via Spiking Node Tokenization
by: Zhang, Huizhe, et al.
Published: (2025)
by: Zhang, Huizhe, et al.
Published: (2025)
Purify Unlearnable Examples via Rate-Constrained Variational Autoencoders
by: Yu, Yi, et al.
Published: (2024)
by: Yu, Yi, et al.
Published: (2024)
MHLA: Restoring Expressivity of Linear Attention via Token-Level Multi-Head
by: Zhang, Kewei, et al.
Published: (2026)
by: Zhang, Kewei, et al.
Published: (2026)
VORTA: Efficient Video Diffusion via Routing Sparse Attention
by: Sun, Wenhao, et al.
Published: (2025)
by: Sun, Wenhao, et al.
Published: (2025)
Similar Items
-
White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
by: Yu, Yaodong, et al.
Published: (2023) -
Attention-Only Transformers via Unrolled Subspace Denoising
by: Wang, Peng, et al.
Published: (2025) -
Masked Completion via Structured Diffusion with White-Box Transformers
by: Pai, Druv, et al.
Published: (2024) -
Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models
by: Chu, Tianzhe, et al.
Published: (2023) -
A Global Geometric Analysis of Maximal Coding Rate Reduction
by: Wang, Peng, et al.
Published: (2024)