Copertina

White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Yu, Yaodong, Buchanan, Sam, Pai, Druv, Chu, Tianzhe, Wu, Ziyang, Tong, Shengbang, Bai, Hao, Zhai, Yuexiang, Haeffele, Benjamin D., Ma, Yi
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning Computation and Language Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Masked Completion via Structured Diffusion with White-Box Transformers
di: Pai, Druv, et al.
Pubblicazione: (2024)

Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models
di: Chu, Tianzhe, et al.
Pubblicazione: (2023)

Scaling White-Box Transformers for Vision
di: Yang, Jinrui, et al.
Pubblicazione: (2024)

Token Statistics Transformer: Linear-Time Attention via Variational Rate Reduction
di: Wu, Ziyang, et al.
Pubblicazione: (2024)

Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
di: Yeh, Chun-Hsiao, et al.
Pubblicazione: (2025)

SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
di: Chu, Tianzhe, et al.
Pubblicazione: (2025)

Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
di: Tong, Shengbang, et al.
Pubblicazione: (2024)

Simplifying DINO via Coding Rate Regularization
di: Wu, Ziyang, et al.
Pubblicazione: (2025)

A Global Geometric Analysis of Maximal Coding Rate Reduction
di: Wang, Peng, et al.
Pubblicazione: (2024)

Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
di: Zhai, Yuexiang, et al.
Pubblicazione: (2024)

On the Edge of Memorization in Diffusion Models
di: Buchanan, Sam, et al.
Pubblicazione: (2025)

Diffusion Transformers with Representation Autoencoders
di: Zheng, Boyang, et al.
Pubblicazione: (2025)

Sparse Transformer for Ultra-sparse Sampled Video Compressive Sensing
di: Cao, Miao, et al.
Pubblicazione: (2025)

Attention-Only Transformers via Unrolled Subspace Denoising
di: Wang, Peng, et al.
Pubblicazione: (2025)

PRISM: Deriving a White-Box Transformer as a Signal-Noise Decomposition Operator via Maximum Coding Rate Reduction
di: Huang, Dongchen
Pubblicazione: (2026)

Connecting Joint-Embedding Predictive Architecture with Contrastive Self-supervised Learning
di: Mo, Shentong, et al.
Pubblicazione: (2024)

Mass-Producing Failures of Multimodal Systems with Language Models
di: Tong, Shengbang, et al.
Pubblicazione: (2023)

Independent and Decentralized Learning in Markov Potential Games
di: Maheshwari, Chinmay, et al.
Pubblicazione: (2022)

Congestion Pricing for Efficiency and Equity: Theory and Applications to the San Francisco Bay Area
di: Maheshwari, Chinmay, et al.
Pubblicazione: (2024)

Learning Hierarchical Sparse Transform Coding for 3DGS Compression
di: Xu, Hao, et al.
Pubblicazione: (2025)

From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models
di: Fang, Irving, et al.
Pubblicazione: (2025)

Motif Channel Opened in a White-Box: Stereo Matching via Motif Correlation Graph
di: Chen, Ziyang, et al.
Pubblicazione: (2024)

White-Box Sensitivity Auditing with Steering Vectors
di: Cyberey, Hannah, et al.
Pubblicazione: (2026)

From Pixels to Feelings: Aligning MLLMs with Human Cognitive Perception of Images
di: Chen, Yiming, et al.
Pubblicazione: (2025)

Adaptive Convolutional Dictionary Network for CT Metal Artifact Reduction
di: Wang, Hong, et al.
Pubblicazione: (2022)

Asymmetric Idiosyncrasies in Multimodal Models
di: Tao, Muzi, et al.
Pubblicazione: (2026)

VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images
di: Zhou, Guanyu, et al.
Pubblicazione: (2026)

Adaptive Stain Normalization for Cross-Domain Medical Histology
di: Xu, Tianyue, et al.
Pubblicazione: (2025)

DeepTutor: Towards Agentic Personalized Tutoring
di: Zhao, Bingxi, et al.
Pubblicazione: (2026)

Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models
di: Nagle, Alliot, et al.
Pubblicazione: (2024)

Temporal Rate Reduction Clustering for Human Motion Segmentation
di: Meng, Xianghan, et al.
Pubblicazione: (2025)

Learning Dual Transformers for All-In-One Image Restoration from a Frequency Perspective
di: Chu, Jie, et al.
Pubblicazione: (2024)

Improving Neuron-level Interpretability with White-box Language Models
di: Bai, Hao, et al.
Pubblicazione: (2024)

ICPC: In-context Prompt Compression with Faster Inference
di: Yu, Ziyang, et al.
Pubblicazione: (2025)

Compression of Voxelized Vector Field Data by Boxes is Hard
di: Zhang, Simon
Pubblicazione: (2025)

1+1>2: A Synergistic Sparse and Low-Rank Compression Method for Large Language Models
di: Zong, Zeliang, et al.
Pubblicazione: (2025)

Scaling Text-to-Image Diffusion Transformers with Representation Autoencoders
di: Tong, Shengbang, et al.
Pubblicazione: (2026)

Towards White Box Deep Learning
di: Satkiewicz, Maciej
Pubblicazione: (2024)

What's in a Prior? Learned Proximal Networks for Inverse Problems
di: Fang, Zhenghan, et al.
Pubblicazione: (2023)

Black-Box Crypto is Useless for Pseudorandom Codes
di: Garg, Sanjam, et al.
Pubblicazione: (2025)