Cover Image

On Exact Bit-level Reversible Transformers Without Changing Architectures

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Guoqiang, Lewis, J. P., Kleijn, W. B.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Lookahead Drifting Model
by: Zhang, Guoqiang, et al.
Published: (2026)

Exact, Tractable Gauss-Newton Optimization in Deep Reversible Architectures Reveal Poor Generalization
by: Buffelli, Davide, et al.
Published: (2024)

Normalized Architectures are Natively 4-Bit
by: Fishman, Maxim, et al.
Published: (2026)

SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs
by: Song, Jaewoo, et al.
Published: (2025)

Comprehension Without Competence: Architectural Limits of LLMs in Symbolic Computation and Reasoning
by: Zhang, Zheng
Published: (2025)

Safe Transformer: An Explicit Safety Bit For Interpretable And Controllable Alignment
by: Feng, Jingyuan, et al.
Published: (2026)

Are Transformers More Robust? Towards Exact Robustness Verification for Transformers
by: Liao, Brian Hsuan-Cheng, et al.
Published: (2022)

Random Cloud: Finding Minimal Neural Architectures Without Training
by: Blázquez, Javier Gil
Published: (2026)

Exact Attention Sensitivity and the Geometry of Transformer Stability
by: Emadi, Seyed Morteza
Published: (2026)

On Limitations of the Transformer Architecture
by: Peng, Binghui, et al.
Published: (2024)

Every Bit Counts: A Theoretical Study of Precision-Expressivity Tradeoffs in Quantized Transformers
by: Chakrabarti, Sayak, et al.
Published: (2026)

N-vium: Mixture-of-Exits Transformer for Accelerated Exact Generation
by: Lorenc, Aleksander, et al.
Published: (2026)

Architecture Determines Observability of Transformers
by: Carmichael, Thomas
Published: (2026)

Human-aligned Chess with a Bit of Search
by: Zhang, Yiming, et al.
Published: (2024)

Emergency Preemption Without Online Exploration: A Decision Transformer Approach
by: Su, Haoran, et al.
Published: (2026)

Vertex-Softmax: Tight Transformer Verification via Exact Softmax Optimization
by: Rezazadeh, Navid, et al.
Published: (2026)

Q-Palette: Fractional-Bit Quantizers Toward Optimal Bit Allocation for Efficient LLM Deployment
by: Lee, Deokjae, et al.
Published: (2025)

Finding Clustering Algorithms in the Transformer Architecture
by: Clarkson, Kenneth L., et al.
Published: (2025)

Attn-QAT: 4-Bit Attention With Quantization-Aware Training
by: Zhang, Peiyuan, et al.
Published: (2026)

Tiled Bit Networks: Sub-Bit Neural Network Compression Through Reuse of Learnable Binary Vectors
by: Gorbett, Matt, et al.
Published: (2024)

BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization
by: Zhao, Jiayu, et al.
Published: (2026)

Inner Loop Inference for Pretrained Transformers: Unlocking Latent Capabilities Without Training
by: Lys, Jonathan, et al.
Published: (2026)

ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modeling
by: Zhang, Yuanyun, et al.
Published: (2025)

Impatient Bandits: Optimizing for the Long-Term Without Delay
by: Zhang, Kelly W., et al.
Published: (2025)

Large EEG-U-Transformer for Time-Step Level Detection Without Pre-Training
by: Wu, Kerui, et al.
Published: (2025)

Learning Grouped Lattice Vector Quantizers for Low-Bit LLM Compression
by: Zhang, Xi, et al.
Published: (2025)

Proactive Depot Discovery: A Generative Framework for Flexible Location-Routing
by: Qu, Site, et al.
Published: (2025)

MUC-G4: Minimal Unsat Core-Guided Incremental Verification for Deep Neural Network Compression
by: Li, Jingyang, et al.
Published: (2025)

LittleBit-2: Maximizing the Spectral Energy Gain in Sub-1-Bit LLMs via Latent Geometry Alignment
by: Lee, Banseok, et al.
Published: (2026)

OT-Transformer: A Continuous-time Transformer Architecture with Optimal Transport Regularization
by: Kan, Kelvin, et al.
Published: (2025)

Resource-Efficient Transformer Architecture: Optimizing Memory and Execution Time for Real-Time Applications
by: V, Krisvarish, et al.
Published: (2024)

Why Do Some Inputs Break Low-Bit LLM Quantization?
by: Chang, Ting-Yun, et al.
Published: (2025)

Pushing the Limits of Low-Bit Optimizers: A Focus on EMA Dynamics
by: Xu, Cong, et al.
Published: (2025)

Residual Stream Duality in Modern Transformer Architectures
by: Zhang, Yifan
Published: (2026)

Diagonal-Tiled Mixed-Precision Attention for Efficient Low-Bit MXFP Inference
by: Ding, Yifu, et al.
Published: (2026)

Interpretable-by-Design Transformers via Architectural Stream Independence
by: Kerce, Clayton, et al.
Published: (2026)

A Survey of Graph Transformers: Architectures, Theories and Applications
by: Yuan, Chaohao, et al.
Published: (2025)

RDKV: Rate-Distortion Bit Allocation for Joint Eviction and Quantization of the KV Cache
by: Zhang, Junkai, et al.
Published: (2026)

Permutation-Invariant Transformer Neural Architectures for Set-Based Indoor Localization Using Learned RSSI Embeddings
by: Aristorenas, Aris J.
Published: (2025)

From Bits to Boardrooms: A Cutting-Edge Multi-Agent LLM Framework for Business Excellence
by: Wang, Zihao, et al.
Published: (2025)