Cover Image

T-REX: A 68-567 μs/token, 0.41-3.95 μJ/token Transformer Accelerator with Reduced External Memory Access and Enhanced Hardware Utilization in 16nm FinFET

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Moon, Seunghyun, Li, Mao, Chen, Gregory, Knag, Phil, Krishnamurthy, Ram, Seok, Mingoo
Format:	Preprint
Published:	2025
Subjects:	Hardware Architecture Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Enhanced LPDDR4X PHY in 12 nm FinFET
by: Feldmann, Johannes, et al.
Published: (2025)

A 28nm 0.22μJ/token memory-compute-intensity-aware CNN-Transformer accelerator with hybrid-attention-based layer-fusion and cascaded pruning for semantic-segmentation
by: Dong, Pingcheng, et al.
Published: (2025)

The Impact of Temperature Variations on the Electrical Performance of SOI FinFET Devices
by: Haifa Bahri, et al.
Published: (2025)

Energy-efficient SNN Architecture using 3nm FinFET Multiport SRAM-based CIM with Online Learning
by: Huijbregts, Lucas, et al.
Published: (2024)

Amplitude of Random Telegraph Noise in Junctionless FinFET with Different Channel Shape
by: Atamuratov, Atabek E., et al.
Published: (2024)

Self-heating effect in nanoscale SOI Junctionless FinFET with different geometries
by: Atamuratov, A. E., et al.
Published: (2024)

The Influence of Fin Shape on the Amplitude of Random Telegraph Noise in the Subthreshold Regime of a Junctionless FinFET
by: Khalilloev, M. M., et al.
Published: (2024)

Simulation of single hole spin qubit in strained triangular FinFET quantum devices
by: Bouquet, Ilan, et al.
Published: (2025)

Energy‐Dependent Proton‐Induced Single‐Event Upsets in 16‐nm Bulk FinFET D Flip‐Flops: Mechanisms and Layout Impacts
by: Lili Zhang, et al.
Published: (2026)

Single-token vs Two-token Blockchain Tokenomics
by: Kiayias, Aggelos, et al.
Published: (2024)

On girth and the parameterized complexity of token sliding and token jumping
by: Bartier, Valentin, et al.
Published: (2020)

A FinFET‐Based Low‐Power Static Random Access Memory Cell With Improved Stability
by: Gautam Rana, et al.
Published: (2024)

Fast-Locking and High-Resolution Mixed-Mode DLL with Binary Search and Clock Failure Detection for Wide Frequency Ranges in 3-nm FinFET CMOS
by: Wainstein, Nicolás, et al.
Published: (2025)

Not all tokens are needed(NAT): token efficient reinforcement learning
by: Sang, Hejian, et al.
Published: (2026)

OSFFET v9 BPD Turbo: A Simplified, High-Performance Post-FinFET Transistor Architecture
by: Alhajj, Abbas
Published: (2025)

PALTO: Physics-Informed Active Learning for Tri-Gate FinFET Design Optimization for Vertical Power Delivery
by: Sadeghi, Ayoub, et al.
Published: (2026)

First Demonstration of HZO/beta-Ga2O3 Ferroelectric FinFET with Improved Memory Window
by: Park, Seohyeon, et al.
Published: (2024)

Ultra-Low-Power Spiking Neurons in 7 nm FinFET Technology: A Comparative Analysis of Leaky Integrate-and-Fire, Morris-Lecar, and Axon-Hillock Architectures
by: Larsh, Logan, et al.
Published: (2025)

Low power and noise‐immune 9 T compute SRAM cell design based on differential power generator and Schmitt‐trigger logics with14 nm FinFET technology
by: Pushkar Praveen, et al.
Published: (2024)

On token signed graphs
by: Dalfó, C., et al.
Published: (2024)

On two algebras of token graphs
by: Reyes, M. A., et al.
Published: (2024)

Where is the signal in tokenization space?
by: Geh, Renato Lui, et al.
Published: (2024)

Looking beyond the next token
by: Thankaraj, Abitha, et al.
Published: (2025)

Physics in Next-token Prediction
by: An, Hongjun, et al.
Published: (2024)

A study on token digraphs
by: Fernandes, Cristina G., et al.
Published: (2024)

The pitfalls of next-token prediction
by: Bachmann, Gregor, et al.
Published: (2024)

The Limits of Data Scaling: Sub-token Utilization and Acoustic Saturation in Multilingual ASR
by: Liang, Siyu, et al.
Published: (2025)

Behavioral economic analysis of pigeons' token accumulation and reinforcer demand in a laboratory‐based token economy
by: Haoran Wan, et al.
Published: (2026)

Comparison of Autoencoders for tokenization of ASL datasets
by: Praun-Petrovic, Vouk, et al.
Published: (2025)

Edge-transitive token graphs as covers
by: Gómez-Galicia, Sergio G., et al.
Published: (2025)

Practical quantum tokens: challenges and perspectives
by: Kukharchyk, Nadezhda P., et al.
Published: (2026)

Occamy: A 432-Core Dual-Chiplet Dual-HBM2E 768-DP-GFLOP/s RISC-V System for 8-to-64-bit Dense and Sparse Computing in 12nm FinFET
by: Scheffler, Paul, et al.
Published: (2025)

AnomaLLMy -- Detecting anomalous tokens in black-box LLMs through low-confidence single-token predictions
by: Witold, Waligóra
Published: (2024)

A general method to find the spectrum and eigenspaces of the $k$-token of a cycle, and 2-token through continuous fractions
by: Reyes, M. A., et al.
Published: (2024)

Shaping capabilities with token-level data filtering
by: Rathi, Neil, et al.
Published: (2026)

Unified token representations for sequential decision models
by: Tian, Zhuojing, et al.
Published: (2025)

The structure of the token space for large language models
by: Robinson, Michael, et al.
Published: (2024)

Probing the topology of the space of tokens with structured prompts
by: Robinson, Michael, et al.
Published: (2025)

Not all tokens contribute equally to diffusion learning
by: Zhang, Guoqing, et al.
Published: (2026)

Why do LLMs attend to the first token?
by: Barbero, Federico, et al.
Published: (2025)