Imagen de Portada

Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lee, Jungi, Lee, Wonbeom, Sim, Jaewoong
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Hardware Architecture
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MX+: Pushing the Limits of Microscaling Formats for Efficient Large Language Model Serving
por: Lee, Jungi, et al.
Publicado: (2025)

MoNDE: Mixture of Near-Data Experts for Large-Scale Sparse Models
por: Kim, Taehyun, et al.
Publicado: (2024)

GRTX: Efficient Ray Tracing for 3D Gaussian-Based Rendering
por: Lee, Junseo, et al.
Publicado: (2026)

InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management
por: Lee, Wonbeom, et al.
Publicado: (2024)

Pimba: A Processing-in-Memory Acceleration for Post-Transformer Large Language Model Serving
por: Kim, Wonung, et al.
Publicado: (2025)

Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores
por: Ma, Shaobo, et al.
Publicado: (2024)

GFormer: Accelerating Large Language Models with Optimized Transformers on Gaudi Processors
por: Zhang, Chengming, et al.
Publicado: (2024)

Large Language Model Inference Acceleration: A Comprehensive Hardware Perspective
por: Li, Jinhao, et al.
Publicado: (2024)

SCRec: A Scalable Computational Storage System with Statistical Sharding and Tensor-train Decomposition for Recommendation Models
por: Yang, Jinho, et al.
Publicado: (2025)

GPT4AIGChip: Towards Next-Generation AI Accelerator Design Automation via Large Language Models
por: Fu, Yonggan, et al.
Publicado: (2023)

Accelerating Neural Networks for Large Language Models and Graph Processing with Silicon Photonics
por: Afifi, Salma, et al.
Publicado: (2024)

AI Accelerators for Large Language Model Inference: Architecture Analysis and Scaling Strategies
por: Sharma, Amit
Publicado: (2025)

Accelerating Sparse Graph Neural Networks with Tensor Core Optimization
por: Wu, Ka Wai
Publicado: (2024)

FLAASH: Flexible Accelerator Architecture for Sparse High-Order Tensor Contraction
por: Kulp, Gabriel, et al.
Publicado: (2024)

Memory Is All You Need: An Overview of Compute-in-Memory Architectures for Accelerating Large Language Model Inference
por: Wolters, Christopher, et al.
Publicado: (2024)

InstantFT: An FPGA-Based Runtime Subsecond Fine-tuning of CNN Models
por: Sugiura, Keisuke, et al.
Publicado: (2025)

Token-Picker: Accelerating Attention in Text Generation with Minimized Memory Transfer via Probability Estimation
por: Park, Junyoung, et al.
Publicado: (2024)

Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System
por: Jang, Hongsun, et al.
Publicado: (2024)

A Runtime-Adaptive Transformer Neural Network Accelerator on FPGAs
por: Kabir, Ehsan, et al.
Publicado: (2024)

Duplex: A Device for Large Language Models with Mixture of Experts, Grouped Query Attention, and Continuous Batching
por: Yun, Sungmin, et al.
Publicado: (2024)

LLM-Aided Compilation for Tensor Accelerators
por: Hong, Charles, et al.
Publicado: (2024)

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design
por: You, Haoran, et al.
Publicado: (2021)

Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications
por: Li, Yang, et al.
Publicado: (2024)

LEGO: Spatial Accelerator Generation and Optimization for Tensor Applications
por: Lin, Yujun, et al.
Publicado: (2025)

TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning
por: Shen, Chaoyao, et al.
Publicado: (2026)

OPAL: Outlier-Preserved Microscaling Quantization Accelerator for Generative Large Language Models
por: Koo, Jahyun, et al.
Publicado: (2024)

LLM-USO: Large Language Model-based Universal Sizing Optimizer
por: S, Karthik Somayaji N., et al.
Publicado: (2025)

EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture
por: Duan, Bowen, et al.
Publicado: (2026)

SNIP: An Adaptive Mixed Precision Framework for Subbyte Large Language Model Training
por: Pan, Yunjie, et al.
Publicado: (2026)

Accelerating Diffusion Models for Generative AI Applications with Silicon Photonics
por: Suresh, Tharini, et al.
Publicado: (2026)

Periodic Online Testing for Sparse Systolic Tensor Arrays
por: Peltekis, Christodoulos, et al.
Publicado: (2025)

Memory Access Characterization of Large Language Models in CPU Environment and its Potential Impacts
por: Banasik, Spencer
Publicado: (2025)

LLM4DV: Using Large Language Models for Hardware Test Stimuli Generation
por: Zhang, Zixi, et al.
Publicado: (2023)

ITERA-LLM: Boosting Sub-8-Bit Large Language Model Inference via Iterative Tensor Decomposition
por: Zheng, Keran, et al.
Publicado: (2025)

DOSA: Differentiable Model-Based One-Loop Search for DNN Accelerators
por: Hong, Charles, et al.
Publicado: (2025)

ESACT: An End-to-End Sparse Accelerator for Compute-Intensive Transformers via Local Similarity
por: Liu, Hongxiang, et al.
Publicado: (2025)

PASCAL: A Phase-Aware Scheduling Algorithm for Serving Reasoning-based Large Language Models
por: Cho, Eunyeong, et al.
Publicado: (2026)

A Hardware-Aware, Per-Layer Methodology for Post-Training Quantization of Large Language Models
por: Killian, Earl
Publicado: (2026)

ReducedLUT: Table Decomposition with "Don't Care" Conditions
por: Cassidy, Oliver, et al.
Publicado: (2024)

APT-LLM: Exploiting Arbitrary-Precision Tensor Core Computing for LLM Acceleration
por: Ma, Shaobo, et al.
Publicado: (2025)