Combating the Memory Walls: Optimization Pathways for Long-Context Agentic LLM Inference
Fuente:
arXiv
Guardado en:
| Autores principales: | Wu, Haoran, Xiao, Can, Nie, Jiayi, Guo, Xuan, Lou, Binglei, Wong, Jeffrey T. H., Mo, Zhiwen, Zhang, Cheng, Forys, Przemyslaw, Ai, Chengyang, Adeniran, Timi, Luk, Wayne, Fan, Hongxiang, Cheng, Jianyi, Jones, Timothy M., Antonova, Rika, Mullins, Robert, Zhao, Aaron |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
MemExplorer: Navigating the Heterogeneous Memory Design Space for Agentic Inference NPUs
por: Wu, Haoran, et al.
Publicado: (2026)
por: Wu, Haoran, et al.
Publicado: (2026)
KernelCraft: Benchmarking for Agentic Close-to-Metal Kernel Generation on Emerging Hardware
por: Nie, Jiayi, et al.
Publicado: (2026)
por: Nie, Jiayi, et al.
Publicado: (2026)
NPU Design for Diffusion Language Model Inference
por: Lou, Binglei, et al.
Publicado: (2026)
por: Lou, Binglei, et al.
Publicado: (2026)
ASPO: Constraint-Aware Bayesian Optimization for FPGA-based Soft Processors
por: Wu, Haoran, et al.
Publicado: (2025)
por: Wu, Haoran, et al.
Publicado: (2025)
FastTTS: Accelerating Test-Time Scaling for Edge LLM Reasoning
por: Chen, Hao Mark, et al.
Publicado: (2025)
por: Chen, Hao Mark, et al.
Publicado: (2025)
DiffCloud: Real-to-Sim from Point Clouds with Differentiable Simulation and Rendering of Deformable Objects
por: Sundaresan, Priya, et al.
Publicado: (2022)
por: Sundaresan, Priya, et al.
Publicado: (2022)
Enhancing LLM-based Quantum Code Generation with Multi-Agent Optimization and Quantum Error Correction
por: Campbell, Charlie, et al.
Publicado: (2025)
por: Campbell, Charlie, et al.
Publicado: (2025)
Deep Kernel Fusion for Transformers
por: Zhang, Zixi, et al.
Publicado: (2026)
por: Zhang, Zixi, et al.
Publicado: (2026)
Dynamic Expert Sharing: Decoupling Memory from Parallelism in Mixture-of-Experts Diffusion LLMs
por: Chen, Hao Mark, et al.
Publicado: (2026)
por: Chen, Hao Mark, et al.
Publicado: (2026)
Refining Datapath for Microscaling ViTs
por: Xiao, Can, et al.
Publicado: (2025)
por: Xiao, Can, et al.
Publicado: (2025)
Accelerating MRI Uncertainty Estimation with Mask-based Bayesian Neural Network
por: Zhang, Zehuan, et al.
Publicado: (2024)
por: Zhang, Zehuan, et al.
Publicado: (2024)
Low-Latency FPGA Control System for Real-Time Neural Network Processing in CCD-Based Trapped-Ion Qubit Measurement
por: Lou, Binglei, et al.
Publicado: (2025)
por: Lou, Binglei, et al.
Publicado: (2025)
Group Policy Gradient
por: Chen, Junhua, et al.
Publicado: (2025)
por: Chen, Junhua, et al.
Publicado: (2025)
Enhancing Trustworthiness with Mixed Precision: Benchmarks, Opportunities, and Challenges
por: Lu, Guanxi, et al.
Publicado: (2025)
por: Lu, Guanxi, et al.
Publicado: (2025)
Hardware-Aware Neural Dropout Search for Reliable Uncertainty Prediction on FPGA
por: Zhang, Zehuan, et al.
Publicado: (2024)
por: Zhang, Zehuan, et al.
Publicado: (2024)
Enhancing LUT-based Deep Neural Networks Inference through Architecture and Connectivity Optimization
por: Lou, Binglei, et al.
Publicado: (2026)
por: Lou, Binglei, et al.
Publicado: (2026)
SparseLUT: Sparse Connectivity Optimization for Lookup Table-based Deep Neural Networks
por: Lou, Binglei, et al.
Publicado: (2025)
por: Lou, Binglei, et al.
Publicado: (2025)
TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks
por: Shen, Hanzhang, et al.
Publicado: (2026)
por: Shen, Hanzhang, et al.
Publicado: (2026)
Information Literacy Program for Student Athletes at the University of Iowa.
por: Forys, Marsha, et al.
Publicado: (2000)
por: Forys, Marsha, et al.
Publicado: (2000)
FW-Merging: Scaling Model Merging with Frank-Wolfe Optimization
por: Chen, Hao Mark, et al.
Publicado: (2025)
por: Chen, Hao Mark, et al.
Publicado: (2025)
MetaML-Pro: Cross-Stage Design Flow Automation for Efficient Deep Learning Acceleration
por: Que, Zhiqiang, et al.
Publicado: (2025)
por: Que, Zhiqiang, et al.
Publicado: (2025)
Enthuse: Efficient Adaptable High-throughput Streaming Aggregation Engines
por: Papaphilippou, Philippos, et al.
Publicado: (2024)
por: Papaphilippou, Philippos, et al.
Publicado: (2024)
DeepStack: Scalable and Accurate Design Space Exploration for Distributed 3D-Stacked AI Accelerators
por: Mo, Zhiwen, et al.
Publicado: (2026)
por: Mo, Zhiwen, et al.
Publicado: (2026)
BGC_DB
por: Wang, Binglei
Publicado: (2026)
por: Wang, Binglei
Publicado: (2026)
Maize root metagenome project part4
por: Wang, Binglei
Publicado: (2025)
por: Wang, Binglei
Publicado: (2025)
Deformable Cargo Transport in Microgravity with Astrobee
por: Morton, Daniel, et al.
Publicado: (2025)
por: Morton, Daniel, et al.
Publicado: (2025)
Children of the Creator's Words: The Great Mystery
por: Akinlembola, Adeniran
Publicado: (2026)
por: Akinlembola, Adeniran
Publicado: (2026)
A anquilose tíbio-társica e sua importância na insuficiência venosa crônica
por: Jorge Ribas Timi
Publicado: (2009)
por: Jorge Ribas Timi
Publicado: (2009)
Simplified model of immunotherapy for glioblastoma multiforme: cancer stem cells hypothesis perspective
por: Jochymczyk, Wiktor, et al.
Publicado: (2025)
por: Jochymczyk, Wiktor, et al.
Publicado: (2025)
fSEAD: a Composable FPGA-based Streaming Ensemble Anomaly Detection Library
por: Lou, Binglei, et al.
Publicado: (2024)
por: Lou, Binglei, et al.
Publicado: (2024)
Versatile Cross-platform Compilation Toolchain for Schrödinger-style Quantum Circuit Simulation
por: Lu, Yuncheng, et al.
Publicado: (2025)
por: Lu, Yuncheng, et al.
Publicado: (2025)
Bibliometrics of Computer Science Literature in Nigeria.
por: Adeniran, O. R.
Publicado: (1988)
por: Adeniran, O. R.
Publicado: (1988)
Small Can Be Beautiful: Automation Efforts at the Nigerian Institute of International Affairs Library.
por: Adeniran, O. R.
Publicado: (1992)
por: Adeniran, O. R.
Publicado: (1992)
Enhancing Dropout-based Bayesian Neural Networks with Multi-Exit on FPGA
por: Chen, Hao Mark, et al.
Publicado: (2024)
por: Chen, Hao Mark, et al.
Publicado: (2024)
Metric mean dimension of irregular sets for maps with shadowing
por: Foryś-Krawiec, Magdalena, et al.
Publicado: (2022)
por: Foryś-Krawiec, Magdalena, et al.
Publicado: (2022)
Learning spatial hearing via innate mechanisms
por: Chu, Yang, et al.
Publicado: (2020)
por: Chu, Yang, et al.
Publicado: (2020)
Scalable Time-Series Causal Discovery with Approximate Causal Ordering
por: Jiao, Ziyang, et al.
Publicado: (2024)
por: Jiao, Ziyang, et al.
Publicado: (2024)
Robust Time Series Causal Discovery for Agent-Based Model Validation
por: Yu, Gene, et al.
Publicado: (2024)
por: Yu, Gene, et al.
Publicado: (2024)
VCDF: A Validated Consensus-Driven Framework for Time Series Causal Discovery
por: Yu, Gene, et al.
Publicado: (2026)
por: Yu, Gene, et al.
Publicado: (2026)
The Algorithm of Affluence: Digital Media, Spectacular Wealth, and the Transformation of Work Ethic in Nigeria's Public Sphere
por: Dr Oyindoubra Timi-Wood
Publicado: (2026)
por: Dr Oyindoubra Timi-Wood
Publicado: (2026)
Ejemplares similares
-
MemExplorer: Navigating the Heterogeneous Memory Design Space for Agentic Inference NPUs
por: Wu, Haoran, et al.
Publicado: (2026) -
KernelCraft: Benchmarking for Agentic Close-to-Metal Kernel Generation on Emerging Hardware
por: Nie, Jiayi, et al.
Publicado: (2026) -
NPU Design for Diffusion Language Model Inference
por: Lou, Binglei, et al.
Publicado: (2026) -
ASPO: Constraint-Aware Bayesian Optimization for FPGA-based Soft Processors
por: Wu, Haoran, et al.
Publicado: (2025) -
FastTTS: Accelerating Test-Time Scaling for Edge LLM Reasoning
por: Chen, Hao Mark, et al.
Publicado: (2025)