Saved in:
| Main Authors: | Ye, Zicong, Zhang, Kunming, Tang, Guoming |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.01744 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
AIMeter: Measuring, Analyzing, and Visualizing Energy and Carbon Footprint of AI Workloads
by: Huang, Hongzhen, et al.
Published: (2025)
by: Huang, Hongzhen, et al.
Published: (2025)
GPU-Accelerated Optimization of Transformer-Based Neural Networks for Real-Time Inference
by: Mukherjee, Soutrik, et al.
Published: (2026)
by: Mukherjee, Soutrik, et al.
Published: (2026)
EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization
by: Song, Zhiye, et al.
Published: (2026)
by: Song, Zhiye, et al.
Published: (2026)
Adaptively Robust LLM Inference Optimization under Prediction Uncertainty
by: Chen, Zixi, et al.
Published: (2025)
by: Chen, Zixi, et al.
Published: (2025)
AGFT: Alignment-Guided Fine-Tuning for Zero-Shot Adversarial Robustness of Vision-Language Models
by: Cui, Yubo, et al.
Published: (2026)
by: Cui, Yubo, et al.
Published: (2026)
Tuning the Tuner: Introducing Hyperparameter Optimization for Auto-Tuning
by: Willemsen, Floris-Jan, et al.
Published: (2025)
by: Willemsen, Floris-Jan, et al.
Published: (2025)
SLO-aware GPU Frequency Scaling for Energy Efficient LLM Inference Serving
by: Kakolyris, Andreas Kosmas, et al.
Published: (2024)
by: Kakolyris, Andreas Kosmas, et al.
Published: (2024)
WaveTuner: Comprehensive Wavelet Subband Tuning for Time Series Forecasting
by: Wang, Yubo, et al.
Published: (2025)
by: Wang, Yubo, et al.
Published: (2025)
BandPilot: Towards Performance- and Contention-Aware GPU Dispatching in AI Clusters
by: Zhang, Kunming, et al.
Published: (2025)
by: Zhang, Kunming, et al.
Published: (2025)
Harvest: Opportunistic Peer-to-Peer GPU Caching for LLM Inference
by: Gopal, Nikhil, et al.
Published: (2026)
by: Gopal, Nikhil, et al.
Published: (2026)
ATFNet: Adaptive Time-Frequency Ensembled Network for Long-term Time Series Forecasting
by: Ye, Hengyu, et al.
Published: (2024)
by: Ye, Hengyu, et al.
Published: (2024)
Stepping on the Edge: Curvature Aware Learning Rate Tuners
by: Roulet, Vincent, et al.
Published: (2024)
by: Roulet, Vincent, et al.
Published: (2024)
HGCA: Hybrid GPU-CPU Attention for Long Context LLM Inference
by: Deng, Weishu, et al.
Published: (2025)
by: Deng, Weishu, et al.
Published: (2025)
Challenging GPU Dominance: When CPUs Outperform for On-Device LLM Inference
by: Zhang, Haolin, et al.
Published: (2025)
by: Zhang, Haolin, et al.
Published: (2025)
Performance-driven Constrained Optimal Auto-Tuner for MPC
by: Puigjaner, Albert Gassol, et al.
Published: (2025)
by: Puigjaner, Albert Gassol, et al.
Published: (2025)
Frequency Adaptive Normalization For Non-stationary Time Series Forecasting
by: Ye, Weiwei, et al.
Published: (2024)
by: Ye, Weiwei, et al.
Published: (2024)
Characterizing LLM Inference Energy-Performance Tradeoffs across Workloads and GPU Scaling
by: Maliakel, Paul Joe, et al.
Published: (2025)
by: Maliakel, Paul Joe, et al.
Published: (2025)
Sign-Symmetry Learning Rules are Robust Fine-Tuners
by: Berriche, Aymene, et al.
Published: (2025)
by: Berriche, Aymene, et al.
Published: (2025)
A Selective Quantization Tuner for ONNX Models
by: Louloudakis, Nikolaos, et al.
Published: (2025)
by: Louloudakis, Nikolaos, et al.
Published: (2025)
Toward Robust and Efficient ML-Based GPU Caching for Modern Inference
by: Chen, Peng, et al.
Published: (2025)
by: Chen, Peng, et al.
Published: (2025)
SpecOffload: Unlocking Latent GPU Capacity for LLM Inference on Resource-Constrained Devices
by: Zhuge, Xiangwen, et al.
Published: (2025)
by: Zhuge, Xiangwen, et al.
Published: (2025)
Floe: Federated Specialization for Real-Time LLM-SLM Inference
by: Tian, Chunlin, et al.
Published: (2026)
by: Tian, Chunlin, et al.
Published: (2026)
Scaling On-Device GPU Inference for Large Generative Models
by: Tang, Jiuqiang, et al.
Published: (2025)
by: Tang, Jiuqiang, et al.
Published: (2025)
Accelerating Sparse Transformer Inference on GPU
by: Dai, Wenhao, et al.
Published: (2025)
by: Dai, Wenhao, et al.
Published: (2025)
Inference-Time Alignment of Diffusion Models with Direct Noise Optimization
by: Tang, Zhiwei, et al.
Published: (2024)
by: Tang, Zhiwei, et al.
Published: (2024)
Optimizing Language Models for Inference Time Objectives using Reinforcement Learning
by: Tang, Yunhao, et al.
Published: (2025)
by: Tang, Yunhao, et al.
Published: (2025)
ERGNN: Spectral Graph Neural Network With Explicitly-Optimized Rational Graph Filters
by: Li, Guoming, et al.
Published: (2024)
by: Li, Guoming, et al.
Published: (2024)
DuetServe: Harmonizing Prefill and Decode for LLM Serving via Adaptive GPU Multiplexing
by: Gao, Lei, et al.
Published: (2025)
by: Gao, Lei, et al.
Published: (2025)
SCORPIO: Serving the Right Requests at the Right Time for Heterogeneous SLOs in LLM Inference
by: Tang, Yinghao, et al.
Published: (2025)
by: Tang, Yinghao, et al.
Published: (2025)
FusAD: Time-Frequency Fusion with Adaptive Denoising for General Time Series Analysis
by: Zhang, Da, et al.
Published: (2025)
by: Zhang, Da, et al.
Published: (2025)
DemoTuner: Automatic Performance Tuning for Database Management Systems Based on Demonstration Reinforcement Learning
by: Dou, Hui, et al.
Published: (2025)
by: Dou, Hui, et al.
Published: (2025)
LiteCache: A Query Similarity-Driven, GPU-Centric KVCache Subsystem for Efficient LLM Inference
by: Yi, Jiawei, et al.
Published: (2025)
by: Yi, Jiawei, et al.
Published: (2025)
Confidential LLM Inference: Performance and Cost Across CPU and GPU TEEs
by: Chrapek, Marcin, et al.
Published: (2025)
by: Chrapek, Marcin, et al.
Published: (2025)
Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
by: Recasens, Pol G., et al.
Published: (2025)
by: Recasens, Pol G., et al.
Published: (2025)
Multi-LLM Adaptive Conformal Inference for Reliable LLM Responses
by: Noh, Kangjun, et al.
Published: (2026)
by: Noh, Kangjun, et al.
Published: (2026)
ML$^2$Tuner: Efficient Code Tuning via Multi-Level Machine Learning Models
by: Cha, JooHyoung, et al.
Published: (2024)
by: Cha, JooHyoung, et al.
Published: (2024)
RASP-Tuner: Retrieval-Augmented Soft Prompts for Context-Aware Black-Box Optimization in Non-Stationary Environments
by: Pan, Enze
Published: (2026)
by: Pan, Enze
Published: (2026)
RAP: Runtime Adaptive Pruning for LLM Inference
by: Liu, Huanrong, et al.
Published: (2025)
by: Liu, Huanrong, et al.
Published: (2025)
A Study of Skews, Imbalances, and Pathological Conditions in LLM Inference Deployment on GPU Clusters detectable from DPU
by: Moye, Javed I. Khan an Henry Uwabor
Published: (2025)
by: Moye, Javed I. Khan an Henry Uwabor
Published: (2025)
Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers
by: Maczan, Jędrzej
Published: (2026)
by: Maczan, Jędrzej
Published: (2026)
Similar Items
-
AIMeter: Measuring, Analyzing, and Visualizing Energy and Carbon Footprint of AI Workloads
by: Huang, Hongzhen, et al.
Published: (2025) -
GPU-Accelerated Optimization of Transformer-Based Neural Networks for Real-Time Inference
by: Mukherjee, Soutrik, et al.
Published: (2026) -
EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization
by: Song, Zhiye, et al.
Published: (2026) -
Adaptively Robust LLM Inference Optimization under Prediction Uncertainty
by: Chen, Zixi, et al.
Published: (2025) -
AGFT: Alignment-Guided Fine-Tuning for Zero-Shot Adversarial Robustness of Vision-Language Models
by: Cui, Yubo, et al.
Published: (2026)