Image de couverture de livre

3D Optimization for AI Inference Scaling: Balancing Accuracy, Cost, and Latency

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jung, Minseok, Ricky, Abhas, Chatni, Muhammad Rameez
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

RAS: Reflection-Augmented Scaling with In-Context Learning for Executable Cypher Query Generation
par: Jung, Minseok, et autres
Publié: (2026)

ALADIN: Accuracy-Latency-Aware Design-space Inference Analysis for Embedded AI Accelerators
par: Baldi, T., et autres
Publié: (2026)

Hardware Aware Ensemble Selection for Balancing Predictive Accuracy and Cost
par: Maier, Jannis, et autres
Publié: (2024)

Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency
par: Husom, Erik Johannes, et autres
Publié: (2025)

MolPaQ: Modular Quantum-Classical Patch Learning for Interpretable Molecular Generation
par: Naqvi, Syed Rameez, et autres
Publié: (2026)

OCCAM: Towards Cost-Efficient and Accuracy-Aware Classification Inference
par: Ding, Dujian, et autres
Publié: (2024)

Win Fast or Lose Slow: Balancing Speed and Accuracy in Latency-Sensitive Decisions of LLMs
par: Kang, Hao, et autres
Publié: (2025)

Inference Optimization of Foundation Models on AI Accelerators
par: Park, Youngsuk, et autres
Publié: (2024)

Trading-off Accuracy and Communication Cost in Federated Learning
par: Villani, Mattia Jacopo, et autres
Publié: (2025)

Hybrid JIT-CUDA Graph Optimization for Low-Latency Large Language Model Inference
par: Yadav, Divakar Kumar, et autres
Publié: (2026)

CEGI: Measuring the trade-off between efficiency and carbon emissions for SLMs and VLMs
par: Kumar, Abhas, et autres
Publié: (2024)

Sensor Calibration Model Balancing Accuracy, Real-time, and Efficiency
par: Yun, Jinyong, et autres
Publié: (2025)

Scalable AI Inference: Performance Analysis and Optimization of AI Model Serving
par: Pham, Hung Cuong, et autres
Publié: (2026)

Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving
par: Weng, Qitao, et autres
Publié: (2026)

Memory- and Latency-Constrained Inference of Large Language Models via Adaptive Split Computing
par: Sung, Mingyu, et autres
Publié: (2025)

SLM Meets LLM: Balancing Latency, Interpretability and Consistency in Hallucination Detection
par: Hu, Mengya, et autres
Publié: (2024)

Balancing Coverage and Draft Latency in Vocabulary Trimming for Faster Speculative Decoding
par: Shoham, Ofir Ben
Publié: (2026)

Outcome-Aware Tool Selection for Semantic Routers: Latency-Constrained Learning Without LLM Inference
par: Chen, Huamin, et autres
Publié: (2026)

Research on Low-Latency Inference and Training Efficiency Optimization for Graph Neural Network and Large Language Model-Based Recommendation Systems
par: Zhao, Yushang, et autres
Publié: (2025)

Carbon Intensity-Aware Adaptive Inference of DNNs
par: Jung, Jiwan
Publié: (2024)

Agent JIT Compilation for Latency-Optimizing Web Agent Planning and Scheduling
par: Winston, Caleb, et autres
Publié: (2026)

Inference Energy and Latency in AI-Mediated Education: A Learning-per-Watt Analysis of Edge and Cloud Models
par: Khemani, Kushal
Publié: (2026)

Difficulty-aware Balancing Margin Loss for Long-tailed Recognition
par: Son, Minseok, et autres
Publié: (2024)

Flow Matching on General Geometries
par: Chen, Ricky T. Q., et autres
Publié: (2023)

LiteVLM: A Low-Latency Vision-Language Model Inference Pipeline for Resource-Constrained Environments
par: Huang, Jin, et autres
Publié: (2025)

MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale Deployment
par: Huang, Hanxian, et autres
Publié: (2026)

Optimizing Travel Itineraries with AI Algorithms in a Microservices Architecture: Balancing Cost, Time, Preferences, and Sustainability
par: Barua, Biman, et autres
Publié: (2024)

Enhancing Financial VQA in Vision Language Models using Intermediate Structured Representations
par: Srivastava, Archita, et autres
Publié: (2025)

Balancing Fairness and Accuracy in Data-Restricted Binary Classification
par: Lazri, Zachary McBride, et autres
Publié: (2024)

Acceleration of Grokking in Learning Arithmetic Operations via Kolmogorov-Arnold Representation
par: Park, Yeachan, et autres
Publié: (2024)

How Ensemble Learning Balances Accuracy and Overfitting: A Bias-Variance Perspective on Tabular Data
par: Mohammad, Zubair Ahmed
Publié: (2025)

Beyond Synthetic Augmentation: Group-Aware Threshold Calibration for Robust Balanced Accuracy in Imbalanced Learning
par: Gittlin, Hunter
Publié: (2025)

Balancing Fairness, Privacy, and Accuracy: A Multitask Adversarial Framework for Centralized Data-Driven Systems
par: Ekanayake, Imesh, et autres
Publié: (2026)

Balancing Graph Embedding Smoothness in Self-Supervised Learning via Information-Theoretic Decomposition
par: Jung, Heesoo, et autres
Publié: (2025)

Pyramid MoA: A Probabilistic Framework for Cost-Optimized Anytime Inference
par: Khaled, Arindam
Publié: (2026)

QPART: Adaptive Model Quantization and Dynamic Workload Balancing for Accuracy-aware Edge Inference
par: Li, Xiangchen, et autres
Publié: (2025)

$S^3$: Stratified Scaling Search for Test-Time in Diffusion Language Models
par: Bilal, Ahsan, et autres
Publié: (2026)

Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency
par: Li, Ruixiao, et autres
Publié: (2025)

Dynamic LLM Routing and Selection based on User Preferences: Balancing Performance, Cost, and Ethics
par: Piskala, Deepak Babu, et autres
Publié: (2025)

GAS: Enhancing Reward-Cost Balance of Generative Model-assisted Offline Safe RL
par: Liu, Zifan, et autres
Publié: (2026)