Slim Scheduler: A Runtime-Aware RL and Scheduler System for Efficient CNN Inference
Fuente:
arXiv
Guardado en:
| Autores principales: | Harshbarger, Ian, Chidambaram, Calvin |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Prompt-Aware Scheduling for Efficient Text-to-Image Inferencing System
por: Agarwal, Shubham, et al.
Publicado: (2025)
por: Agarwal, Shubham, et al.
Publicado: (2025)
SortedRL: Accelerating RL Training for LLMs through Online Length-Aware Scheduling
por: Zhang, Yiqi, et al.
Publicado: (2026)
por: Zhang, Yiqi, et al.
Publicado: (2026)
AgentSlimming: Towards Efficient and Cost-Aware Multi-Agent Systems
por: Chen, Yulang, et al.
Publicado: (2026)
por: Chen, Yulang, et al.
Publicado: (2026)
ML Inference Scheduling with Predictable Latency
por: Zhao, Haidong, et al.
Publicado: (2025)
por: Zhao, Haidong, et al.
Publicado: (2025)
ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference
por: Oh, Hyungjun, et al.
Publicado: (2024)
por: Oh, Hyungjun, et al.
Publicado: (2024)
Capacity-Aware Planning and Scheduling in Budget-Constrained Multi-Agent MDPs: A Meta-RL Approach
por: Vora, Manav, et al.
Publicado: (2024)
por: Vora, Manav, et al.
Publicado: (2024)
Optimal Inference Schedules for Masked Diffusion Models
por: Chen, Sitan, et al.
Publicado: (2025)
por: Chen, Sitan, et al.
Publicado: (2025)
Semantic Scheduling for LLM Inference
por: Hua, Wenyue, et al.
Publicado: (2025)
por: Hua, Wenyue, et al.
Publicado: (2025)
PecSched: Preemptive and Efficient Cluster Scheduling for LLM Inference
por: Zhang, Zeyu, et al.
Publicado: (2024)
por: Zhang, Zeyu, et al.
Publicado: (2024)
Efficient LLM Scheduling by Learning to Rank
por: Fu, Yichao, et al.
Publicado: (2024)
por: Fu, Yichao, et al.
Publicado: (2024)
Mamba Meets Scheduling: Learning to Solve Flexible Job Shop Scheduling with Efficient Sequence Modeling
por: Cao, Zhi, et al.
Publicado: (2026)
por: Cao, Zhi, et al.
Publicado: (2026)
A Data-Driven Approach to Dataflow-Aware Online Scheduling for Graph Neural Network Inference
por: Puigdemont, Pol, et al.
Publicado: (2024)
por: Puigdemont, Pol, et al.
Publicado: (2024)
CNN-Enabled Scheduling for Probabilistic Real-Time Guarantees in Industrial URLLC
por: Alqudah, Eman, et al.
Publicado: (2025)
por: Alqudah, Eman, et al.
Publicado: (2025)
Heterogeneity-Aware Dataset Scheduling for Efficient Audio Large Language Model Training
por: Wu, Yanru, et al.
Publicado: (2026)
por: Wu, Yanru, et al.
Publicado: (2026)
Priority-Aware Preemptive Scheduling for Mixed-Priority Workloads in MoE Inference
por: Siavashi, Mohammad, et al.
Publicado: (2025)
por: Siavashi, Mohammad, et al.
Publicado: (2025)
Flow-Controlled Scheduling for LLM Inference with Provable Stability Guarantees
por: Dong, Zhuolun, et al.
Publicado: (2026)
por: Dong, Zhuolun, et al.
Publicado: (2026)
Energy-Efficient Scheduling with Predictions
por: Balkanski, Eric, et al.
Publicado: (2024)
por: Balkanski, Eric, et al.
Publicado: (2024)
Throughput-Optimal Scheduling Algorithms for LLM Inference and AI Agents
por: Dai, J. G., et al.
Publicado: (2025)
por: Dai, J. G., et al.
Publicado: (2025)
Duration Aware Scheduling for ASR Serving Under Workload Drift
por: Makwana, Darshan, et al.
Publicado: (2026)
por: Makwana, Darshan, et al.
Publicado: (2026)
Mining--Gym: A Configurable RL Benchmarking Environment for Truck Dispatch Scheduling
por: Banerjee, Chayan, et al.
Publicado: (2025)
por: Banerjee, Chayan, et al.
Publicado: (2025)
LayerScope: Predictive Cross-Layer Scheduling for Efficient Multi-Batch MoE Inference on Legacy Servers
por: Yu, Enda, et al.
Publicado: (2025)
por: Yu, Enda, et al.
Publicado: (2025)
Omni-Thinker: Scaling Multi-Task RL in LLMs with Hybrid Reward and Task Scheduling
por: Li, Derek, et al.
Publicado: (2025)
por: Li, Derek, et al.
Publicado: (2025)
CuAsmRL: Optimizing GPU SASS Schedules via Deep Reinforcement Learning
por: He, Guoliang, et al.
Publicado: (2025)
por: He, Guoliang, et al.
Publicado: (2025)
Hierarchical Online-Scheduling for Energy-Efficient Split Inference with Progressive Transmission
por: Tang, Zengzipeng, et al.
Publicado: (2026)
por: Tang, Zengzipeng, et al.
Publicado: (2026)
RL-MSA: a Reinforcement Learning-based Multi-line bus Scheduling Approach
por: Liu, Yingzhuo
Publicado: (2024)
por: Liu, Yingzhuo
Publicado: (2024)
Adapter-Augmented Bandits for Online Multi-Constrained Multi-Modal Inference Scheduling
por: Zhang, Xianzhi, et al.
Publicado: (2026)
por: Zhang, Xianzhi, et al.
Publicado: (2026)
SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference on Superchips
por: Yu, Jiahuan, et al.
Publicado: (2026)
por: Yu, Jiahuan, et al.
Publicado: (2026)
Online Scheduling for LLM Inference with KV Cache Constraints
por: Jaillet, Patrick, et al.
Publicado: (2025)
por: Jaillet, Patrick, et al.
Publicado: (2025)
Optimal Scheduling Algorithms for LLM Inference: Theory and Practice
por: Bari, Agrim, et al.
Publicado: (2025)
por: Bari, Agrim, et al.
Publicado: (2025)
SeamlessFlow: A Trainer Agent Isolation RL Framework Achieving Bubble-Free Pipelines via Tag Scheduling
por: Wang, Jinghui, et al.
Publicado: (2025)
por: Wang, Jinghui, et al.
Publicado: (2025)
Design and Scheduling of an AI-based Queueing System
por: Lee, Jiung, et al.
Publicado: (2024)
por: Lee, Jiung, et al.
Publicado: (2024)
Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
por: Gao, Shihong, et al.
Publicado: (2025)
por: Gao, Shihong, et al.
Publicado: (2025)
Green Federated Learning via Carbon-Aware Client and Time Slot Scheduling
por: Arputharaj, Daniel Richards, et al.
Publicado: (2025)
por: Arputharaj, Daniel Richards, et al.
Publicado: (2025)
Score-Optimal Diffusion Schedules
por: Williams, Christopher, et al.
Publicado: (2024)
por: Williams, Christopher, et al.
Publicado: (2024)
Adaptive Slimming for Scalable and Efficient Speech Enhancement
por: Miccini, Riccardo, et al.
Publicado: (2025)
por: Miccini, Riccardo, et al.
Publicado: (2025)
LLM-Guided Runtime Parameter Optimization for Energy-Efficient Model Inference
por: Crumpacker, Katelyn, et al.
Publicado: (2026)
por: Crumpacker, Katelyn, et al.
Publicado: (2026)
Data-Rate-Aware High-Speed CNN Inference on FPGAs
por: Habermann, Tobias, et al.
Publicado: (2026)
por: Habermann, Tobias, et al.
Publicado: (2026)
Improving Pattern Recognition of Scheduling Anomalies through Structure-Aware and Semantically-Enhanced Graphs
por: Lyu, Ning, et al.
Publicado: (2025)
por: Lyu, Ning, et al.
Publicado: (2025)
HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference
por: Zhong, Shuzhang, et al.
Publicado: (2025)
por: Zhong, Shuzhang, et al.
Publicado: (2025)
Select Smarter, Not More: Prompt-Aware Evaluation Scheduling with Submodular Guarantees
por: Ma, Xiaoyu, et al.
Publicado: (2026)
por: Ma, Xiaoyu, et al.
Publicado: (2026)
Ejemplares similares
-
Prompt-Aware Scheduling for Efficient Text-to-Image Inferencing System
por: Agarwal, Shubham, et al.
Publicado: (2025) -
SortedRL: Accelerating RL Training for LLMs through Online Length-Aware Scheduling
por: Zhang, Yiqi, et al.
Publicado: (2026) -
AgentSlimming: Towards Efficient and Cost-Aware Multi-Agent Systems
por: Chen, Yulang, et al.
Publicado: (2026) -
ML Inference Scheduling with Predictable Latency
por: Zhao, Haidong, et al.
Publicado: (2025) -
ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference
por: Oh, Hyungjun, et al.
Publicado: (2024)