Cover Image

Green MLOps: Closed-Loop, Energy-Aware Inference with NVIDIA Triton, FastAPI, and Bio-Inspired Thresholding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hamdi, Mustapha, Jabou, Mourad
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scalable and Secure AI Inference in Healthcare: A Comparative Benchmarking of FastAPI and Triton Inference Server on Kubernetes
by: Ali, Ratul
Published: (2026)

Green MLOps to Green GenOps: An Empirical Study of Energy Consumption in Discriminative and Generative AI Operations
by: Sánchez-Mompó, Adrián, et al.
Published: (2025)

StructuredDNA: A Bio-Physical Framework for Energy-Aware Transformer Routing
by: Hamdi, Mustapha
Published: (2025)

Fast and Simplex: 2-Simplicial Attention in Triton
by: Roy, Aurko, et al.
Published: (2025)

Evaluation of Bio-Inspired Models under Different Learning Settings For Energy Efficiency in Network Traffic Prediction
by: Tsiolakis, Theodoros, et al.
Published: (2024)

BioOSS: A Bio-Inspired Oscillatory State System with Spatio-Temporal Dynamics
by: Yuan, Zhongju, et al.
Published: (2025)

Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach
by: Bayram, Firas, et al.
Published: (2024)

NVIDIA Nemotron 3: Efficient and Open Intelligence
by: NVIDIA, et al.
Published: (2025)

Agents Thinking Fast and Slow: A Talker-Reasoner Architecture
by: Christakopoulou, Konstantina, et al.
Published: (2024)

Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMs
by: Patel, Harsh, et al.
Published: (2024)

Geak: Introducing Triton Kernel AI Agent & Evaluation Benchmarks
by: Wang, Jianghui, et al.
Published: (2025)

Relevance-Aware Thresholding in Online Conformal Prediction for Time Series
by: Dupuy, Théo, et al.
Published: (2025)

Green Prompting: Characterizing Prompt-driven Energy Costs of LLM Inference
by: Adamska, Marta, et al.
Published: (2025)

Energy-Efficient Wireless LLM Inference via Uncertainty and Importance-Aware Speculative Decoding
by: Park, Jihoon, et al.
Published: (2025)

LoopTool: Closing the Data-Training Loop for Robust LLM Tool Calls
by: Zhang, Kangning, et al.
Published: (2025)

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations
by: Liu, Wei, et al.
Published: (2026)

Learning Dynamics of RNNs in Closed-Loop Environments
by: Ger, Yoav, et al.
Published: (2025)

Clover: Closed-Loop Verifiable Code Generation
by: Sun, Chuyue, et al.
Published: (2023)

GreenPlanner: Practical Floorplan Layout Generation via an Energy-Aware and Function-Feasible Generative Framework
by: Zeng, Pengyu, et al.
Published: (2025)

Continual Driving Policy Optimization with Closed-Loop Individualized Curricula
by: Niu, Haoyi, et al.
Published: (2023)

QaRL: Rollout-Aligned Quantization-Aware RL for Fast and Stable Training under Training--Inference Mismatch
by: Gu, Hao, et al.
Published: (2026)

Towards Bio-Inspired Robotic Trajectory Planning via Self-Supervised RNN
by: Cibula, Miroslav, et al.
Published: (2025)

MetaGreen: Meta-Learning Inspired Transformer Selection for Green Semantic Communication
by: Mukherjee, Shubhabrata, et al.
Published: (2024)

FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference
by: Bajpai, Divya Jyoti, et al.
Published: (2025)

Fast Inference for Augmented Large Language Models
by: Shahout, Rana, et al.
Published: (2024)

Predictive Inference With Fast Feature Conformal Prediction
by: Tang, Zihao, et al.
Published: (2024)

Fast Inference of Removal-Based Node Influence
by: Li, Weikai, et al.
Published: (2024)

LLM-AutoSciLab: Closed-Loop Scientific Discovery via Active Experimentation with LLMs
by: Kabra, Sanchit, et al.
Published: (2026)

DeepMF: Deep Motion Factorization for Closed-Loop Safety-Critical Driving Scenario Simulation
by: Li, Yizhe, et al.
Published: (2024)

FlashMLA-ETAP: Efficient Transpose Attention Pipeline for Accelerating MLA Inference on NVIDIA H20 GPUs
by: Dege, Pengcuo, et al.
Published: (2025)

NVIDIA Nemotron Nano V2 VL
by: NVIDIA, et al.
Published: (2025)

Energy-Aware Dynamic Neural Inference
by: Bullo, Marcello, et al.
Published: (2024)

Inner Loop Inference for Pretrained Transformers: Unlocking Latent Capabilities Without Training
by: Lys, Jonathan, et al.
Published: (2026)

FAST: Feature Aware Similarity Thresholding for Weak Unlearning in Black-Box Generative Models
by: Panda, Subhodip, et al.
Published: (2023)

Implementing Reinforcement Learning Datacenter Congestion Control in NVIDIA NICs
by: Fuhrer, Benjamin, et al.
Published: (2022)

Inference-Time Refinement Closes the Synthetic-Real Gap in Tabular Diffusion
by: Lomurno, Eugenio, et al.
Published: (2026)

Composing Non-Conjugate Factor Graphs with Closed-Form Variational Inference
by: Lukashchuk, Mykola, et al.
Published: (2026)

ADV-0: Closed-Loop Min-Max Adversarial Training for Long-Tail Robustness in Autonomous Driving
by: Nie, Tong, et al.
Published: (2026)

Consistency Models for Scalable and Fast Simulation-Based Inference
by: Schmitt, Marvin, et al.
Published: (2023)

Entropy-Guided Loop: Achieving Reasoning through Uncertainty-Aware Generation
by: Correa, Andrew G. A., et al.
Published: (2025)