Taming and Controlling Performance and Energy Trade-offs Automatically in Network Applications

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dong, Han, Awad, Yara, Arora, Sanjay, Krieger, Orran, Appavoo, Jonathan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917931746590720
author Dong, Han
Awad, Yara
Arora, Sanjay
Krieger, Orran
Appavoo, Jonathan
author_facet Dong, Han
Awad, Yara
Arora, Sanjay
Krieger, Orran
Appavoo, Jonathan
contents In this paper, we demonstrate that a server running a single latency-sensitive application can be treated as a black box to reduce energy consumption while meeting an SLA target. We find that when the mean offered load is stable, one can find the "sweet spot" settings in packet batching (via interrupt coalescing) and controlling the processing rate (DVFS) that represents optimal trade-offs in the interactions of the software stack and hardware with the arrival rate and composition of requests currently being served. Trying a few combinations of settings on the live system, an example Bayesian optimizer can find settings that reduce the energy consumption to meet a desired tail latency for the current load. This research demonstrates that: 1) without software changes, dramatic energy savings (up to 60%) can be achieved across diverse hardware systems if one controls batching and processing rate, 2) specialized research OSes that have been developed for performance can achieve more than 2x better energy efficiency than general-purpose OSes, and 3) a controller, agnostic to the application and system, can easily find energy-efficient settings for the offered load that meets SLA objectives.
format Preprint
id arxiv_https___arxiv_org_abs_2502_14987
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Taming and Controlling Performance and Energy Trade-offs Automatically in Network Applications
Dong, Han
Awad, Yara
Arora, Sanjay
Krieger, Orran
Appavoo, Jonathan
Operating Systems
C.5.0; D.4.8
In this paper, we demonstrate that a server running a single latency-sensitive application can be treated as a black box to reduce energy consumption while meeting an SLA target. We find that when the mean offered load is stable, one can find the "sweet spot" settings in packet batching (via interrupt coalescing) and controlling the processing rate (DVFS) that represents optimal trade-offs in the interactions of the software stack and hardware with the arrival rate and composition of requests currently being served. Trying a few combinations of settings on the live system, an example Bayesian optimizer can find settings that reduce the energy consumption to meet a desired tail latency for the current load. This research demonstrates that: 1) without software changes, dramatic energy savings (up to 60%) can be achieved across diverse hardware systems if one controls batching and processing rate, 2) specialized research OSes that have been developed for performance can achieve more than 2x better energy efficiency than general-purpose OSes, and 3) a controller, agnostic to the application and system, can easily find energy-efficient settings for the offered load that meets SLA objectives.
title Taming and Controlling Performance and Energy Trade-offs Automatically in Network Applications
topic Operating Systems
C.5.0; D.4.8
url https://arxiv.org/abs/2502.14987