Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.11935 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918293869166592 |
|---|---|
| author | Parikh, Milan Soni, Aniket Abhishek Shah, Sneja Mitinbhai Jha, Ayush Raj |
| author_facet | Parikh, Milan Soni, Aniket Abhishek Shah, Sneja Mitinbhai Jha, Ayush Raj |
| contents | Cloud data centers face increasing pressure to reduce operational energy consumption as big data workloads continue to grow in scale and complexity. This paper presents a workload aware and energy efficient scheduling framework that profiles CPU utilization, memory demand, and storage IO behavior to guide virtual machine placement decisions. By combining historical execution logs with real time telemetry, the proposed system predicts the energy and performance impact of candidate placements and enables adaptive consolidation while preserving service level agreement compliance. The framework is evaluated using representative Hadoop MapReduce, Spark MLlib, and ETL workloads deployed on a multi node cloud testbed. Experimental results demonstrate consistent energy savings of 15 to 20 percent compared to a baseline scheduler, with negligible performance degradation. These findings highlight workload profiling as a practical and scalable strategy for improving the sustainability of cloud based big data processing environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_11935 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Big Data Workload Profiling for Energy-Aware Cloud Resource Management Parikh, Milan Soni, Aniket Abhishek Shah, Sneja Mitinbhai Jha, Ayush Raj Distributed, Parallel, and Cluster Computing Artificial Intelligence Software Engineering 68M20, 68M14 C.4; D.4.8; D.4.1 Cloud data centers face increasing pressure to reduce operational energy consumption as big data workloads continue to grow in scale and complexity. This paper presents a workload aware and energy efficient scheduling framework that profiles CPU utilization, memory demand, and storage IO behavior to guide virtual machine placement decisions. By combining historical execution logs with real time telemetry, the proposed system predicts the energy and performance impact of candidate placements and enables adaptive consolidation while preserving service level agreement compliance. The framework is evaluated using representative Hadoop MapReduce, Spark MLlib, and ETL workloads deployed on a multi node cloud testbed. Experimental results demonstrate consistent energy savings of 15 to 20 percent compared to a baseline scheduler, with negligible performance degradation. These findings highlight workload profiling as a practical and scalable strategy for improving the sustainability of cloud based big data processing environments. |
| title | Big Data Workload Profiling for Energy-Aware Cloud Resource Management |
| topic | Distributed, Parallel, and Cluster Computing Artificial Intelligence Software Engineering 68M20, 68M14 C.4; D.4.8; D.4.1 |
| url | https://arxiv.org/abs/2601.11935 |