Real-Time Data Processing in Cloud Computing: Challenges, Opportunities, and Performance Analysis

Fuente: Zenodo
Salvato in:
Dettagli Bibliografici
Autore principale: M R Ramesh
Natura: Recurso digital
Lingua:inglese
Pubblicazione: Zenodo 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866901682915377152
author M R Ramesh
author_facet M R Ramesh
contents <p><em><span lang="EN-US">Cloud computing has revolutionized the way data is stored, processed, and analyzed, enabling real-time applications across various domains such as healthcare, finance, and IoT. This study explores the capabilities and challenges of real-time data processing in cloud environments, focusing on performance metrics such as latency, scalability, and resource utilization. Hybrid cloud architecture was implemented to simulate real-time data streams, and experiments were conducted to evaluate the efficiency of processing frameworks like Apache Kafka and Apache Flink.</span></em></p> <p><em><span lang="EN-US">The results indicate that cloud-based real-time processing systems achieve an average latency reduction of 42% compared to traditional on-premise solutions, with a throughput improvement of 35% under high data loads. However, challenges such as network latency, data security, and resource allocation were identified as critical bottlenecks, particularly in multi-tenant environments. Statistical analysis revealed a strong positive correlation (r = 0.85, p < 0.01) between the number of virtual machines allocated and system performance, highlighting the importance of dynamic resource scaling. Regression models further demonstrated that optimizing resource allocation could reduce processing delays by up to 28%.  </span></em></p> <p><em><span lang="EN-US">This study also highlights the potential of edge computing integration with cloud platforms to address latency issues, particularly for time-sensitive applications like autonomous vehicles and real-time analytics. The findings underscore the need for advanced load-balancing algorithms and security protocols to enhance the reliability and efficiency of real-time cloud systems. By addressing these challenges, cloud computing can unlock new opportunities for innovation in real-time data-driven applications.</span></em></p> <p><strong><em><span lang="EN-US"> </span></em></strong></p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_16410617
institution Zenodo
language eng
publishDate 2025
publisher Zenodo
record_format zenodo
spellingShingle Real-Time Data Processing in Cloud Computing: Challenges, Opportunities, and Performance Analysis
M R Ramesh
Cloud computing, real-time data processing, latency, scalability, Apache Kafka, Apache Flink, edge computing, resource allocation, performance analysis, IoT.
<p><em><span lang="EN-US">Cloud computing has revolutionized the way data is stored, processed, and analyzed, enabling real-time applications across various domains such as healthcare, finance, and IoT. This study explores the capabilities and challenges of real-time data processing in cloud environments, focusing on performance metrics such as latency, scalability, and resource utilization. Hybrid cloud architecture was implemented to simulate real-time data streams, and experiments were conducted to evaluate the efficiency of processing frameworks like Apache Kafka and Apache Flink.</span></em></p> <p><em><span lang="EN-US">The results indicate that cloud-based real-time processing systems achieve an average latency reduction of 42% compared to traditional on-premise solutions, with a throughput improvement of 35% under high data loads. However, challenges such as network latency, data security, and resource allocation were identified as critical bottlenecks, particularly in multi-tenant environments. Statistical analysis revealed a strong positive correlation (r = 0.85, p < 0.01) between the number of virtual machines allocated and system performance, highlighting the importance of dynamic resource scaling. Regression models further demonstrated that optimizing resource allocation could reduce processing delays by up to 28%.  </span></em></p> <p><em><span lang="EN-US">This study also highlights the potential of edge computing integration with cloud platforms to address latency issues, particularly for time-sensitive applications like autonomous vehicles and real-time analytics. The findings underscore the need for advanced load-balancing algorithms and security protocols to enhance the reliability and efficiency of real-time cloud systems. By addressing these challenges, cloud computing can unlock new opportunities for innovation in real-time data-driven applications.</span></em></p> <p><strong><em><span lang="EN-US"> </span></em></strong></p>
title Real-Time Data Processing in Cloud Computing: Challenges, Opportunities, and Performance Analysis
topic Cloud computing, real-time data processing, latency, scalability, Apache Kafka, Apache Flink, edge computing, resource allocation, performance analysis, IoT.
url https://doi.org/10.5281/zenodo.16410617