Using MongoDB Sync to Replace Kinesis for Real-Time Fuel Data Update

Fuente: Zenodo
Saved in:
Bibliographic Details
Main Author: Rohith Varma Vegesna
Format: Recurso digital
Published: Zenodo 2024
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866901906318688256
author Rohith Varma Vegesna
author_facet Rohith Varma Vegesna
contents <p>The need for real-time data synchronization in fuel stations has led to widespread adoption of cloud-based streaming services such as AWS Kinesis, which allows for high-throughput data ingestion and event processing but at the cost of increased complexity, latency, and additional operational expenses. Fuel controllers generate a constant stream of transactional data that must be transmitted to the cloud efficiently and with minimal delay. However, the reliance on Kinesis and Lambda introduces multiple processing stages that can degrade real-time performance. This paper explores an alternative approach using MongoDB Sync, enabling direct synchronization from local MongoDB instances within fuel controllers to cloud-hosted MongoDB databases. By eliminating the need for event-driven computation layers, such as Lambda, and reducing dependency on cloud-managed streaming solutions, MongoDB Sync offers a simplified, cost-effective, and low-latency data update mechanism. The proposed architecture ensures that fuel transactions and ATG data are continuously and reliably synchronized without the need for intermediary processing layers. This study examines the challenges of implementing MongoDB Sync in fuel station environments, evaluates key performance metrics such as latency and resource utilization, and presents a comparative analysis with Kinesis-based solutions to determine the effectiveness of the proposed approach in enhancing operational efficiency while minimizing costs.</p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_14883171
institution Zenodo
language
publishDate 2024
publisher Zenodo
record_format zenodo
spellingShingle Using MongoDB Sync to Replace Kinesis for Real-Time Fuel Data Update
Rohith Varma Vegesna
<p>The need for real-time data synchronization in fuel stations has led to widespread adoption of cloud-based streaming services such as AWS Kinesis, which allows for high-throughput data ingestion and event processing but at the cost of increased complexity, latency, and additional operational expenses. Fuel controllers generate a constant stream of transactional data that must be transmitted to the cloud efficiently and with minimal delay. However, the reliance on Kinesis and Lambda introduces multiple processing stages that can degrade real-time performance. This paper explores an alternative approach using MongoDB Sync, enabling direct synchronization from local MongoDB instances within fuel controllers to cloud-hosted MongoDB databases. By eliminating the need for event-driven computation layers, such as Lambda, and reducing dependency on cloud-managed streaming solutions, MongoDB Sync offers a simplified, cost-effective, and low-latency data update mechanism. The proposed architecture ensures that fuel transactions and ATG data are continuously and reliably synchronized without the need for intermediary processing layers. This study examines the challenges of implementing MongoDB Sync in fuel station environments, evaluates key performance metrics such as latency and resource utilization, and presents a comparative analysis with Kinesis-based solutions to determine the effectiveness of the proposed approach in enhancing operational efficiency while minimizing costs.</p>
title Using MongoDB Sync to Replace Kinesis for Real-Time Fuel Data Update
url https://doi.org/10.5281/zenodo.14883171