Saved in:
Bibliographic Details
Main Authors: Thakur, Ayush, Chauhan, Sanskar, Tomar, Ilisha, Paul, Vaibhavi, Gupta, Deepak
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.00004
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911860698120192
author Thakur, Ayush
Chauhan, Sanskar
Tomar, Ilisha
Paul, Vaibhavi
Gupta, Deepak
author_facet Thakur, Ayush
Chauhan, Sanskar
Tomar, Ilisha
Paul, Vaibhavi
Gupta, Deepak
contents Data sharding, a technique for partitioning and distributing data among multiple servers or nodes, offers enhancements in the scalability, performance, and fault tolerance of extensive distributed systems. Nonetheless, this strategy introduces novel challenges, including load balancing among shards, management of node failures and data loss, and adaptation to evolving data and workload patterns. This paper proposes an innovative approach to tackle these challenges by empowering self-healing nodes with adaptive data sharding. Leveraging concepts such as self-replication, fractal regeneration, sentient data sharding, and symbiotic node clusters, our approach establishes a dynamic and resilient data sharding scheme capable of addressing diverse scenarios and meeting varied requirements. Implementation and evaluation of our approach involve a prototype system simulating a large-scale distributed database across various data sharding scenarios. Comparative analyses against existing data sharding techniques highlight the superior scalability, performance, fault tolerance, and adaptability of our approach. Additionally, the paper delves into potential applications and limitations, providing insights into the future research directions that can further advance this innovative approach.
format Preprint
id arxiv_https___arxiv_org_abs_2405_00004
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-healing Nodes with Adaptive Data-Sharding
Thakur, Ayush
Chauhan, Sanskar
Tomar, Ilisha
Paul, Vaibhavi
Gupta, Deepak
Distributed, Parallel, and Cluster Computing
Data sharding, a technique for partitioning and distributing data among multiple servers or nodes, offers enhancements in the scalability, performance, and fault tolerance of extensive distributed systems. Nonetheless, this strategy introduces novel challenges, including load balancing among shards, management of node failures and data loss, and adaptation to evolving data and workload patterns. This paper proposes an innovative approach to tackle these challenges by empowering self-healing nodes with adaptive data sharding. Leveraging concepts such as self-replication, fractal regeneration, sentient data sharding, and symbiotic node clusters, our approach establishes a dynamic and resilient data sharding scheme capable of addressing diverse scenarios and meeting varied requirements. Implementation and evaluation of our approach involve a prototype system simulating a large-scale distributed database across various data sharding scenarios. Comparative analyses against existing data sharding techniques highlight the superior scalability, performance, fault tolerance, and adaptability of our approach. Additionally, the paper delves into potential applications and limitations, providing insights into the future research directions that can further advance this innovative approach.
title Self-healing Nodes with Adaptive Data-Sharding
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2405.00004