Self-healing Nodes with Adaptive Data-Sharding

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Thakur, Ayush, Chauhan, Sanskar, Tomar, Ilisha, Paul, Vaibhavi, Gupta, Deepak
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911860698120192
author Thakur, Ayush
Chauhan, Sanskar
Tomar, Ilisha
Paul, Vaibhavi
Gupta, Deepak
author_facet Thakur, Ayush
Chauhan, Sanskar
Tomar, Ilisha
Paul, Vaibhavi
Gupta, Deepak
contents Data sharding, a technique for partitioning and distributing data among multiple servers or nodes, offers enhancements in the scalability, performance, and fault tolerance of extensive distributed systems. Nonetheless, this strategy introduces novel challenges, including load balancing among shards, management of node failures and data loss, and adaptation to evolving data and workload patterns. This paper proposes an innovative approach to tackle these challenges by empowering self-healing nodes with adaptive data sharding. Leveraging concepts such as self-replication, fractal regeneration, sentient data sharding, and symbiotic node clusters, our approach establishes a dynamic and resilient data sharding scheme capable of addressing diverse scenarios and meeting varied requirements. Implementation and evaluation of our approach involve a prototype system simulating a large-scale distributed database across various data sharding scenarios. Comparative analyses against existing data sharding techniques highlight the superior scalability, performance, fault tolerance, and adaptability of our approach. Additionally, the paper delves into potential applications and limitations, providing insights into the future research directions that can further advance this innovative approach.
format Preprint
id arxiv_https___arxiv_org_abs_2405_00004
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-healing Nodes with Adaptive Data-Sharding
Thakur, Ayush
Chauhan, Sanskar
Tomar, Ilisha
Paul, Vaibhavi
Gupta, Deepak
Distributed, Parallel, and Cluster Computing
Data sharding, a technique for partitioning and distributing data among multiple servers or nodes, offers enhancements in the scalability, performance, and fault tolerance of extensive distributed systems. Nonetheless, this strategy introduces novel challenges, including load balancing among shards, management of node failures and data loss, and adaptation to evolving data and workload patterns. This paper proposes an innovative approach to tackle these challenges by empowering self-healing nodes with adaptive data sharding. Leveraging concepts such as self-replication, fractal regeneration, sentient data sharding, and symbiotic node clusters, our approach establishes a dynamic and resilient data sharding scheme capable of addressing diverse scenarios and meeting varied requirements. Implementation and evaluation of our approach involve a prototype system simulating a large-scale distributed database across various data sharding scenarios. Comparative analyses against existing data sharding techniques highlight the superior scalability, performance, fault tolerance, and adaptability of our approach. Additionally, the paper delves into potential applications and limitations, providing insights into the future research directions that can further advance this innovative approach.
title Self-healing Nodes with Adaptive Data-Sharding
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2405.00004