Brame: Hierarchical Data Management Framework for Cloud-Edge-Device Collaboration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Xianglong, Wang, Hongzhi, Li, Yingze, Li, Minchong, Zheng, Shenghe, Sun, Weihua
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929711933816832
author Liu, Xianglong
Wang, Hongzhi
Li, Yingze
Li, Minchong
Zheng, Shenghe
Sun, Weihua
author_facet Liu, Xianglong
Wang, Hongzhi
Li, Yingze
Li, Minchong
Zheng, Shenghe
Sun, Weihua
contents In the realm of big data, cloud-edge-device collaboration is prevalent in industrial scenarios. However, a systematic exploration of the theory and methodologies related to data management in this field is lacking. This paper delves into the sub-problem of data storage and scheduling within cloud-edge-device collaborative environments. Following extensive research and analysis of the characteristics and requirements of data management in cloud-edge collaboration, it is evident that existing studies on hierarchical data management primarily focus on the migration of hot and cold data. Additionally, these studies encounter challenges such as elevated operational and maintenance costs, difficulties in locating data within tiered storage, and intricate metadata management attributable to excessively fine-grained management granularity. These challenges impede the fulfillment of the storage needs in cloud-edge-device collaboration. To overcome these challenges, we propose a \underline{B}lock-based hie\underline{R}archical d\underline{A}ta \underline{M}anagement fram\underline{E}work, \textbf{Brame}, which advocates for a workload-aware three-tier storage architecture and suggests a shift from using tuples to employing $Blocks$ as the fundamental unit for data management. \textbf{Brame} owns an offline block generation method designed to facilitate efficient block generation and expeditious query routing. Extensive experiments substantiate the superior performance of \textbf{Brame}.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08331
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Brame: Hierarchical Data Management Framework for Cloud-Edge-Device Collaboration
Liu, Xianglong
Wang, Hongzhi
Li, Yingze
Li, Minchong
Zheng, Shenghe
Sun, Weihua
Databases
In the realm of big data, cloud-edge-device collaboration is prevalent in industrial scenarios. However, a systematic exploration of the theory and methodologies related to data management in this field is lacking. This paper delves into the sub-problem of data storage and scheduling within cloud-edge-device collaborative environments. Following extensive research and analysis of the characteristics and requirements of data management in cloud-edge collaboration, it is evident that existing studies on hierarchical data management primarily focus on the migration of hot and cold data. Additionally, these studies encounter challenges such as elevated operational and maintenance costs, difficulties in locating data within tiered storage, and intricate metadata management attributable to excessively fine-grained management granularity. These challenges impede the fulfillment of the storage needs in cloud-edge-device collaboration. To overcome these challenges, we propose a \underline{B}lock-based hie\underline{R}archical d\underline{A}ta \underline{M}anagement fram\underline{E}work, \textbf{Brame}, which advocates for a workload-aware three-tier storage architecture and suggests a shift from using tuples to employing $Blocks$ as the fundamental unit for data management. \textbf{Brame} owns an offline block generation method designed to facilitate efficient block generation and expeditious query routing. Extensive experiments substantiate the superior performance of \textbf{Brame}.
title Brame: Hierarchical Data Management Framework for Cloud-Edge-Device Collaboration
topic Databases
url https://arxiv.org/abs/2502.08331