OffloadFS: Leveraging Disaggregated Storage for Computation Offloading

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Moon, Sungho, Han, Daegyu, Koo, Hera, Chae, Sangeun, Bae, Duck-Ho, Seo, Euiseong, Nam, Beomseok
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913034850533376
author Moon, Sungho
Han, Daegyu
Koo, Hera
Chae, Sangeun
Bae, Duck-Ho
Seo, Euiseong
Nam, Beomseok
author_facet Moon, Sungho
Han, Daegyu
Koo, Hera
Chae, Sangeun
Bae, Duck-Ho
Seo, Euiseong
Nam, Beomseok
contents Disaggregated storage systems improve resource utilization and enable independent scaling of storage and compute resources by separating storage resources from computing resources in data centers. NVMe over fabrics (NVMeoF) is a key technology that underpins the functionality and benefits of disaggregated storage systems. While NVMeoF inherently possesses substantial computing and memory capacity, these resources are often underutilized for tasks beyond simple I/O delegation. This study proposes OffloadFS, a user-level file system that enables offloaded IO-intensive tasks primarily to a disaggregated storage node for near-data processing, with the option to offload to peer compute nodes as well, without the need for distributed lock management. OffloadFS optimizes cache management by reducing interference between threads performing distinct I/O operations. On top of OffloadFS, we develop OffloadDB, which enables RocksDB to offload MemTable flush and compaction operations, and OffloadPrep, which offloads image pre-processing tasks for machine learning to disaggregated storage nodes. Our evaluation shows that OffloadFS improves the performance of RocksDB and machine learning pre-processing tasks by up to 3.36x and 1.85x, respectively, compared to OCFS2.
format Preprint
id arxiv_https___arxiv_org_abs_2604_13743
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle OffloadFS: Leveraging Disaggregated Storage for Computation Offloading
Moon, Sungho
Han, Daegyu
Koo, Hera
Chae, Sangeun
Bae, Duck-Ho
Seo, Euiseong
Nam, Beomseok
Distributed, Parallel, and Cluster Computing
Databases
Disaggregated storage systems improve resource utilization and enable independent scaling of storage and compute resources by separating storage resources from computing resources in data centers. NVMe over fabrics (NVMeoF) is a key technology that underpins the functionality and benefits of disaggregated storage systems. While NVMeoF inherently possesses substantial computing and memory capacity, these resources are often underutilized for tasks beyond simple I/O delegation. This study proposes OffloadFS, a user-level file system that enables offloaded IO-intensive tasks primarily to a disaggregated storage node for near-data processing, with the option to offload to peer compute nodes as well, without the need for distributed lock management. OffloadFS optimizes cache management by reducing interference between threads performing distinct I/O operations. On top of OffloadFS, we develop OffloadDB, which enables RocksDB to offload MemTable flush and compaction operations, and OffloadPrep, which offloads image pre-processing tasks for machine learning to disaggregated storage nodes. Our evaluation shows that OffloadFS improves the performance of RocksDB and machine learning pre-processing tasks by up to 3.36x and 1.85x, respectively, compared to OCFS2.
title OffloadFS: Leveraging Disaggregated Storage for Computation Offloading
topic Distributed, Parallel, and Cluster Computing
Databases
url https://arxiv.org/abs/2604.13743