GetBatch: Distributed Multi-Object Retrieval for ML Data Loading

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Aizman, Alex, Gaikwad, Abhishek, Żelasko, Piotr
Format:	Preprint
Published:	2026
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence Databases Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On-device Online Learning and Semantic Management of TinyML Systems
by: Ren, Haoyu, et al.
Published: (2024)

Modyn: Data-Centric Machine Learning Pipeline Orchestration
by: Böther, Maximilian, et al.
Published: (2023)

Orchestrating Agents and Data for Enterprise: A Blueprint Architecture for Compound AI
by: Kandogan, Eser, et al.
Published: (2025)

Eco-Friendly AI: Unleashing Data Power for Green Federated Learning
by: Sabella, Mattia, et al.
Published: (2025)

Morphing-based Compression for Data-centric ML Pipelines
by: Baunsgaard, Sebastian, et al.
Published: (2025)

Autonomous FAIR Digital Objects: From Passive Assertions to Active Knowledge
by: Boukhers, Zeyd, et al.
Published: (2026)

CubicML: Automated ML for Large ML Systems Co-design with ML Prediction of Performance
by: Wen, Wei, et al.
Published: (2024)

On Using Large-Batches in Federated Learning
by: Tyagi, Sahil
Published: (2025)

Enabling Secure and Ephemeral AI Workloads in Data Mesh Environments
by: Patel, Chinkit, et al.
Published: (2025)

DisCEdge: Distributed Context Management for Large Language Models at the Edge
by: Malekabbasi, Mohammadreza, et al.
Published: (2025)

PixelsDB: Serverless and NL-Aided Data Analytics with Flexible Service Levels and Prices
by: Bian, Haoqiong, et al.
Published: (2024)

Building a Correct-by-Design Lakehouse. Data Contracts, Versioning, and Transactional Pipelines for Humans and Agents
by: Sheng, Weiming, et al.
Published: (2026)

TensAIR: Real-Time Training of Neural Networks from Data-streams
by: Tosi, Mauro D. L., et al.
Published: (2022)

CHASe: Client Heterogeneity-Aware Data Selection for Effective Federated Active Learning
by: Zhang, Jun, et al.
Published: (2025)

Multi-Worker Selection based Distributed Swarm Learning for Edge IoT with Non-i.i.d. Data
by: Yao, Zhuoyu, et al.
Published: (2025)

BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
by: Zheng, Zhen, et al.
Published: (2024)

On the Fragility of Data Attribution When Learning Is Distributed
by: Gao, Xian, et al.
Published: (2026)

Fully Distributed Fog Load Balancing with Multi-Agent Reinforcement Learning
by: Ebrahim, Maad, et al.
Published: (2024)

Push Down Optimization for Distributed Multi Cloud Data Integration
by: Kodali, Ravi Kiran, et al.
Published: (2026)

Snowpark: Performant, Secure, User-Friendly Data Engineering and AI/ML Next To Your Data
by: Baker, Brandon, et al.
Published: (2025)

Batch Query Processing and Optimization for Agentic Workflows
by: Shen, Junyi, et al.
Published: (2025)

AdaptiveLoad: Towards Efficient Video Diffusion Transformer Training
by: Guo, Yucheng, et al.
Published: (2026)

MergePipe: A Budget-Aware Parameter Management System for Scalable LLM Merging
by: Wang, Yuanyi, et al.
Published: (2026)

DLRover-RM: Resource Optimization for Deep Recommendation Models Training in the Cloud
by: Wang, Qinlong, et al.
Published: (2023)

A Planet Scale Spatial-Temporal Knowledge Graph Based On OpenStreetMap And H3 Grid
by: Böckling, Martin, et al.
Published: (2024)

Mosaic: Data-Free Knowledge Distillation via Mixture-of-Experts for Heterogeneous Distributed Environments
by: Liu, Junming, et al.
Published: (2025)

Stateful Entities: Object-oriented Cloud Applications as Distributed Dataflows
by: Psarakis, Kyriakos, et al.
Published: (2021)

PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection
by: Xu, Ronghui, et al.
Published: (2024)

Improving Automatic Parallel Training via Balanced Memory Workload Optimization
by: Wang, Yujie, et al.
Published: (2023)

Workshop Scientific HPC in the pre-Exascale era (part of ITADATA 2024) Proceedings
by: Bena, Nicola, et al.
Published: (2025)

TablePuppet: A Generic Framework for Relational Federated Learning
by: Xu, Lijie, et al.
Published: (2024)

Delta Tensor: Efficient Vector and Tensor Storage in Delta Lake
by: Bao, Zhiwei, et al.
Published: (2024)

EmbedPart: Embedding-Driven Graph Partitioning for Scalable Graph Neural Network Training
by: Merkel, Nikolai, et al.
Published: (2026)

COSTREAM: Learned Cost Models for Operator Placement in Edge-Cloud Environments
by: Heinrich, Roman, et al.
Published: (2024)

Rel-HNN: Split Parallel Hypergraph Neural Network for Learning on Relational Databases
by: Alam, Md. Tanvir, et al.
Published: (2025)

EdgeServe: A Streaming System for Decentralized Model Serving
by: Shaowang, Ted, et al.
Published: (2023)

Scalable and Cost-Efficient ML Inference: Parallel Batch Processing with Serverless Functions
by: Barrak, Amine, et al.
Published: (2025)

Game-Theoretic Deep Reinforcement Learning to Minimize Carbon Emissions and Energy Costs for AI Inference Workloads in Geo-Distributed Data Centers
by: Hogade, Ninad, et al.
Published: (2024)

Demystifying Object-based Big Data Storage Systems
by: Mondal, Anindita Sarkar, et al.
Published: (2024)

Batch-Schedule-Execute: On Optimizing Concurrent Deterministic Scheduling for Blockchains (Extended Version)
by: Hay, Yaron, et al.
Published: (2024)