Cover Image

Data Readiness for Scientific AI at Scale

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Brewer, Wesley, Widener, Patrick, Anantharaj, Valentine, Wang, Feiyi, Beck, Tom, Shankar, Arjun, Oral, Sarp
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Computational Engineering, Finance, and Science Distributed, Parallel, and Cluster Computing Machine Learning I.2.6
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Designing FAIR Workflows at OLCF: Building Scalable and Reusable Ecosystems for HPC Science
by: Wilkinson, Sean R., et al.
Published: (2025)

FAIR Ecosystems for Science at Scale
by: Wilkinson, Sean R., et al.
Published: (2025)

Provenance Tracking in Large-Scale Machine Learning Systems
by: Padovani, Gabriele, et al.
Published: (2025)

A Study on Messaging Trade-offs in Data Streaming for Scientific Workflows
by: George, Anjus, et al.
Published: (2025)

Secure API-Driven Research Automation to Accelerate Scientific Discovery
by: Skluzacek, Tyler J., et al.
Published: (2025)

yProv4ML: Effortless Provenance Tracking for Machine Learning Systems
by: Padovani, Gabriele, et al.
Published: (2025)

AI-coupled HPC Workflow Applications, Middleware and Performance
by: Brewer, Wes, et al.
Published: (2024)

Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows
by: Etz, Brian D., et al.
Published: (2025)

Data readiness pipeline patterns for scientific AI at scale: Insights from climate, fusion, life sciences, and materials
by: Wesley Brewer, et al.
Published: (2026)

Trace Replay Simulation of MIT SuperCloud for Studying Optimal Sustainability Policies
by: Brewer, Wesley, et al.
Published: (2025)

Experimentally Evaluating the Resource Efficiency of Big Data Autoscaling
by: Will, Jonathan, et al.
Published: (2025)

Chronicals: A High-Performance Framework for LLM Fine-Tuning with 3.51x Speedup over Unsloth
by: Nair, Arjun S.
Published: (2026)

In-Transit Data Transport Strategies for Coupled AI-Simulation Workflow Patterns
by: Tummalapalli, Harikrishna, et al.
Published: (2025)

Characterizing GPU Energy Usage in Exascale-Ready Portable Science Applications
by: Godoy, William F., et al.
Published: (2025)

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
by: Wang, Xiaoyu, et al.
Published: (2025)

Scalable Artificial Intelligence for Science: Perspectives, Methods and Exemplars
by: Brewer, Wesley, et al.
Published: (2024)

Intelligent Sampling of Extreme-Scale Turbulence Datasets for Accurate and Efficient Spatiotemporal Model Training
by: Brewer, Wesley, et al.
Published: (2025)

Profiling and Modeling of Power Characteristics of Leadership-Scale HPC System Workloads
by: Karimi, Ahmad Maroof, et al.
Published: (2024)

From Edge to HPC: Investigating Cross-Facility Data Streaming Architectures
by: George, Anjus, et al.
Published: (2025)

A GPU-based Compressible Combustion Solver for Applications Exhibiting Disparate Space and Time Scales
by: Carreon, Anthony, et al.
Published: (2025)

Challenges of Heterogeneity in Big Data: A Comparative Study of Classification in Large-Scale Structured and Unstructured Domains
by: Eduardo, González Trigueros Jesús, et al.
Published: (2025)

Scaling the memory wall using mixed-precision -- HPG-MxP on an exascale machine
by: Kashi, Aditya, et al.
Published: (2025)

AMP4EC: Adaptive Model Partitioning Framework for Efficient Deep Learning Inference in Edge Computing Environments
by: Zhang, Guilin, et al.
Published: (2025)

Distributed Quantum Optimization for Large-Scale Higher-Order Problems with Dense Interactions
by: Kim, Seongmin, et al.
Published: (2026)

High-performance Effective Scientific Error-bounded Lossy Compression with Auto-tuned Multi-component Interpolation
by: Liu, Jinyang, et al.
Published: (2023)

Integrating Quantum Computing Resources into Scientific HPC Ecosystems
by: Beck, Thomas, et al.
Published: (2024)

Exploring the Frontiers of Energy Efficiency using Power Management at System Scale
by: Karimi, Ahmad Maroof, et al.
Published: (2024)

A Digital Twin Framework for Liquid-cooled Supercomputers as Demonstrated at Exascale
by: Brewer, Wesley, et al.
Published: (2024)

The (R)evolution of Scientific Workflows in the Agentic AI Era: Towards Autonomous Science
by: Shin, Woong, et al.
Published: (2025)

FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving
by: Gao, Shouwei, et al.
Published: (2026)

Cost-Effective Edge Data Distribution with End-To-End Delay Guarantees in Edge Computing
by: Shankar, Ravi, et al.
Published: (2025)

EDD-NSTE: Edge Data Distribution as a Network Steiner Tree Estimation in Edge Computing
by: Shankar, Ravi, et al.
Published: (2025)

EWSJF: An Adaptive Scheduler with Hybrid Partitioning for Mixed-Workload LLM Inference
by: Sidik, Bronislav, et al.
Published: (2026)

ACME: Adaptive Customization of Large Models via Distributed Systems
by: Dai, Ziming, et al.
Published: (2025)

Static Batching of Irregular Workloads on GPUs: Framework and Application to Efficient MoE Model Inference
by: Li, Yinghan, et al.
Published: (2025)

An Empirical Study of the Impact of Federated Learning on Machine Learning Model Accuracy
by: Yang, Haotian, et al.
Published: (2025)

ATLAHS: An Application-centric Network Simulator Toolchain for AI, HPC, and Distributed Storage
by: Shen, Siyuan, et al.
Published: (2025)

SPARK: Igniting Communication-Efficient Decentralized Learning via Stage-wise Projected NTK and Accelerated Regularization
by: Xia, Li
Published: (2025)

On the Effectiveness of the 'Follow-the-Sun' Strategy in Mitigating the Carbon Footprint of AI in Cloud Instances
by: Vergallo, Roberto, et al.
Published: (2025)

Reduced and mixed precision turbulent flow simulations using explicit finite difference schemes
by: Siklósi, Bálint, et al.
Published: (2025)