Cover Image

Streaming Large-Scale Electron Microscopy Data to a Supercomputing Facility

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Welborn, Samuel S., Harris, Chris, Ribet, Stephanie M., Varnavides, Georgios, Ophus, Colin, Enders, Bjoern, Ercius, Peter
Format:	Preprint
Published:	2024
Subjects:	Instrumentation and Detectors Materials Science Distributed, Parallel, and Cluster Computing Networking and Internet Architecture
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Accelerating Time-to-Science by Streaming Detector Data Directly into Perlmutter Compute Nodes
by: Welborn, Samuel S., et al.
Published: (2024)

NET4EXA: Pioneering the Future of Interconnects for Supercomputing and AI
by: Martinelli, Michele, et al.
Published: (2026)

Distributed Simulation for Digital Twins of Large-Scale Real-World DiffServ-Based Networks
by: Huang, Zhuoyao, et al.
Published: (2024)

To Stream or Not to Stream: Towards A Quantitative Model for Remote HPC Processing Decisions
by: Castro, Flavio, et al.
Published: (2025)

Harvest: Adaptive Photonic Switching Schedules for Collective Communication in Scale-up Domains
by: Rahman, Mahir, et al.
Published: (2026)

Fast Prototyping of Distributed Stream Processing Applications with stream2gym
by: Ifath, Md. Monzurul Amin, et al.
Published: (2024)

SCENIC: Stream Computation-Enhanced SmartNIC
by: Ramhorst, Benjamin, et al.
Published: (2026)

AirChain: A Novel Blockchain Framework and Low-Cost Device for Democratized Air Quality Data Aggregation
by: Stankiewicz, Samuel
Published: (2024)

An optimization framework for task allocation in the edge/hub/cloud paradigm
by: Kouloumpris, Andreas, et al.
Published: (2025)

An Open-Source Experimentation Framework for the Edge Cloud Continuum
by: Koukis, Georgios, et al.
Published: (2024)

Extreme-Scale Interconnection Networks
by: Cano, Alejandro, et al.
Published: (2026)

Throughput-Optimized Networks at Scale
by: Green, Conor James, et al.
Published: (2026)

SplitSim: Large-Scale Simulations for Evaluating Network Systems Research
by: Li, Hejing, et al.
Published: (2024)

Optimal Oblivious Load-Balancing for Sparse Traffic in Large-Scale Satellite Networks
by: Ramakanth, Rudrapatna Vallabh, et al.
Published: (2026)

Ethereal: Divide and Conquer Network Load Balancing in Large-Scale Distributed Training
by: Addanki, Vamsi, et al.
Published: (2024)

JANUS: Resilient and Adaptive Data Transmission for Enabling Timely and Efficient Cross-Facility Scientific Workflows
by: Esaulov, Vladislav, et al.
Published: (2025)

When Light Bends to the Collective Will: A Theory and Vision for Adaptive Photonic Scale-up Domains
by: Addanki, Vamsi
Published: (2025)

1.5 Million Messages Per Second on 3 Machines: Benchmarking and Latency Optimization of Apache Pulsar at Enterprise Scale
by: Mukkolakkal, Muhamed Ramees Cheriya
Published: (2026)

Decentralized Stratified Sampling for Low-Latency Approximate Geospatial Data Stream Processing in Edge-Cloud Architectures
by: Jawarneh, Isam Mashhour Al, et al.
Published: (2026)

RailX: A Flexible, Scalable, and Low-Cost Network Architecture for Hyper-Scale LLM Training Systems
by: Feng, Yinxiao, et al.
Published: (2025)

EvalNet: A Practical Toolchain for Generation and Analysis of Extreme-Scale Interconnects
by: Besta, Maciej, et al.
Published: (2021)

ScaleAcross Explorer: Exploring Communication Optimization for Scale-Across AI Model Training
by: Li, Minghao, et al.
Published: (2026)

ScaDLES: Scalable Deep Learning over Streaming data at the Edge
by: Tyagi, Sahil, et al.
Published: (2023)

Trivance: Latency-Optimal AllReduce by Shortcutting Multiport Networks
by: Juerss, Anton, et al.
Published: (2026)

A Uniqueness Theorem for Distributed Computation under Physical Constraint
by: Ren, Zhiyuan, et al.
Published: (2025)

Multi-stage Flow Scheduling for LLM Serving
by: Sun, Yijun, et al.
Published: (2026)

Fast Multichannel Topology Discovery in Cognitive Radio Networks
by: Wang, Yung-Li, et al.
Published: (2025)

Enabling Scalability in Asynchronous and Bidirectional Communication in LPWAN
by: Rahman, Mahbubur
Published: (2025)

Real-Time In-Network Machine Learning on P4-Programmable FPGA SmartNICs with Fixed-Point Arithmetic and Taylor
by: Sada, Mohammad Firas, et al.
Published: (2025)

Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration
by: Luo, Haoxiang, et al.
Published: (2025)

Performance Evaluation of Brokerless Messaging Libraries
by: La Corte, Lorenzo, et al.
Published: (2025)

Accelerating Stable Matching between Workers and Spatial-Temporal Tasks for Dynamic MCS: A Stagewise Service Trading Approach
by: Qi, Houyi, et al.
Published: (2025)

An Auction-Based Mechanism for Optimal Task Allocation and Resource Aware Containerization
by: kumar, Ramakant
Published: (2026)

SCRamble: Adaptive Decentralized Overlay Construction for Blockchain Networks
by: Kolyvas, Evangelos, et al.
Published: (2026)

Optimal Server Selection for Straggler Mitigation
by: Badita, Ajay, et al.
Published: (2019)

A Density-Delay Law for Stable Event-Driven State Progression in Open Distributed Systems
by: Chen, Bin, et al.
Published: (2026)

CCL-Bench 1.0: A Trace-Based Benchmark for LLM Infrastructure
by: Ding, Eric, et al.
Published: (2026)

ncsim: A Lightweight Simulator for Networked Edge Computing with Wireless Interference Modeling
by: Krishnamachari, Bhaskar, et al.
Published: (2026)

COREC: Concurrent Non-Blocking Single-Queue Receive Driver for Low Latency Networking
by: Faltelli, Marco, et al.
Published: (2024)

Multitier Service Migration Framework Based on Mobility Prediction in Mobile Edge Computing
by: Yang, Run, et al.
Published: (2024)