Cover Image

Improving inference time in multi-TPU systems with profiled model segmentation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Villarrubia, Jorge, Costero, Luis, Igual, Francisco D., Olcoz, Katzalin
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing C.1.3; B.8
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Balanced segmentation of CNNs for multi-TPU inference
by: Villarrubia, Jorge, et al.
Published: (2025)

A comprehensive evaluation of spatial co-execution on GPUs using MPS and MIG technologies
by: Villarrubia, Jorge, et al.
Published: (2026)

Leveraging Multi-Instance GPUs through moldable task scheduling
by: Villarrubia, Jorge, et al.
Published: (2025)

Leveraging knowledge-as-a-service (KaaS) for QoS-aware resource management in multi-user video transcoding
by: Costero, Luis, et al.
Published: (2024)

Energy efficiency optimization of task-parallel codes on asymmetric architectures
by: Costero, Luis, et al.
Published: (2024)

PIM-STM: Software Transactional Memory for Processing-In-Memory Systems
by: Lopes, André, et al.
Published: (2024)

Joint Training on AMD and NVIDIA GPUs
by: Hu, Jon, et al.
Published: (2026)

pLUTo: Enabling Massively Parallel Computation in DRAM via Lookup Tables
by: Ferreira, João Dinis, et al.
Published: (2021)

Stream parallel skeleton optimization
by: Aldinucci, Marco, et al.
Published: (2024)

StreamFlow: cross-breeding cloud with HPC
by: Colonnelli, Iacopo, et al.
Published: (2020)

Optimizing Fine-Grained Parallelism Through Dynamic Load Balancing on Multi-Socket Many-Core Systems
by: Wang, Wenyi, et al.
Published: (2025)

AutoTSMM: An Auto-tuning Framework for Building High-Performance Tall-and-Skinny Matrix-Matrix Multiplication on CPUs
by: Li, Chendi, et al.
Published: (2022)

Enabling Practical Transparent Checkpointing for MPI: A Topological Sort Approach
by: Xu, Yao, et al.
Published: (2024)

Challenging Portability Paradigms: FPGA Acceleration Using SYCL and OpenCL
by: de Castro, Manuel, et al.
Published: (2024)

Rust vs. C for Python Libraries: Evaluating Rust-Compatible Bindings Toolchains
by: Amaral, Isabella Basso do, et al.
Published: (2025)

Fancy Some Chips for Your TeaStore? Modeling the Control of an Adaptable Discrete System
by: Gallone, Anna, et al.
Published: (2025)

Hardware-Level QoS Enforcement Features: Technologies, Use Cases, and Research Challenges
by: Larsson, Oliver, et al.
Published: (2025)

TokenRing: An Efficient Parallelism Framework for Infinite-Context LLMs via Bidirectional Communication
by: Wang, Zongwu, et al.
Published: (2024)

Hybrid Quantum-HPC Middleware Systems for Adaptive Resource, Workload and Task Management
by: Mantha, Pradeep, et al.
Published: (2026)

N2N: A Parallel Framework for Large-Scale MILP under Distributed Memory
by: Wang, Longfei, et al.
Published: (2025)

Work-Efficient Parallel Non-Maximum Suppression Kernels
by: Oro, David, et al.
Published: (2025)

Simulating Cloud Environments of Connected Vehicles for Anomaly Detection
by: Weiß, M., et al.
Published: (2024)

An OpenSource CI/CD Pipeline for Variant-Rich Software-Defined Vehicles
by: Weiß, Matthias, et al.
Published: (2025)

Aurora: Architecting Argonne's First Exascale Supercomputer for Accelerated Scientific Discovery
by: Allcock, William E., et al.
Published: (2025)

DNA sequence alignment: An assignment for OpenMP, MPI, and CUDA/OpenCL
by: Gonzalez-Escribano, Arturo, et al.
Published: (2024)

Sharded Elimination and Combining for Highly-Efficient Concurrent Stacks
by: Singh, Ajay, et al.
Published: (2026)

SAKURAONE: Empowering Transparent and Open AI Platforms through Private-Sector HPC Investment in Japan
by: Konishi, Fumikazu
Published: (2025)

NM-SpMM: Accelerating Matrix Multiplication Using N:M Sparsity with GPGPU
by: Ma, Cong, et al.
Published: (2025)

Construction of a Byzantine Linearizable SWMR Atomic Register from SWSR Atomic Registers
by: Kshemkalyani, Ajay D., et al.
Published: (2024)

Cost-Aware Logging: Measuring the Financial Impact of Excessive Log Retention in Small-Scale Cloud Deployments
by: Putra, Jody Almaida
Published: (2026)

Trident: Adaptive Scheduling for Heterogeneous Multimodal Data Pipelines
by: Pan, Ding, et al.
Published: (2026)

Scheduler-Driven Job Atomization
by: Konopa, Michal, et al.
Published: (2025)

JASDA: Introducing Job-Aware Scheduling in Scheduler-Driven Job Atomization
by: Konopa, Michal, et al.
Published: (2025)

Scalable Concurrent Queues for GPU
by: Shetty, Pratheek Prakash, et al.
Published: (2026)

SpaDA: A Spatial Dataflow Architecture Programming Language
by: Gianinazzi, Lukas, et al.
Published: (2025)

On Advanced Monte Carlo Methods for Linear Algebra on Advanced Accelerator Architectures
by: Lebedev, Anton, et al.
Published: (2024)

Exploring the Design Space for Message-Driven Systems for Dynamic Graph Processing using CCA
by: Chandio, Bibrak Qamar, et al.
Published: (2024)

SDVDiag: A Modular Platform for the Diagnosis of Connected Vehicle Functions
by: Weiß, Matthias, et al.
Published: (2025)

A C++17 Thread Pool for High-Performance Scientific Computing
by: Shoshany, Barak
Published: (2021)

Dynamic Memory Management on GPUs with SYCL
by: Standish, Russell K.
Published: (2025)