Cover Image

Systems and Algorithms for Convolutional Multi-Hybrid Language Models at Scale

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ku, Jerome, Nguyen, Eric, Romero, David W., Brixi, Garyk, Yang, Brandon, Vorontsov, Anton, Taghibakhshi, Ali, Lu, Amy X., Burke, Dave P., Brockman, Greg, Massaroli, Stefano, Ré, Christopher, Hsu, Patrick D., Hie, Brian L., Ermon, Stefano, Poli, Michael
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Computation and Language Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sliding Window Recurrences for Sequence Models
by: Secrieru, Dragos, et al.
Published: (2025)

What is Quantum Parallelism, Anyhow?
by: Markidis, Stefano
Published: (2024)

Beyond Pre-Training: The Full Lifecycle of Foundation Models on HPC Systems
by: Conciatore, Dino, et al.
Published: (2026)

6G EdgeAI: Performance Evaluation and Analysis
by: Yang, Chien-Sheng, et al.
Published: (2025)

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs
by: Ekelund, Jonah, et al.
Published: (2025)

Multiscale Parallel Simulation of Malignant Pleural Mesothelioma via Adaptive Domain Partitioning -- an Efficiency Analysis Study
by: Dolganov, Anton, et al.
Published: (2025)

Mass Matrix Assembly on Tensor Cores for Implicit Particle-In-Cell Methods
by: Pennati, Luca, et al.
Published: (2026)

Declarative Application Management in the Fog. A bacteria-inspired decentralised approach
by: Brogi, Antonio, et al.
Published: (2025)

Combining Declarative and Linear Programming for Application Management in the Cloud-Edge Continuum
by: Massa, Jacopo, et al.
Published: (2025)

Minimizing speculation overhead in a parallel recognizer for regular texts
by: Borsotti, Angelo, et al.
Published: (2024)

A parallel parser for regular expressions
by: Borsotti, Angelo, et al.
Published: (2025)

Mechanistic Design and Scaling of Hybrid Architectures
by: Poli, Michael, et al.
Published: (2024)

Gathering in Vertex- and Edge-Transitive Graphs without Multiplicity Detection under Round Robin
by: Cicerone, Serafino, et al.
Published: (2025)

On the impact of unlimited computational power in OBLOT: consequences for synchronous robots on graphs
by: Cicerone, Serafino, et al.
Published: (2025)

An Edge-based WiFi Fingerprinting Indoor Localization Using Convolutional Neural Network and Convolutional Auto-Encoder
by: Kargar-Barzi, Amin, et al.
Published: (2023)

EfiMon: A Process Analyser for Granular Power Consumption Prediction
by: León-Vega, Luis G., et al.
Published: (2024)

A Comprehensive Analysis of Process Energy Consumption on Multi-Socket Systems with GPUs
by: León-Vega, Luis G., et al.
Published: (2024)

Carbon-aware Software Services
by: Forti, Stefano, et al.
Published: (2024)

Harnessing CUDA-Q's MPS for Tensor Network Simulations of Large-Scale Quantum Circuits
by: Schieffer, Gabin, et al.
Published: (2025)

Krylov Solvers for Interior Point Methods with Applications in Radiation Therapy and Support Vector Machines
by: Liu, Felix, et al.
Published: (2023)

Understanding Data Movement in AMD Multi-GPU Systems with Infinity Fabric
by: Schieffer, Gabin, et al.
Published: (2024)

Application Placement with Constraint Relaxation
by: Azzolini, Damiano, et al.
Published: (2025)

Enabling AI Deep Potentials for Ab Initio-quality Molecular Dynamics Simulations in GROMACS
by: Hu, Andong, et al.
Published: (2026)

Portable High-Performance Kernel Generation for a Computational Fluid Dynamics Code with DaCe
by: Andersson, Måns I., et al.
Published: (2025)

Data Augmentation and Convolutional Network Architecture Influence on Distributed Learning
by: Jansen, Victor Forattini, et al.
Published: (2026)

NLP-Guided Synthesis: Transitioning from Sequential Programs to Distributed Programs
by: Sanjel, Arun, et al.
Published: (2024)

Enabling SSI-Compliant Use of EUDI Wallet Credentials through Trusted Execution Environment and Zero-Knowledge Proof
by: Sitouah, Nacereddine, et al.
Published: (2026)

An optimal algorithm for geodesic mutual visibility on hexagonal grids
by: Badri, Sahar, et al.
Published: (2024)

Gathering in Non-Vertex-Transitive Graphs Under Round Robin
by: Cicerone, Serafino, et al.
Published: (2025)

Multi-Resolution Model Fusion for Accelerating the Convolutional Neural Network Training
by: Wang, Kewei, et al.
Published: (2025)

Broadcast in Almost Mixing Time
by: Paramonov, Anton, et al.
Published: (2025)

A Parallel and Highly-Portable HPC Poisson Solver: Preconditioned Bi-CGSTAB with alpaka
by: Pennati, Luca, et al.
Published: (2025)

Leveraging HPC Profiling & Tracing Tools to Understand the Performance of Particle-in-Cell Monte Carlo Simulations
by: Williams, Jeremy J., et al.
Published: (2023)

GPU-accelerated Linear Algebra for Coupled Solvers in Industrial CFD Applications with OpenFOAM
by: Oliani, Stefano, et al.
Published: (2024)

TimberStrike: Dataset Reconstruction Attack Revealing Privacy Leakage in Federated Tree-Based Systems
by: Di Gennaro, Marco, et al.
Published: (2025)

Zen-Attention: A Compiler Framework for Dynamic Attention Folding on AMD NPUs
by: Deshmukh, Aadesh, et al.
Published: (2025)

Efficient Query Verification for Blockchain Superlight Clients Using SNARKs
by: De Angelis, Stefano, et al.
Published: (2025)

Age-of-Gradient Updates for Federated Learning over Random Access Channels
by: Wu, Yu Heng, et al.
Published: (2024)

SEE++: Evolving Snowpark Execution Environment for Modern Workloads
by: Jain, Gaurav, et al.
Published: (2025)

General Convex Agreement with Near-Optimal Communication
by: Dufay, Marc, et al.
Published: (2026)