Lattica: A Decentralized Cross-NAT Communication Framework for Scalable AI Inference and Training

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Ween, Liu, Jason, Wang, Suli, Song, Xinyuan, Ai, Lynn, Yang, Eric, Shi, Bill
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918153564454912
author Yang, Ween
Liu, Jason
Wang, Suli
Song, Xinyuan
Ai, Lynn
Yang, Eric
Shi, Bill
author_facet Yang, Ween
Liu, Jason
Wang, Suli
Song, Xinyuan
Ai, Lynn
Yang, Eric
Shi, Bill
contents The rapid expansion of distributed Artificial Intelligence (AI) workloads beyond centralized data centers creates a demand for new communication substrates. These substrates must operate reliably in heterogeneous and permissionless environments, where Network Address Translators (NATs) and firewalls impose significant constraints. Existing solutions, however, are either designed for controlled data center deployments or implemented as monolithic systems that tightly couple machine learning logic with networking code. To address these limitations, we present Lattica, a decentralized cross-NAT communication framework designed to support distributed AI systems. Lattica integrates three core components. First, it employs a robust suite of NAT traversal mechanisms to establish a globally addressable peer-to-peer mesh. Second, it provides a decentralized data store based on Conflict-free Replicated Data Types (CRDTs), ensuring verifiable and eventually consistent state replication. Third, it incorporates a content discovery layer that leverages distributed hash tables (DHTs) together with an optimized RPC protocol for efficient model synchronization. By integrating these components, Lattica delivers a complete protocol stack for sovereign, resilient, and scalable AI systems that operate independently of centralized intermediaries. It is directly applicable to edge intelligence, collaborative reinforcement learning, and other large-scale distributed machine learning scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2510_00183
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Lattica: A Decentralized Cross-NAT Communication Framework for Scalable AI Inference and Training
Yang, Ween
Liu, Jason
Wang, Suli
Song, Xinyuan
Ai, Lynn
Yang, Eric
Shi, Bill
Distributed, Parallel, and Cluster Computing
The rapid expansion of distributed Artificial Intelligence (AI) workloads beyond centralized data centers creates a demand for new communication substrates. These substrates must operate reliably in heterogeneous and permissionless environments, where Network Address Translators (NATs) and firewalls impose significant constraints. Existing solutions, however, are either designed for controlled data center deployments or implemented as monolithic systems that tightly couple machine learning logic with networking code. To address these limitations, we present Lattica, a decentralized cross-NAT communication framework designed to support distributed AI systems. Lattica integrates three core components. First, it employs a robust suite of NAT traversal mechanisms to establish a globally addressable peer-to-peer mesh. Second, it provides a decentralized data store based on Conflict-free Replicated Data Types (CRDTs), ensuring verifiable and eventually consistent state replication. Third, it incorporates a content discovery layer that leverages distributed hash tables (DHTs) together with an optimized RPC protocol for efficient model synchronization. By integrating these components, Lattica delivers a complete protocol stack for sovereign, resilient, and scalable AI systems that operate independently of centralized intermediaries. It is directly applicable to edge intelligence, collaborative reinforcement learning, and other large-scale distributed machine learning scenarios.
title Lattica: A Decentralized Cross-NAT Communication Framework for Scalable AI Inference and Training
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2510.00183