Osmotic Learning: A Self-Supervised Paradigm for Decentralized Contextual Data Representation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Colosi, Mario, Farahani, Reza, Fazio, Maria, Prodan, Radu, Villari, Massimo
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917173510799360
author Colosi, Mario
Farahani, Reza
Fazio, Maria
Prodan, Radu
Villari, Massimo
author_facet Colosi, Mario
Farahani, Reza
Fazio, Maria
Prodan, Radu
Villari, Massimo
contents Data within a specific context gains deeper significance beyond its isolated interpretation. In distributed systems, interdependent data sources reveal hidden relationships and latent structures, representing valuable information for many applications. This paper introduces Osmotic Learning (OSM-L), a self-supervised distributed learning paradigm designed to uncover higher-level latent knowledge from distributed data. The core of OSM-L is osmosis, a process that synthesizes dense and compact representation by extracting contextual information, eliminating the need for raw data exchange between distributed entities. OSM-L iteratively aligns local data representations, enabling information diffusion and convergence into a dynamic equilibrium that captures contextual patterns. During training, it also identifies correlated data groups, functioning as a decentralized clustering mechanism. Experimental results confirm OSM-L's convergence and representation capabilities on structured datasets, achieving over 0.99 accuracy in local information alignment while preserving contextual integrity.
format Preprint
id arxiv_https___arxiv_org_abs_2512_23096
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Osmotic Learning: A Self-Supervised Paradigm for Decentralized Contextual Data Representation
Colosi, Mario
Farahani, Reza
Fazio, Maria
Prodan, Radu
Villari, Massimo
Machine Learning
Distributed, Parallel, and Cluster Computing
Data within a specific context gains deeper significance beyond its isolated interpretation. In distributed systems, interdependent data sources reveal hidden relationships and latent structures, representing valuable information for many applications. This paper introduces Osmotic Learning (OSM-L), a self-supervised distributed learning paradigm designed to uncover higher-level latent knowledge from distributed data. The core of OSM-L is osmosis, a process that synthesizes dense and compact representation by extracting contextual information, eliminating the need for raw data exchange between distributed entities. OSM-L iteratively aligns local data representations, enabling information diffusion and convergence into a dynamic equilibrium that captures contextual patterns. During training, it also identifies correlated data groups, functioning as a decentralized clustering mechanism. Experimental results confirm OSM-L's convergence and representation capabilities on structured datasets, achieving over 0.99 accuracy in local information alignment while preserving contextual integrity.
title Osmotic Learning: A Self-Supervised Paradigm for Decentralized Contextual Data Representation
topic Machine Learning
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2512.23096