Cover Image

Babel: A Scalable Pre-trained Model for Multi-Modal Sensing via Expandable Modality Alignment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dai, Shenghong, Jiang, Shiqi, Yang, Yifan, Cao, Ting, Li, Mo, Banerjee, Suman, Qiu, Lili
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning Signal Processing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-Modal Intelligent Channel Modeling: From Fine-tuned LLMs to Pre-trained Foundation Models
by: Bai, Lu, et al.
Published: (2026)

Multi-Modal Fiber Sensing for OffshoreEnvironmental and Infrastructure Monitoring
by: Alexoudis, Konstantinos, et al.
Published: (2026)

Artificial-Intelligence-Assisted Multi-Modal Terahertz Sensing and Environment Reconstruction
by: Lyu, Yejian, et al.
Published: (2026)

MEDUSA: Scalable Biometric Sensing in the Wild through Distributed MIMO Radars
by: Li, Yilong, et al.
Published: (2023)

RMD: Robust Modal Decomposition with Constrained Bandwidth
by: Hao, Wang, et al.
Published: (2025)

Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)
by: Zhang, Haotian, et al.
Published: (2023)

Multi-Modal Sensing Residual-Corrected GNN for mmWave Path Loss Prediction via Synesthesia of Machines
by: Lu, Mengyuan, et al.
Published: (2026)

A Short Overview of Multi-Modal Wi-Fi Sensing
by: Zhao, Zijian
Published: (2025)

A Multi-Modal Foundational Model for Wireless Communication and Sensing
by: Yazdnian, Vahid, et al.
Published: (2026)

Synesthesia of Machines (SoM)-Aided Online FDD Precoding via Heterogeneous Multi-Modal Sensing: A Vertical Federated Learning Approach
by: Zhang, Haotian, et al.
Published: (2025)

Multi-Modal Environmental Sensing Based Path Loss Prediction for V2I Communications
by: Wang, Kai, et al.
Published: (2024)

SynthSoM-Twin: A Multi-Modal Sensing-Communication Digital-Twin Dataset for Sim2Real Transfer via Synesthesia of Machines
by: Chen, Junlong, et al.
Published: (2025)

Multi-Modal Beamforming with Model Compression and Modality Generation for V2X Networks
by: Shang, Chen, et al.
Published: (2025)

Multi-Modal Fusion-Based Multi-Task Semantic Communication System
by: Zhu, Zengle, et al.
Published: (2024)

A Multi-Modal Intelligent U2V Channel Model for 6G Sensing-Communication Integration
by: Wang, Shuo, et al.
Published: (2026)

PrismNet: Viewing Time Series Through a Multi-Modal Prism for Interpretable Power Load Forecasting
by: Chen, Yuxuan, et al.
Published: (2026)

Foundation Model Empowered Synesthesia of Machines (SoM): AI-native Intelligent Multi-Modal Sensing-Communication Integration
by: Cheng, Xiang, et al.
Published: (2025)

Simultaneous Multi-Modal Covert Communications: Analysis and Optimization
by: Kong, Justin H., et al.
Published: (2026)

Enhancing Alzheimer's Detection through Late Fusion of Multi-Modal EEG Features
by: Vinh, Nguyen Thanh, et al.
Published: (2025)

Scatterer Recognition for Multi-Modal Intelligent Vehicular Channel Modeling via Synesthesia of Machines
by: Huang, Ziwei, et al.
Published: (2024)

Canine EEG Helps Human: Cross-Species and Cross-Modality Epileptic Seizure Detection via Multi-Space Alignment
by: Wang, Z., et al.
Published: (2024)

Multi-Modal Concurrent Transmission
by: Khormuji, Majid Nasiri, et al.
Published: (2024)

Modally Reduced Representation Learning of Multi-Lead ECG Signals through Simultaneous Alignment and Reconstruction
by: Ibtehaz, Nabil, et al.
Published: (2024)

Design and Benchmarking of A Multi-Modality Sensor for Robotic Manipulation with GAN-Based Cross-Modality Interpretation
by: Zhang, Dandan, et al.
Published: (2025)

Multi-Modal Intelligent Channel Modeling: A New Modeling Paradigm via Synesthesia of Machines
by: Bai, Lu, et al.
Published: (2024)

A Harmony Composition-Inspired Tensor Modalization Method for Near-Field IRS Channel Estimation
by: Cao, Wenzhou, et al.
Published: (2026)

Environment Reconstruction based on Multi-User Selection and Multi-Modal Fusion in ISAC
by: Lin, Bo, et al.
Published: (2024)

Gemini: Integrating Full-fledged Sensing upon Millimeter Wave Communications
by: Li, Yilong, et al.
Published: (2024)

Scalable Multi-task Edge Sensing via Task-oriented Joint Information Gathering and Broadcast
by: Hou, Huawei, et al.
Published: (2025)

FLAME: A Federated Learning Approach for Multi-Modal RF Fingerprinting
by: Kianfar, Kiarash, et al.
Published: (2025)

Efficient Domain Generalization in Wireless Networks with Scarce Multi-Modal Data
by: Kim, Minsu, et al.
Published: (2025)

Addressing the Curse of Scenario and Task Generalization in AI-6G: A Multi-Modal Paradigm
by: Jiao, Tianyu, et al.
Published: (2025)

CIG-MAE: Cross-Modal Information-Guided Masked Autoencoder for Self-Supervised WiFi Sensing
by: Liu, Gang, et al.
Published: (2025)

BodySense: An Expandable and Wearable-Sized Wireless Evaluation Platform for Human Body Communication
by: Schulthess, Lukas, et al.
Published: (2025)

Demo: Multi-Modal Seizure Prediction System
by: Saeizadeh, Ali, et al.
Published: (2024)

Multi-Modal Neural Radio Radiance Field for Localized Statistical Channel Modelling
by: Wang, Yiheng, et al.
Published: (2025)

sleep2vec: Unified Cross-Modal Alignment for Heterogeneous Nocturnal Biosignals
by: Yuan, Weixuan, et al.
Published: (2026)

Scenario-Agnostic Deep-Learning-Based Localization with Contrastive Self-Supervised Pre-training
by: Zhang, Lingyan, et al.
Published: (2025)

RJD-BASE: Multi-Modal Spectral Clustering via Randomized Joint Diagonalization
by: He, Haoze, et al.
Published: (2025)

Cross-Modal Epileptic Signal Harmonization: Frequency Domain Mapping Quantization for Pre-training a Unified Neurophysiological Transformer
by: Zhang, Runkai, et al.
Published: (2025)