OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xue, Yida, Zhang, Ningyu, Wu, Tingwei, Ma, Zhe, Ji, Daxiong, Wang, Zhao, Zheng, Guozhou, Chen, Huajun
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917463012147200
author Xue, Yida
Zhang, Ningyu
Wu, Tingwei
Ma, Zhe
Ji, Daxiong
Wang, Zhao
Zheng, Guozhou
Chen, Huajun
author_facet Xue, Yida
Zhang, Ningyu
Wu, Tingwei
Ma, Zhe
Ji, Daxiong
Wang, Zhao
Zheng, Guozhou
Chen, Huajun
contents The vast and underexplored ocean plays a critical role in regulating global climate and supporting marine biodiversity, yet artificial intelligence has so far delivered limited impact in this domain due to a fundamental data bottleneck. Specifically, ocean data are highly fragmented across disparate sources and inherently exhibit multi-modal, high-noise, and weakly labeled characteristics, lacking unified schemas and semantic alignment. Although Multimodal Large Language Models (MLLMs) have achieved remarkable success in general domains, their application to ocean science remains severely constrained by the absence of large-scale, well-aligned multimodal datasets tailored to marine environments. To bridge this gap, we introduce OceanPile, a large-scale multimodal corpus designed for ocean foundation models. It comprises three key components: OceanCorpus, a unified collection integrating sonar data, underwater imagery, marine science visuals, and scientific text from diverse authoritative sources; OceanInstruction, a high-quality instruction dataset synthesized via a novel pipeline guided by a hierarchical Ocean Concept Knowledge Graph; and OceanBenchmark, a manually curated evaluation benchmark for rigorous assessment. We establish a multi-stage quality control process to ensure scientific validity and alignment across modalities. Experimental validation demonstrates significant performance improvements for models trained on our data. All datasets are publicly released to advance the field of marine artificial intelligence and empower domain-specific MLLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2605_00877
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models
Xue, Yida
Zhang, Ningyu
Wu, Tingwei
Ma, Zhe
Ji, Daxiong
Wang, Zhao
Zheng, Guozhou
Chen, Huajun
Multimedia
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Machine Learning
The vast and underexplored ocean plays a critical role in regulating global climate and supporting marine biodiversity, yet artificial intelligence has so far delivered limited impact in this domain due to a fundamental data bottleneck. Specifically, ocean data are highly fragmented across disparate sources and inherently exhibit multi-modal, high-noise, and weakly labeled characteristics, lacking unified schemas and semantic alignment. Although Multimodal Large Language Models (MLLMs) have achieved remarkable success in general domains, their application to ocean science remains severely constrained by the absence of large-scale, well-aligned multimodal datasets tailored to marine environments. To bridge this gap, we introduce OceanPile, a large-scale multimodal corpus designed for ocean foundation models. It comprises three key components: OceanCorpus, a unified collection integrating sonar data, underwater imagery, marine science visuals, and scientific text from diverse authoritative sources; OceanInstruction, a high-quality instruction dataset synthesized via a novel pipeline guided by a hierarchical Ocean Concept Knowledge Graph; and OceanBenchmark, a manually curated evaluation benchmark for rigorous assessment. We establish a multi-stage quality control process to ensure scientific validity and alignment across modalities. Experimental validation demonstrates significant performance improvements for models trained on our data. All datasets are publicly released to advance the field of marine artificial intelligence and empower domain-specific MLLMs.
title OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models
topic Multimedia
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2605.00877