Ocean-OCR: Towards General OCR Application via a Vision-Language Model
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929687822860288 |
|---|---|
| author | Chen, Song Guo, Xinyu Li, Yadong Zhang, Tao Lin, Mingan Kuang, Dongdong Zhang, Youwei Ming, Lingfeng Zhang, Fengyu Wang, Yuran Xu, Jianhua Zhou, Zenan Chen, Weipeng |
| author_facet | Chen, Song Guo, Xinyu Li, Yadong Zhang, Tao Lin, Mingan Kuang, Dongdong Zhang, Youwei Ming, Lingfeng Zhang, Fengyu Wang, Yuran Xu, Jianhua Zhou, Zenan Chen, Weipeng |
| contents | Multimodal large language models (MLLMs) have shown impressive capabilities across various domains, excelling in processing and understanding information from multiple modalities. Despite the rapid progress made previously, insufficient OCR ability hinders MLLMs from excelling in text-related tasks. In this paper, we present \textbf{Ocean-OCR}, a 3B MLLM with state-of-the-art performance on various OCR scenarios and comparable understanding ability on general tasks. We employ Native Resolution ViT to enable variable resolution input and utilize a substantial collection of high-quality OCR datasets to enhance the model performance. We demonstrate the superiority of Ocean-OCR through comprehensive experiments on open-source OCR benchmarks and across various OCR scenarios. These scenarios encompass document understanding, scene text recognition, and handwritten recognition, highlighting the robust OCR capabilities of Ocean-OCR. Note that Ocean-OCR is the first MLLM to outperform professional OCR models such as TextIn and PaddleOCR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_15558 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Ocean-OCR: Towards General OCR Application via a Vision-Language Model Chen, Song Guo, Xinyu Li, Yadong Zhang, Tao Lin, Mingan Kuang, Dongdong Zhang, Youwei Ming, Lingfeng Zhang, Fengyu Wang, Yuran Xu, Jianhua Zhou, Zenan Chen, Weipeng Computer Vision and Pattern Recognition Multimodal large language models (MLLMs) have shown impressive capabilities across various domains, excelling in processing and understanding information from multiple modalities. Despite the rapid progress made previously, insufficient OCR ability hinders MLLMs from excelling in text-related tasks. In this paper, we present \textbf{Ocean-OCR}, a 3B MLLM with state-of-the-art performance on various OCR scenarios and comparable understanding ability on general tasks. We employ Native Resolution ViT to enable variable resolution input and utilize a substantial collection of high-quality OCR datasets to enhance the model performance. We demonstrate the superiority of Ocean-OCR through comprehensive experiments on open-source OCR benchmarks and across various OCR scenarios. These scenarios encompass document understanding, scene text recognition, and handwritten recognition, highlighting the robust OCR capabilities of Ocean-OCR. Note that Ocean-OCR is the first MLLM to outperform professional OCR models such as TextIn and PaddleOCR. |
| title | Ocean-OCR: Towards General OCR Application via a Vision-Language Model |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2501.15558 |