Cover Image

EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shi, Danli, Zhang, Weiyi, Yang, Jiancheng, Huang, Siyu, Chen, Xiaolan, Yusufu, Mayinuer, Jin, Kai, Lin, Shan, Liu, Shunming, Zhang, Qing, He, Mingguang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

EyeDiff: text-to-image diffusion model improves rare eye disease diagnosis
by: Chen, Ruoyu, et al.
Published: (2024)

Choroidal Vessel Segmentation on Indocyanine Green Angiography Images via Human-in-the-Loop Labeling
by: Chen, Ruoyu, et al.
Published: (2024)

EyeFound: A Multimodal Generalist Foundation Model for Ophthalmic Imaging
by: Shi, Danli, et al.
Published: (2024)

ChatMyopia: An AI Agent for Pre-consultation Education in Primary Eye Care Settings
by: Wu, Yue, et al.
Published: (2025)

Fundus to Fluorescein Angiography Video Generation as a Retinal Generative Foundation Model
by: Zhang, Weiyi, et al.
Published: (2024)

Fundus2Video: Cross-Modal Angiography Video Generation from Static Fundus Photography with Clinical Knowledge Guidance
by: Zhang, Weiyi, et al.
Published: (2024)

EyeGPT: Ophthalmic Assistant with Large Language Models
by: Chen, Xiaolan, et al.
Published: (2024)

Visual Question Answering in Ophthalmology: A Progressive and Practical Perspective
by: Chen, Xiaolan, et al.
Published: (2024)

Evaluating large language models in medical applications: a survey
by: Chen, Xiaolan, et al.
Published: (2024)

DeepSeek-R1 Outperforms Gemini 2.0 Pro, OpenAI o1, and o3-mini in Bilingual Complex Ophthalmology Reasoning
by: Xu, Pusheng, et al.
Published: (2025)

Benchmarking Large Multimodal Models for Ophthalmic Visual Question Answering with OphthalWeChat
by: Xu, Pusheng, et al.
Published: (2025)

EyeWorld: A Generative World Model of Ocular State and Dynamics
by: Gao, Ziyu, et al.
Published: (2026)

UWF-RI2FA: Generating Multi-frame Ultrawide-field Fluorescein Angiography from Ultrawide-field Retinal Imaging Improves Diabetic Retinopathy Stratification
by: Chen, Ruoyu, et al.
Published: (2024)

EyeAgent: An Agentic AI System for Multimodal Clinical Decision Support in Ophthalmology
by: Shi, Danli, et al.
Published: (2025)

FFA Sora, video generation as fundus fluorescein angiography simulator
by: Wu, Xinyuan, et al.
Published: (2024)

AI-powered virtual eye: perspective, challenges and opportunities
by: Wu, Yue, et al.
Published: (2025)

Exploring epistemological decentring in a language other than English classroom through pedagogical translanguaging
by: Danli Li, et al.
Published: (2024)

Metabolomic network reveals novel biomarkers for type 2 diabetes mellitus in the UK Biobank study
by: Jiahao Liu, et al.
Published: (2025)

Fundus2Globe: Generative AI-Driven 3D Digital Twins for Personalized Myopia Management
by: Shi, Danli, et al.
Published: (2025)

SSVT: Self-Supervised Vision Transformer For Eye Disease Diagnosis Based On Fundus Images
by: Wang, Jiaqi, et al.
Published: (2024)

Underlying brain and genetic mechanisms linking historic phone use patterns, visual decline, and dementia risk in middle‐aged and older adults
by: Xiayin Zhang, et al.
Published: (2025)

LncRNA SNHG14 Participates in the Development of Chronic Obstructive Pulmonary Disease by Targeting the miR‐150‐5p/BASP1 Axis
by: Mayinuer Yibulayin, et al.
Published: (2026)

Robust image classification with multi-modal large language models
by: Villani, Francesco, et al.
Published: (2024)

Category‐Specific Uncertainty Learning for Retinal Disease Diagnosis
by: Lingyi Chu, et al.
Published: (2026)

Establishment of a new vault prediction formula after implantable collamer lens implantation based on factor analysis of multi‐modal ophthalmic parameters of anterior and posterior chamber
by: Yijia Xu, et al.
Published: (2024)

Thinker: A vision-language foundation model for embodied intelligence
by: Pan, Baiyu, et al.
Published: (2026)

From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models
by: Jiang, Dongsheng, et al.
Published: (2023)

M$^3$amba: CLIP-driven Mamba Model for Multi-modal Remote Sensing Classification
by: Cao, Mingxiang, et al.
Published: (2025)

CAPM and Skewness Pricing Under Probability Weighting: Based on the Generalised Wang Transform
by: Jianchun Sun, et al.
Published: (2025)

The language of time: a language model perspective on time-series foundation models
by: Xie, Yi, et al.
Published: (2025)

InterCLIP-MEP: Interactive CLIP and Memory-Enhanced Predictor for Multi-modal Sarcasm Detection
by: Chen, Junjie, et al.
Published: (2024)

PriorCLIP: Visual Prior Guided Vision-Language Model for Remote Sensing Image-Text Retrieval
by: Pan, Jiancheng, et al.
Published: (2024)

GenMed: A Pairwise Generative Reformulation of Medical Diagnostic Tasks
by: Zhang, Hantao, et al.
Published: (2026)

Advancing systemic disease diagnosis through ophthalmic image‐based artificial intelligence
by: Hanpei Miao, et al.
Published: (2024)

Association of metabolomic aging acceleration and body mass index phenotypes with mortality and obesity‐related morbidities
by: Xiaomin Zeng, et al.
Published: (2024)

Microelectromechanical system‐based devices for the diagnosis, treatment, and monitoring of ophthalmic diseases (3/2026)
by: Yaling Peng, et al.
Published: (2026)

Dynamic Adaptive Resource Scheduling for Phased Array Radar: Enhancing Efficiency through Synthesis Priorities and Pulse Interleaving
by: Han, Mingguang
Published: (2024)

AI in ophthalmology: From invisible to visible
by: Mingguang He
Published: (2024)

BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
by: Zhang, Sheng, et al.
Published: (2023)

IsoCLIP: Decomposing CLIP Projectors for Efficient Intra-modal Alignment
by: Magistri, Simone, et al.
Published: (2026)