Multimodal Learning for Embryo Viability Prediction in Clinical IVF

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Junsik, Shi, Zhiyi, Jeong, Davin, Knittel, Johannes, Yang, Helen Y., Song, Yonghyun, Li, Wanhua, Li, Yicong, Ben-Yosef, Dalit, Needleman, Daniel, Pfister, Hanspeter
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917810248089600
author Kim, Junsik
Shi, Zhiyi
Jeong, Davin
Knittel, Johannes
Yang, Helen Y.
Song, Yonghyun
Li, Wanhua
Li, Yicong
Ben-Yosef, Dalit
Needleman, Daniel
Pfister, Hanspeter
author_facet Kim, Junsik
Shi, Zhiyi
Jeong, Davin
Knittel, Johannes
Yang, Helen Y.
Song, Yonghyun
Li, Wanhua
Li, Yicong
Ben-Yosef, Dalit
Needleman, Daniel
Pfister, Hanspeter
contents In clinical In-Vitro Fertilization (IVF), identifying the most viable embryo for transfer is important to increasing the likelihood of a successful pregnancy. Traditionally, this process involves embryologists manually assessing embryos' static morphological features at specific intervals using light microscopy. This manual evaluation is not only time-intensive and costly, due to the need for expert analysis, but also inherently subjective, leading to variability in the selection process. To address these challenges, we develop a multimodal model that leverages both time-lapse video data and Electronic Health Records (EHRs) to predict embryo viability. One of the primary challenges of our research is to effectively combine time-lapse video and EHR data, owing to their inherent differences in modality. We comprehensively analyze our multimodal model with various modality inputs and integration approaches. Our approach will enable fast and automated embryo viability predictions in scale for clinical IVF.
format Preprint
id arxiv_https___arxiv_org_abs_2410_15581
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multimodal Learning for Embryo Viability Prediction in Clinical IVF
Kim, Junsik
Shi, Zhiyi
Jeong, Davin
Knittel, Johannes
Yang, Helen Y.
Song, Yonghyun
Li, Wanhua
Li, Yicong
Ben-Yosef, Dalit
Needleman, Daniel
Pfister, Hanspeter
Computer Vision and Pattern Recognition
Machine Learning
In clinical In-Vitro Fertilization (IVF), identifying the most viable embryo for transfer is important to increasing the likelihood of a successful pregnancy. Traditionally, this process involves embryologists manually assessing embryos' static morphological features at specific intervals using light microscopy. This manual evaluation is not only time-intensive and costly, due to the need for expert analysis, but also inherently subjective, leading to variability in the selection process. To address these challenges, we develop a multimodal model that leverages both time-lapse video data and Electronic Health Records (EHRs) to predict embryo viability. One of the primary challenges of our research is to effectively combine time-lapse video and EHR data, owing to their inherent differences in modality. We comprehensively analyze our multimodal model with various modality inputs and integration approaches. Our approach will enable fast and automated embryo viability predictions in scale for clinical IVF.
title Multimodal Learning for Embryo Viability Prediction in Clinical IVF
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2410.15581