Transformers in Healthcare: A Survey

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Nerella, Subhash, Bandyopadhyay, Sabyasachi, Zhang, Jiaqing, Contreras, Miguel, Siegel, Scott, Bumin, Aysegul, Silva, Brandon, Sena, Jessica, Shickel, Benjamin, Bihorac, Azra, Khezeli, Kia, Rashidi, Parisa
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910707551830016
author Nerella, Subhash
Bandyopadhyay, Sabyasachi
Zhang, Jiaqing
Contreras, Miguel
Siegel, Scott
Bumin, Aysegul
Silva, Brandon
Sena, Jessica
Shickel, Benjamin
Bihorac, Azra
Khezeli, Kia
Rashidi, Parisa
author_facet Nerella, Subhash
Bandyopadhyay, Sabyasachi
Zhang, Jiaqing
Contreras, Miguel
Siegel, Scott
Bumin, Aysegul
Silva, Brandon
Sena, Jessica
Shickel, Benjamin
Bihorac, Azra
Khezeli, Kia
Rashidi, Parisa
contents With Artificial Intelligence (AI) increasingly permeating various aspects of society, including healthcare, the adoption of the Transformers neural network architecture is rapidly changing many applications. Transformer is a type of deep learning architecture initially developed to solve general-purpose Natural Language Processing (NLP) tasks and has subsequently been adapted in many fields, including healthcare. In this survey paper, we provide an overview of how this architecture has been adopted to analyze various forms of data, including medical imaging, structured and unstructured Electronic Health Records (EHR), social media, physiological signals, and biomolecular sequences. Those models could help in clinical diagnosis, report generation, data reconstruction, and drug/protein synthesis. We identified relevant studies using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We also discuss the benefits and limitations of using transformers in healthcare and examine issues such as computational cost, model interpretability, fairness, alignment with human values, ethical implications, and environmental impact.
format Preprint
id arxiv_https___arxiv_org_abs_2307_00067
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Transformers in Healthcare: A Survey
Nerella, Subhash
Bandyopadhyay, Sabyasachi
Zhang, Jiaqing
Contreras, Miguel
Siegel, Scott
Bumin, Aysegul
Silva, Brandon
Sena, Jessica
Shickel, Benjamin
Bihorac, Azra
Khezeli, Kia
Rashidi, Parisa
Artificial Intelligence
Computers and Society
Machine Learning
With Artificial Intelligence (AI) increasingly permeating various aspects of society, including healthcare, the adoption of the Transformers neural network architecture is rapidly changing many applications. Transformer is a type of deep learning architecture initially developed to solve general-purpose Natural Language Processing (NLP) tasks and has subsequently been adapted in many fields, including healthcare. In this survey paper, we provide an overview of how this architecture has been adopted to analyze various forms of data, including medical imaging, structured and unstructured Electronic Health Records (EHR), social media, physiological signals, and biomolecular sequences. Those models could help in clinical diagnosis, report generation, data reconstruction, and drug/protein synthesis. We identified relevant studies using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We also discuss the benefits and limitations of using transformers in healthcare and examine issues such as computational cost, model interpretability, fairness, alignment with human values, ethical implications, and environmental impact.
title Transformers in Healthcare: A Survey
topic Artificial Intelligence
Computers and Society
Machine Learning
url https://arxiv.org/abs/2307.00067