GigaPevt: Multimodal Medical Assistant

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Blinov, Pavel, Egorov, Konstantin, Sviridov, Ivan, Ivanov, Nikolay, Botman, Stepan, Tagin, Evgeniy, Kudin, Stepan, Zubkova, Galina, Savchenko, Andrey
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916339017318400
author Blinov, Pavel
Egorov, Konstantin
Sviridov, Ivan
Ivanov, Nikolay
Botman, Stepan
Tagin, Evgeniy
Kudin, Stepan
Zubkova, Galina
Savchenko, Andrey
author_facet Blinov, Pavel
Egorov, Konstantin
Sviridov, Ivan
Ivanov, Nikolay
Botman, Stepan
Tagin, Evgeniy
Kudin, Stepan
Zubkova, Galina
Savchenko, Andrey
contents Building an intelligent and efficient medical assistant is still a challenging AI problem. The major limitation comes from the data modality scarceness, which reduces comprehensive patient perception. This demo paper presents the GigaPevt, the first multimodal medical assistant that combines the dialog capabilities of large language models with specialized medical models. Such an approach shows immediate advantages in dialog quality and metric performance, with a 1.18% accuracy improvement in the question-answering task.
format Preprint
id arxiv_https___arxiv_org_abs_2402_16654
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GigaPevt: Multimodal Medical Assistant
Blinov, Pavel
Egorov, Konstantin
Sviridov, Ivan
Ivanov, Nikolay
Botman, Stepan
Tagin, Evgeniy
Kudin, Stepan
Zubkova, Galina
Savchenko, Andrey
Artificial Intelligence
Computation and Language
Human-Computer Interaction
68T07
I.2.1
Building an intelligent and efficient medical assistant is still a challenging AI problem. The major limitation comes from the data modality scarceness, which reduces comprehensive patient perception. This demo paper presents the GigaPevt, the first multimodal medical assistant that combines the dialog capabilities of large language models with specialized medical models. Such an approach shows immediate advantages in dialog quality and metric performance, with a 1.18% accuracy improvement in the question-answering task.
title GigaPevt: Multimodal Medical Assistant
topic Artificial Intelligence
Computation and Language
Human-Computer Interaction
68T07
I.2.1
url https://arxiv.org/abs/2402.16654