GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kouremenos, Dimitris, Ntalianis, Klimis
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909452687376384
author Kouremenos, Dimitris
Ntalianis, Klimis
author_facet Kouremenos, Dimitris
Ntalianis, Klimis
contents The Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility (GLaM-Sign) [1] is a groundbreaking resource in accessibility and multimodal AI, designed to support Deaf and Hard-of-Hearing (DHH) individuals. Developed from the FEELIT project [2], it integrates high-resolution audio, video, textual transcriptions, and Greek Sign Language translations for applications like real-time sign language translation and enhanced subtitle synchronization. While its primary focus is on promoting inclusivity in the Greek tourism sector, its adaptability extends to education, healthcare, and public services. Future advancements will enhance word-level precision and scalability to additional languages, supported by advanced AI methodologies and collaborations with diverse stakeholders. This dataset underscores the transformative potential of multimodal resources in bridging communication gaps, fostering innovation, and setting a benchmark for ethical AI and inclusive technologies.
format Preprint
id arxiv_https___arxiv_org_abs_2501_05213
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility
Kouremenos, Dimitris
Ntalianis, Klimis
Computation and Language
Artificial Intelligence
The Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility (GLaM-Sign) [1] is a groundbreaking resource in accessibility and multimodal AI, designed to support Deaf and Hard-of-Hearing (DHH) individuals. Developed from the FEELIT project [2], it integrates high-resolution audio, video, textual transcriptions, and Greek Sign Language translations for applications like real-time sign language translation and enhanced subtitle synchronization. While its primary focus is on promoting inclusivity in the Greek tourism sector, its adaptability extends to education, healthcare, and public services. Future advancements will enhance word-level precision and scalability to additional languages, supported by advanced AI methodologies and collaborations with diverse stakeholders. This dataset underscores the transformative potential of multimodal resources in bridging communication gaps, fostering innovation, and setting a benchmark for ethical AI and inclusive technologies.
title GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2501.05213