Cover Image

A Critical Study of Automatic Evaluation in Sign Language Translation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yazdani, Shakib, Hamidullah, Yasser, España-Bonet, Cristina, Avramidis, Eleftherios, van Genabith, Josef
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Seeing, Signing, and Saying: A Vision-Language Model-Assisted Pipeline for Sign Language Data Acquisition and Curation from Social Media
by: Yazdani, Shakib, et al.
Published: (2025)

SONAR-SLT: Multilingual Sign Language Translation via Language-Agnostic Sentence Embedding Supervision
by: Hamidullah, Yasser, et al.
Published: (2025)

Sign Language Translation with Sentence Embedding Supervision
by: Hamidullah, Yasser, et al.
Published: (2025)

Spatio-temporal Sign Language Representation and Translation
by: Hamidullah, Yasser, et al.
Published: (2025)

DFKI-MLT at SemEval-2026 TASK 7: Steering Multilingual Models Towards Cultural Knowledge
by: Ghussin, Yusser Al, et al.
Published: (2026)

PETra: A Multilingual Corpus of Pragmatic Explicitation in Translation
by: Osmelak, Doreen, et al.
Published: (2025)

Measuring Spurious Correlation in Classification: 'Clever Hans' in Translationese
by: Borah, Angana, et al.
Published: (2023)

When your Cousin has the Right Connections: Unsupervised Bilingual Lexicon Induction for Related Data-Imbalanced Languages
by: Bafna, Niyati, et al.
Published: (2023)

The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face?
by: Pham, Dinh Nam, et al.
Published: (2025)

Evaluation of a Sign Language Avatar on Comprehensibility, User Experience \& Acceptability
by: Wasserroth, Fenya, et al.
Published: (2025)

When Flores Bloomz Wrong: Cross-Direction Contamination in Machine Translation Evaluation
by: Tan, David, et al.
Published: (2026)

DualFact+: A Multimodal Fact Verification Framework for Procedural Video Understanding
by: Oguz, Cennet, et al.
Published: (2026)

When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification
by: Shcharbakova, Hanna, et al.
Published: (2025)

Probing Context Localization of Polysemous Words in Pre-trained Language Model Sub-Layers
by: Vijayakumar, Soniya, et al.
Published: (2024)

On Multilingual Encoder Language Model Compression for Low-Resource Languages
by: Gurgurov, Daniil, et al.
Published: (2025)

Sparse Subnetwork Enhancement for Underrepresented Languages in Large Language Models
by: Gurgurov, Daniil, et al.
Published: (2025)

Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
by: Baeumel, Tanja, et al.
Published: (2026)

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages
by: Gurgurov, Daniil, et al.
Published: (2025)

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation
by: Kocmi, Tom, et al.
Published: (2024)

Automatic Fact-checking in English and Telugu
by: Chikkala, Ravi Kiran, et al.
Published: (2025)

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs
by: Baeumel, Tanja, et al.
Published: (2025)

SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation
by: Kim, Jung-Ho, et al.
Published: (2024)

Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language
by: Pham, Dinh Nam, et al.
Published: (2025)

The TUB Sign Language Corpus Collection
by: Avramidis, Eleftherios, et al.
Published: (2025)

AutoPsyC: Automatic Recognition of Psychodynamic Conflicts from Semi-structured Interviews with Large Language Models
by: Hossain, Sayed Muddashir, et al.
Published: (2025)

Listening or Reading? Evaluating Speech Awareness in Chain-of-Thought Speech-to-Text Translation
by: Romero-Díaz, Jacobo, et al.
Published: (2025)

Why Does Reinforcement Learning Generalize? A Feature-Level Mechanistic Study of Post-Training in Large Language Models
by: Shi, Dan, et al.
Published: (2026)

The Latin Substrate: How Language Models Represent and Mediate Script Choice
by: Gurgurov, Daniil, et al.
Published: (2026)

Revisiting Direct Speech-to-Text Translation with Speech LLMs: Better Scaling than CoT Prompting?
by: Pareras, Oriol, et al.
Published: (2025)

Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation
by: Gurgurov, Daniil, et al.
Published: (2025)

Multilingual Political Views of Large Language Models: Identification and Steering
by: Gurgurov, Daniil, et al.
Published: (2025)

Modular Arithmetic: Language Models Solve Math Digit by Digit
by: Baeumel, Tanja, et al.
Published: (2025)

ReasonXL: Shifting LLM Reasoning Language Without Sacrificing Performance
by: Gurgurov, Daniil, et al.
Published: (2026)

Evaluation of Pose Estimation Systems for Sign Language Translation
by: O'Brien, Catherine, et al.
Published: (2026)

Rewiring the Transformer with Depth-Wise LSTMs
by: Xu, Hongfei, et al.
Published: (2020)

Reverse Probing: Evaluating Knowledge Transfer via Finetuned Task Embeddings for Coreference Resolution
by: Anikina, Tatiana, et al.
Published: (2025)

LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools and Self-Explanations
by: Wang, Qianli, et al.
Published: (2024)

Unsupervised Sign Language Translation and Generation
by: Guo, Zhengsheng, et al.
Published: (2024)

SignDATA: Data Pipeline for Sign Language Translation
by: Chen, Kuanwei, et al.
Published: (2026)

Multilingual Steering by Design: Multilingual Sparse Autoencoders and Principled Layer Selection
by: Ghussin, Yusser Al, et al.
Published: (2026)