Cover Image

An Automatic Quality Metric for Evaluating Simultaneous Interpretation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Makinae, Mana, Sudoh, Katsuhito, Yamada, Masaru, Nakamura, Satoshi
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Word Order in English-Japanese Simultaneous Interpretation: Analyses and Evaluation using Chunk-wise Monotonic Translation
by: Doi, Kosuke, et al.
Published: (2024)

LLMs Are Zero-Shot Context-Aware Simultaneous Translators
by: Koshkin, Roman, et al.
Published: (2024)

TransLLaMa: LLM-based Simultaneous Translation System
by: Koshkin, Roman, et al.
Published: (2024)

Automated Essay Scoring Using Grammatical Variety and Errors with Multi-Task Learning and Item Response Theory
by: Doi, Kosuke, et al.
Published: (2024)

NAIST-SIC-Aligned: an Aligned English-Japanese Simultaneous Interpretation Corpus
by: Zhao, Jinming, et al.
Published: (2023)

NAIST Simultaneous Speech Translation System for IWSLT 2024
by: Ko, Yuka, et al.
Published: (2024)

Subspace Representations for Soft Set Operations and Sentence Similarities
by: Ishibashi, Yoichi, et al.
Published: (2022)

Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair
by: Sakai, Yusuke, et al.
Published: (2024)

Top-down string-to-dependency Neural Machine Translation
by: Kondo, Shuhei, et al.
Published: (2026)

Evaluating the IWSLT2023 Speech Translation Tasks: Human Annotations, Automatic Metrics, and Segmentation
by: Sperber, Matthias, et al.
Published: (2024)

Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategies
by: Zhang, Qianen, et al.
Published: (2025)

Redefining Machine Simultaneous Interpretation: From Incremental Translation to Human-Like Strategies
by: Zhang, Qianen, et al.
Published: (2026)

Reading Comprehension using Entity-based Memory Network
by: Wang, Xun, et al.
Published: (2016)

Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT's Customizability
by: Yamada, Masaru
Published: (2023)

Translators as Invisible Teachers of AI: Copyright, Translation Memory, and the Political Economy of Linguistic Data
by: Yamada, Masaru
Published: (2026)

DPO-Tuned Large Language Models for Segmentation in Simultaneous Speech Translation
by: Yang, Zeyu, et al.
Published: (2025)

Real-Time Generation of Game Video Commentary with Multimodal LLMs: Pause-Aware Decoding Approaches
by: Afzal, Anum, et al.
Published: (2026)

Can Automatic Metrics Assess High-Quality Translations?
by: Agrawal, Sweta, et al.
Published: (2024)

Quality and Quantity of Machine Translation References for Automatic Metrics
by: Zouhar, Vilém, et al.
Published: (2024)

Agentic AI Translate: An Agentic Translator Prototype for Translation as Communication Design
by: Yamada, Masaru
Published: (2026)

SASST: Leveraging Syntax-Aware Chunking and LLMs for Simultaneous Speech Translation
by: Yang, Zeyu, et al.
Published: (2025)

A Paradigm for Interpreting Metrics and Identifying Critical Errors in Automatic Speech Recognition
by: Bañeras-Roux, Thibault, et al.
Published: (2026)

Evaluating Automatic Metrics with Incremental Machine Translation Systems
by: Wu, Guojun, et al.
Published: (2024)

Towards Automatic Evaluation for LLMs' Clinical Capabilities: Metric, Data, and Algorithm
by: Liu, Lei, et al.
Published: (2024)

TeXBLEU: Automatic Metric for Evaluate LaTeX Format
by: Jung, Kyudan, et al.
Published: (2024)

PEEM: Prompt Engineering Evaluation Metrics for Interpretable Joint Evaluation of Prompts and Responses
by: Hong, Minki, et al.
Published: (2026)

Gradient-Informed Training for Low-Resource Multilingual Speech Translation
by: Sun, Ruiyan, et al.
Published: (2026)

Automatic Metrics in Natural Language Generation: A Survey of Current Evaluation Practices
by: Schmidtová, Patrícia, et al.
Published: (2024)

AutoMetrics: Approximate Human Judgements with Automatically Generated Evaluators
by: Ryan, Michael J., et al.
Published: (2025)

Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics
by: Perrella, Stefano, et al.
Published: (2024)

Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation
by: Agrawal, Sweta, et al.
Published: (2024)

Comprehensiveness Metrics for Automatic Evaluation of Factual Recall in Text Generation
by: Dejl, Adam, et al.
Published: (2025)

Do Automatic Factuality Metrics Measure Factuality? A Critical Evaluation
by: Ramprasad, Sanjana, et al.
Published: (2024)

Automatic Evaluation Metrics for Document-level Translation: Overview, Challenges and Trends
by: GUO, Jiaxin, et al.
Published: (2025)

MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language
by: Wang, Shun, et al.
Published: (2024)

Model Utility Law: Evaluating LLMs beyond Performance through Mechanism Interpretable Metric
by: Cao, Yixin, et al.
Published: (2025)

A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability
by: Hu, Xinyu, et al.
Published: (2025)

DENEB: A Hallucination-Robust Automatic Evaluation Metric for Image Captioning
by: Matsuda, Kazuki, et al.
Published: (2024)

Enhancing Argument Summarization: Prioritizing Exhaustiveness in Key Point Generation and Introducing an Automatic Coverage Evaluation Metric
by: Khosravani, Mohammad, et al.
Published: (2024)

HATS: An Open data set Integrating Human Perception Applied to the Evaluation of Automatic Speech Recognition Metrics
by: Roux, Thibault Bañeras, et al.
Published: (2026)