Cover Image

DMDTEval: An Evaluation and Analysis of LLMs on Disambiguation in Multi-domain Translation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Man, Zhibo, Chen, Yuanmeng, Zhang, Yujie, Xu, Jinan
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SoT: Structured-of-Thought Prompting Guides Multilingual Reasoning in Large Language Models
by: Qi, Rui, et al.
Published: (2025)

Evaluating LLMs on Entity Disambiguation in Tables
by: Belotti, Federico, et al.
Published: (2024)

Beyond Binary Gender: Evaluating Gender-Inclusive Machine Translation with Ambiguous Attitude Words
by: Chen, Yijie, et al.
Published: (2024)

An Exploration-Analysis-Disambiguation Reasoning Framework for Word Sense Disambiguation with Low-Parameter LLMs
by: Sumanathilaka, Deshan, et al.
Published: (2026)

Towards Faster k-Nearest-Neighbor Machine Translation
by: Shi, Xiangyu, et al.
Published: (2023)

Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures
by: Manna, Chiara, et al.
Published: (2026)

LLMs for Robotic Object Disambiguation
by: Jiang, Connie, et al.
Published: (2024)

Multi-domain Multi-modal Document Classification Benchmark with a Multi-level Taxonomy
by: Ma, Denghao, et al.
Published: (2026)

Evaluating LLMs on Chinese Idiom Translation
by: Yang, Cai, et al.
Published: (2025)

Active Task Disambiguation with LLMs
by: Kobalczyk, Katarzyna, et al.
Published: (2025)

Less, but Better: Efficient Multilingual Expansion for LLMs via Layer-wise Mixture-of-Experts
by: Zhang, Xue, et al.
Published: (2025)

Using Language Models to Disambiguate Lexical Choices in Translation
by: Barua, Josh, et al.
Published: (2024)

Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation
by: Zhang, Songming, et al.
Published: (2023)

Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey
by: Tanjim, Md Mehrab, et al.
Published: (2025)

Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysis
by: Chen, Andong, et al.
Published: (2025)

LCS: A Language Converter Strategy for Zero-Shot Neural Machine Translation
by: Sun, Zengkui, et al.
Published: (2024)

Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translation
by: Manna, Chiara, et al.
Published: (2025)

Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation
by: Sumanathilaka, T. G. D. K., et al.
Published: (2024)

How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMs
by: Zhang, Ran, et al.
Published: (2024)

A Multi-Agent LLM Framework for Multi-Domain Low-Resource In-Context NER via Knowledge Retrieval, Disambiguation and Reflective Analysis
by: Mu, Wenxuan, et al.
Published: (2025)

Multi-Aspect Knowledge Distillation for Language Model with Low-rank Factorization
by: Liu, Zihe, et al.
Published: (2026)

Evaluating Design Decisions for Dual Encoder-based Entity Disambiguation
by: Rücker, Susanna, et al.
Published: (2025)

Ambiguity Awareness Optimization: Towards Semantic Disambiguation for Direct Preference Optimization
by: Li, Jian, et al.
Published: (2025)

Agentic Verification for Ambiguous Query Disambiguation
by: Lee, Youngwon, et al.
Published: (2025)

DACE For Railway Acronym Disambiguation
by: Hribach, El Mokhtar, et al.
Published: (2025)

Provably Secure Disambiguating Neural Linguistic Steganography
by: Qi, Yuang, et al.
Published: (2024)

Sign Language Sense Disambiguation
by: Grimm, Jana, et al.
Published: (2024)

Dual-Space Knowledge Distillation for Large Language Models
by: Zhang, Songming, et al.
Published: (2024)

Analyzing the Attention Heads for Pronoun Disambiguation in Context-aware Machine Translation Models
by: Mąka, Paweł, et al.
Published: (2024)

PROST-LLM: Progressively Enhancing the Speech-to-Speech Translation Capability in LLMs
by: Xu, Jing, et al.
Published: (2026)

Generating Clarification Questions for Disambiguating Contracts
by: Singhal, Anmol, et al.
Published: (2024)

Prompt Balance Matters: Understanding How Imbalanced Few-Shot Learning Affects Multilingual Sense Disambiguation in LLMs
by: Sumanathilaka, Deshan, et al.
Published: (2025)

Nsanku: Evaluating Zero-Shot Translation Performance of LLMs for Ghanaian Languages
by: Moore, Stephen E., et al.
Published: (2026)

Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
by: Fu, Chaoyou, et al.
Published: (2024)

Wired for Overconfidence: A Mechanistic Perspective on Inflated Verbalized Confidence in LLMs
by: Zhao, Tianyi, et al.
Published: (2026)

Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL
by: Cheng, Ning, et al.
Published: (2024)

Enhancing Cross-Tokenizer Knowledge Distillation with Contextual Dynamical Mapping
by: Chen, Yijie, et al.
Published: (2025)

How Well Do Large Reasoning Models Translate? A Comprehensive Evaluation for Multi-Domain Machine Translation
by: Ye, Yongshi, et al.
Published: (2025)

Comments as Natural Logic Pivots: Improve Code Generation via Comment Perspective
by: Chen, Yijie, et al.
Published: (2024)

CM-Align: Consistency-based Multilingual Alignment for Large Language Models
by: Zhang, Xue, et al.
Published: (2025)