Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metrics
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Kumar, Sanjeev, Jyothi, Preethi, Bhattacharyya, Pushpak |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleaving
par: Shankar, Bhavani, et autres
Publié: (2024)
par: Shankar, Bhavani, et autres
Publié: (2024)
Translation Errors Significantly Impact Low-Resource Languages in Cross-Lingual Learning
par: Agrawal, Ashish Sunil, et autres
Publié: (2024)
par: Agrawal, Ashish Sunil, et autres
Publié: (2024)
How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?
par: Gaikwad, Pranav, et autres
Publié: (2024)
par: Gaikwad, Pranav, et autres
Publié: (2024)
Beyond BLEU: A Semantic Evaluation Method for Code Translation
par: Näumann, Julius, et autres
Publié: (2026)
par: Näumann, Julius, et autres
Publié: (2026)
RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languages
par: Kashid, Harshvivek, et autres
Publié: (2024)
par: Kashid, Harshvivek, et autres
Publié: (2024)
Assessing and Improving Punctuation Robustness in English-Marathi Machine Translation
par: Shejole, Kaustubh Shivshankar, et autres
Publié: (2025)
par: Shejole, Kaustubh Shivshankar, et autres
Publié: (2025)
Together We Can: Multilingual Automatic Post-Editing for Low-Resource Languages
par: Deoghare, Sourabh, et autres
Publié: (2024)
par: Deoghare, Sourabh, et autres
Publié: (2024)
A Case Study on Context-Aware Neural Machine Translation with Multi-Task Learning
par: Appicharla, Ramakrishna, et autres
Publié: (2024)
par: Appicharla, Ramakrishna, et autres
Publié: (2024)
XITE: Cross-lingual Interpolation for Transfer using Embeddings
par: Fazili, Barah, et autres
Publié: (2026)
par: Fazili, Barah, et autres
Publié: (2026)
Translation or Recitation? Calibrating Evaluation Scores for Machine Translation of Extremely Low-Resource Languages
par: Chen, Danlu, et autres
Publié: (2026)
par: Chen, Danlu, et autres
Publié: (2026)
LASER: An LLM-based ASR Scoring and Evaluation Rubric
par: Parulekar, Amruta, et autres
Publié: (2025)
par: Parulekar, Amruta, et autres
Publié: (2025)
Reconsidering SMT Over NMT for Closely Related Languages: A Case Study of Persian-Hindi Pair
par: Yousofi, Waisullah, et autres
Publié: (2024)
par: Yousofi, Waisullah, et autres
Publié: (2024)
SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation
par: Kim, Jung-Ho, et autres
Publié: (2024)
par: Kim, Jung-Ho, et autres
Publié: (2024)
TensorBLEU: Vectorized GPU-based BLEU Score Implementation for Per-Sentence In-Training Evaluation
par: Filipek, Adam
Publié: (2025)
par: Filipek, Adam
Publié: (2025)
GRAFT: A Graph-based Flow-aware Agentic Framework for Document-level Machine Translation
par: Dutta, Himanshu, et autres
Publié: (2025)
par: Dutta, Himanshu, et autres
Publié: (2025)
Are Language Models Agnostic to Linguistically Grounded Perturbations? A Case Study of Indic Languages
par: Ghosh, Poulami, et autres
Publié: (2024)
par: Ghosh, Poulami, et autres
Publié: (2024)
Facts-and-Feelings: Capturing both Objectivity and Subjectivity in Table-to-Text Generation
par: Dey, Tathagata, et autres
Publié: (2024)
par: Dey, Tathagata, et autres
Publié: (2024)
We Care: Multimodal Depression Detection and Knowledge Infused Mental Health Therapeutic Response Generation
par: Moon, Palash, et autres
Publié: (2024)
par: Moon, Palash, et autres
Publié: (2024)
P-ReMIS: Pragmatic Reasoning in Mental Health and a Social Implication
par: Oram, Sneha, et autres
Publié: (2025)
par: Oram, Sneha, et autres
Publié: (2025)
Main Predicate and Their Arguments as Explanation Signals For Intent Classification
par: Pimparkhede, Sameer, et autres
Publié: (2025)
par: Pimparkhede, Sameer, et autres
Publié: (2025)
DICTDIS: Dictionary Constrained Disambiguation for Improved NMT
par: Maheshwari, Ayush, et autres
Publié: (2022)
par: Maheshwari, Ayush, et autres
Publié: (2022)
Hi Model, generating 'nice' instead of 'good' is not as bad as generating 'rice'! Towards Context and Semantic Infused Dialogue Generation Loss Function and Evaluation Metric
par: Tiwari, Abhisek, et autres
Publié: (2023)
par: Tiwari, Abhisek, et autres
Publié: (2023)
Enhancing Food-Domain Question Answering with a Multimodal Knowledge Graph: Hybrid QA Generation and Diversity Analysis
par: B, Srihari K, et autres
Publié: (2025)
par: B, Srihari K, et autres
Publié: (2025)
DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer
par: Simon, Sona Elza, et autres
Publié: (2025)
par: Simon, Sona Elza, et autres
Publié: (2025)
Parameter-efficient Adaptation of Multilingual Multimodal Models for Low-resource ASR
par: Gupta, Abhishek, et autres
Publié: (2024)
par: Gupta, Abhishek, et autres
Publié: (2024)
Gujarati-English Code-Switching Speech Recognition using ensemble prediction of spoken language
par: Sharma, Yash, et autres
Publié: (2024)
par: Sharma, Yash, et autres
Publié: (2024)
Boosting Zero-Shot Crosslingual Performance using LLM-Based Augmentations with Effective Data Selection
par: Fazili, Barah, et autres
Publié: (2024)
par: Fazili, Barah, et autres
Publié: (2024)
Stereotype Detection as a Catalyst for Enhanced Bias Detection: A Multi-Task Learning Approach
par: Tomar, Aditya, et autres
Publié: (2025)
par: Tomar, Aditya, et autres
Publié: (2025)
Dialectal and Low-Resource Machine Translation for Aromanian
par: Jerpelea, Alexandru-Iulius, et autres
Publié: (2024)
par: Jerpelea, Alexandru-Iulius, et autres
Publié: (2024)
StereoDetect: Detecting Stereotypes and Anti-stereotypes the Correct Way Using Social Psychological Underpinnings
par: Shejole, Kaustubh Shivshankar, et autres
Publié: (2025)
par: Shejole, Kaustubh Shivshankar, et autres
Publié: (2025)
Evaluating Automatic Metrics with Incremental Machine Translation Systems
par: Wu, Guojun, et autres
Publié: (2024)
par: Wu, Guojun, et autres
Publié: (2024)
Language-specific Neurons Do Not Facilitate Cross-Lingual Transfer
par: Mondal, Soumen Kumar, et autres
Publié: (2025)
par: Mondal, Soumen Kumar, et autres
Publié: (2025)
Towards Explainable Evaluation Metrics for Machine Translation
par: Leiter, Christoph, et autres
Publié: (2023)
par: Leiter, Christoph, et autres
Publié: (2023)
Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu
par: Pei, Renhao, et autres
Publié: (2025)
par: Pei, Renhao, et autres
Publié: (2025)
Towards Emotion Consistency Analysis of Large Language Models in Emotional Conversational Contexts
par: Oram, Sneha, et autres
Publié: (2026)
par: Oram, Sneha, et autres
Publié: (2026)
Pretraining Language Models Using Translationese
par: Doshi, Meet, et autres
Publié: (2024)
par: Doshi, Meet, et autres
Publié: (2024)
Ta-G-T: Subjectivity Capture in Table to Text Generation via RDF Graphs
par: Upasham, Ronak, et autres
Publié: (2025)
par: Upasham, Ronak, et autres
Publié: (2025)
Giving the Old a Fresh Spin: Quality Estimation-Assisted Constrained Decoding for Automatic Post-Editing
par: Deoghare, Sourabh, et autres
Publié: (2025)
par: Deoghare, Sourabh, et autres
Publié: (2025)
LEVOS: Leveraging Vocabulary Overlap with Sanskrit to Generate Technical Lexicons in Indian Languages
par: J, Karthika N, et autres
Publié: (2024)
par: J, Karthika N, et autres
Publié: (2024)
BharatBBQ: A Multilingual Bias Benchmark for Question Answering in the Indian Context
par: Tomar, Aditya, et autres
Publié: (2025)
par: Tomar, Aditya, et autres
Publié: (2025)
Documents similaires
-
CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleaving
par: Shankar, Bhavani, et autres
Publié: (2024) -
Translation Errors Significantly Impact Low-Resource Languages in Cross-Lingual Learning
par: Agrawal, Ashish Sunil, et autres
Publié: (2024) -
How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?
par: Gaikwad, Pranav, et autres
Publié: (2024) -
Beyond BLEU: A Semantic Evaluation Method for Code Translation
par: Näumann, Julius, et autres
Publié: (2026) -
RoundTripOCR: A Data Generation Technique for Enhancing Post-OCR Error Correction in Low-Resource Devanagari Languages
par: Kashid, Harshvivek, et autres
Publié: (2024)