Cover Image

PIER: A Novel Metric for Evaluating What Matters in Code-Switching

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ugan, Enes Yavuz, Pham, Ngoc-Quan, Bärmann, Leonard, Waibel, Alex
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adapting Language Balance in Code-Switching Speech
by: Ugan, Enes Yavuz, et al.
Published: (2025)

Bayesian Low-Rank Factorization for Robust Model Adaptation
by: Ugan, Enes Yavuz, et al.
Published: (2025)

Weight Factorization and Centralization for Continual Learning in Speech Recognition
by: Ugan, Enes Yavuz, et al.
Published: (2025)

Policies and Evaluation for Online Meeting Summarization
by: Schneider, Felix, et al.
Published: (2025)

Decoupled Vocabulary Learning Enables Zero-Shot Translation from Unseen Languages
by: Mullov, Carlos, et al.
Published: (2024)

BOOM: Beyond Only One Modality KIT's Multimodal Multilingual Lecture Companion
by: Koneru, Sai, et al.
Published: (2025)

End-to-End Evaluation for Low-Latency Simultaneous Speech Translation
by: Huber, Christian, et al.
Published: (2023)

Context Biasing for Pronunciation-Orthography Mismatch in Automatic Speech Recognition
by: Huber, Christian, et al.
Published: (2025)

Continuously Learning New Words in Automatic Speech Recognition
by: Huber, Christian, et al.
Published: (2024)

MUSCAT: MUltilingual, SCientific ConversATion Benchmark
by: Sinhamahapatra, Supriti, et al.
Published: (2026)

Cocktail-Party Audio-Visual Speech Recognition
by: Nguyen, Thai-Binh, et al.
Published: (2025)

Towards continually learning new languages
by: Pham, Ngoc-Quan, et al.
Published: (2022)

Titanic Calling: Low Bandwidth Video Conference from the Titanic Wreck
by: Eyiokur, Fevziye Irem, et al.
Published: (2024)

Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual Settings
by: Xu, Austin, et al.
Published: (2025)

Accent conversion using discrete units with parallel data synthesized from controllable accented TTS
by: Nguyen, Tuan Nam, et al.
Published: (2024)

Compared to What? Baselines and Metrics for Counterfactual Prompting
by: Yang, Zihao, et al.
Published: (2026)

A Unified Framework with Novel Metrics for Evaluating the Effectiveness of XAI Techniques in LLMs
by: Mersha, Melkamu Abay, et al.
Published: (2025)

A Cocktail-Party Benchmark: Multi-Modal dataset and Comparative Evaluation Results
by: Nguyen, Thai-Binh, et al.
Published: (2025)

DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching
by: Ojo, Jessica, et al.
Published: (2025)

KIT's Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization
by: Li, Zhaolin, et al.
Published: (2025)

MIC: Maximizing Informational Capacity in Adaptive Representations via Isotropic Subspace Alignment
by: Hong, Dang Nguyen, et al.
Published: (2026)

A Rate-Distortion Framework for Summarization
by: Arda, Enes, et al.
Published: (2025)

CMLFormer: A Dual Decoder Transformer with Switching Point Learning for Code-Mixed Language Modeling
by: Baral, Aditeya, et al.
Published: (2025)

CS-Sum: A Benchmark for Code-Switching Dialogue Summarization and the Limits of Large Language Models
by: Suresh, Sathya Krishnan, et al.
Published: (2025)

Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching
by: Li, Zhuoran, et al.
Published: (2024)

A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practice
by: Opitz, Juri
Published: (2024)

Code-Switching Curriculum Learning for Multilingual Transfer in LLMs
by: Yoo, Haneul, et al.
Published: (2024)

What Matters for Model Merging at Scale?
by: Yadav, Prateek, et al.
Published: (2024)

Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvement
by: Nguyen, Tuan-Nam, et al.
Published: (2025)

We Need to Talk About Classification Evaluation Metrics in NLP
by: Vickers, Peter, et al.
Published: (2024)

Towards Explainable Evaluation Metrics for Machine Translation
by: Leiter, Christoph, et al.
Published: (2023)

What Matters in LLM-generated Data: Diversity and Its Effect on Model Fine-Tuning
by: Zhu, Yuchang, et al.
Published: (2025)

CodeMixBench: Evaluating Large Language Models on Code Generation with Code-Mixed Prompts
by: Sheokand, Manik, et al.
Published: (2025)

What Matters in Transformers? Not All Attention is Needed
by: He, Shwai, et al.
Published: (2024)

Evaluating Evaluation Metrics -- The Mirage of Hallucination Detection
by: Kulkarni, Atharva, et al.
Published: (2025)

Toward More Accurate and Generalizable Evaluation Metrics for Task-Oriented Dialogs
by: Komma, Abishek, et al.
Published: (2023)

Weighting What Matters: Boosting Sample Efficiency in Medical Report Generation via Token Reweighting
by: Weers, Alexander, et al.
Published: (2026)

Reinforcement Learning for Latent-Space Thinking in LLMs
by: Özeren, Enes, et al.
Published: (2025)

Objective Metrics for Evaluating Large Language Models Using External Data Sources
by: Du, Haoze, et al.
Published: (2025)

Generative Frontiers: Why Evaluation Matters for Diffusion Language Models
by: Pynadath, Patrick, et al.
Published: (2026)