Cover Image

SemEval-2025 Task 3: Mu-SHROOM, the Multilingual Shared Task on Hallucinations and Related Observable Overgeneration Mistakes

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Vázquez, Raúl, Mickus, Timothee, Zosa, Elaine, Vahtola, Teemu, Tiedemann, Jörg, Sinha, Aman, Segonne, Vincent, Sánchez-Vega, Fernando, Raganato, Alessandro, Libovický, Jindřich, Karlgren, Jussi, Ji, Shaoxiong, Helcl, Jindřich, Guillou, Liane, de Gibert, Ona, Bengoetxea, Jaione, Attieh, Joseph, Apidianaki, Marianna
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes
by: Mickus, Timothee, et al.
Published: (2024)

Lexically Grounded Subword Segmentation
by: Libovický, Jindřich, et al.
Published: (2024)

Atyaephyra at SemEval-2025 Task 4: Low-Rank Negative Preference Optimization
by: Bronec, Jan, et al.
Published: (2025)

Different Time, Different Language: Revisiting the Bias Against Non-Native Speakers in GPT Detectors
by: Ali, Adnan Al, et al.
Published: (2026)

CUS-QA: Local-Knowledge-Oriented Open-Ended Question Answering Dataset
by: Libovický, Jindřich, et al.
Published: (2025)

On the Credibility of Evaluating LLMs using Survey Questions
by: Libovický, Jindřich
Published: (2026)

KD4MT: A Survey of Knowledge Distillation for Machine Translation
by: de Gibert, Ona, et al.
Published: (2026)

Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning?
by: Ji, Shaoxiong, et al.
Published: (2024)

Teaching LLMs at Charles University: Assignments and Activities
by: Helcl, Jindřich, et al.
Published: (2024)

Evaluating Morphological Plausibility of Subword Tokenization via Statistical Alignment with Morpho-Syntactic Features
by: Stephen, Abishek, et al.
Published: (2026)

Crowdsourcing Piedmontese to Test LLMs on Non-Standard Orthography
by: Vico, Gianluca, et al.
Published: (2026)

MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki
by: Mickus, Timothee, et al.
Published: (2024)

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives
by: Li, Zihao, et al.
Published: (2024)

Multilingual Vision-Language Models, A Survey
by: Manea, Andrei-Alexandru, et al.
Published: (2025)

How Gender Interacts with Political Values: A Case Study on Czech BERT Models
by: Ali, Adnan Al, et al.
Published: (2024)

Investigating the Effect of Parallel Data in the Cross-Lingual Transfer for Vision-Language Encoders
by: Manea, Andrei-Alexandru, et al.
Published: (2025)

I Have an Attention Bridge to Sell You: Generalization Capabilities of Modular Translation Architectures
by: Mickus, Timothee, et al.
Published: (2024)

Scaling Low-Resource MT via Synthetic Data Generation with LLMs
by: de Gibert, Ona, et al.
Published: (2025)

Understanding Cross-Lingual Alignment -- A Survey
by: Hämmerl, Katharina, et al.
Published: (2024)

LLM as a Meta-Judge: Synthetic Data for NLP Evaluation Metric Validation
by: Eigler, Lukáš, et al.
Published: (2026)

Charles Translator: A Machine Translation System between Ukrainian and Czech
by: Popel, Martin, et al.
Published: (2024)

Isotropy, Clusters, and Classifiers
by: Mickus, Timothee, et al.
Published: (2024)

Beyond Literal Token Overlap: Token Alignability for Multilinguality
by: Hämmerl, Katharina, et al.
Published: (2025)

Enhancing Conceptual Understanding in Multimodal Contrastive Learning through Hard Negative Samples
by: Rösch, Philipp J., et al.
Published: (2024)

SLPL SHROOM at SemEval2024 Task 06: A comprehensive study on models ability to detect hallucination
by: Fallah, Pouya, et al.
Published: (2024)

Figs 33–39 in The genus Pteremis (Diptera: Sphaeroceridae) in the West Palaearctic area, with description of four new species
by: Roháček, Jindřich
Published: (2024)

Figs 158–161 in The genus Pteremis (Diptera: Sphaeroceridae) in the West Palaearctic area, with description of four new species
by: Roháček, Jindřich
Published: (2024)

Figs 133–135 in Three new genera and nine new species - just a fragment of the Afrotropical fauna of Anthomyzidae (Diptera)
by: Roháček, Jindřich
Published: (2025)

Figs 18–22 in Three new genera and nine new species - just a fragment of the Afrotropical fauna of Anthomyzidae (Diptera)
by: Roháček, Jindřich
Published: (2025)

Figs 36–40 in Three new genera and nine new species - just a fragment of the Afrotropical fauna of Anthomyzidae (Diptera)
by: Roháček, Jindřich
Published: (2025)

Figs 109–111 in The genus Pteremis (Diptera: Sphaeroceridae) in the West Palaearctic area, with description of four new species
by: Roháček, Jindřich
Published: (2024)

Dynamical ideals and the axiom of choice
by: Zapletal, Jindrich
Published: (2024)

Independence relations in the Solovay model I
by: Zapletal, Jindrich
Published: (2025)

Coloring equilateral triangles
by: Zapletal, Jindrich
Published: (2025)

Life Cycle-Aware Evaluation of Knowledge Distillation for Machine Translation: Environmental Impact and Translation Quality Trade-offs
by: Attieh, Joseph, et al.
Published: (2026)

SHROOM-INDElab at SemEval-2024 Task 6: Zero- and Few-Shot LLM-Based Classification for Hallucination Detection
by: Allen, Bradley P., et al.
Published: (2024)

A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations
by: Bengoetxea, Jaione, et al.
Published: (2026)

Lost in Variation? Evaluating NLI Performance in Basque and Spanish Geographical Variants
by: Bengoetxea, Jaione, et al.
Published: (2025)

Physical Commonsense Reasoning for Lower-Resourced Languages and Dialects: a Study on Basque
by: Bengoetxea, Jaione, et al.
Published: (2026)

OpenLID-v3: Improving the Precision of Closely Related Language Identification -- An Experience Report
by: Fedorova, Mariia, et al.
Published: (2026)