Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding
Fuente:
arXiv
Guardado en:
| Autores principales: | Schmidt, Fabian David, Vulić, Ivan, Glavaš, Goran, Adelani, David Ifeoluwa |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Natural language processing for African languages
por: Adelani, David Ifeoluwa
Publicado: (2025)
por: Adelani, David Ifeoluwa
Publicado: (2025)
MVL-SIB: A Massively Multilingual Vision-Language Benchmark for Cross-Modal Topical Matching
por: Schmidt, Fabian David, et al.
Publicado: (2025)
por: Schmidt, Fabian David, et al.
Publicado: (2025)
ReCoVeR the Target Language: Language Steering without Sacrificing Task Performance
por: Sterz, Hannah, et al.
Publicado: (2025)
por: Sterz, Hannah, et al.
Publicado: (2025)
ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Model
por: Quinjica, Osvaldo Luamba, et al.
Publicado: (2024)
por: Quinjica, Osvaldo Luamba, et al.
Publicado: (2024)
Large Language Models are Miscalibrated In-Context Learners
por: Li, Chengzu, et al.
Publicado: (2023)
por: Li, Chengzu, et al.
Publicado: (2023)
Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages
por: Schmidt, Fabian David, et al.
Publicado: (2024)
por: Schmidt, Fabian David, et al.
Publicado: (2024)
IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generators
por: Paul, Indraneil, et al.
Publicado: (2024)
por: Paul, Indraneil, et al.
Publicado: (2024)
News Without Borders: Domain Adaptation of Multilingual Sentence Embeddings for Cross-lingual News Recommendation
por: Iana, Andreea, et al.
Publicado: (2024)
por: Iana, Andreea, et al.
Publicado: (2024)
DIVERS-Bench: Evaluating Language Identification Across Domain Shifts and Code-Switching
por: Ojo, Jessica, et al.
Publicado: (2025)
por: Ojo, Jessica, et al.
Publicado: (2025)
How Much Do LLMs Hallucinate across Languages? On Realistic Multilingual Estimation of LLM Hallucination
por: Islam, Saad Obaid ul, et al.
Publicado: (2025)
por: Islam, Saad Obaid ul, et al.
Publicado: (2025)
TukaBench: A Culturally Grounded Jailbreak Benchmark for African Languages
por: Akinode, Victor, et al.
Publicado: (2026)
por: Akinode, Victor, et al.
Publicado: (2026)
Lugha-Llama: Adapting Large Language Models for African Languages
por: Buzaaba, Happy, et al.
Publicado: (2025)
por: Buzaaba, Happy, et al.
Publicado: (2025)
UniSLU: Unified Spoken Language Understanding from Heterogeneous Cross-Task Datasets
por: Sheng, Zhichao, et al.
Publicado: (2025)
por: Sheng, Zhichao, et al.
Publicado: (2025)
Translation as a Scalable Proxy for Multilingual Evaluation
por: Issaka, Sheriff, et al.
Publicado: (2026)
por: Issaka, Sheriff, et al.
Publicado: (2026)
MINERS: Multilingual Language Models as Semantic Retrievers
por: Winata, Genta Indra, et al.
Publicado: (2024)
por: Winata, Genta Indra, et al.
Publicado: (2024)
MGSM-Pro: A Simple Strategy for Robust Multilingual Mathematical Reasoning Evaluation
por: Xu, Tianyi, et al.
Publicado: (2026)
por: Xu, Tianyi, et al.
Publicado: (2026)
Babel-ImageNet: Massively Multilingual Evaluation of Vision-and-Language Representations
por: Geigle, Gregor, et al.
Publicado: (2023)
por: Geigle, Gregor, et al.
Publicado: (2023)
AfroBench: How Good are Large Language Models on African Languages?
por: Ojo, Jessica, et al.
Publicado: (2023)
por: Ojo, Jessica, et al.
Publicado: (2023)
New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark
por: Alavoine, Nadège, et al.
Publicado: (2024)
por: Alavoine, Nadège, et al.
Publicado: (2024)
Ibom NLP: A Step Toward Inclusive Natural Language Processing for Nigeria's Minority Languages
por: Kalejaiye, Oluwadara, et al.
Publicado: (2025)
por: Kalejaiye, Oluwadara, et al.
Publicado: (2025)
Warmup Generations: A Task-Agnostic Approach for Guiding Sequence-to-Sequence Learning with Unsupervised Initial State Generation
por: Li, Senyu, et al.
Publicado: (2025)
por: Li, Senyu, et al.
Publicado: (2025)
The Curious Case of Factual (Mis)Alignment between LLMs' Short- and Long-Form Answers
por: Islam, Saad Obaid ul, et al.
Publicado: (2025)
por: Islam, Saad Obaid ul, et al.
Publicado: (2025)
MAC-SLU: Multi-Intent Automotive Cabin Spoken Language Understanding Benchmark
por: Peng, Yuezhang, et al.
Publicado: (2025)
por: Peng, Yuezhang, et al.
Publicado: (2025)
SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU
por: Razumovskaia, Evgeniia, et al.
Publicado: (2023)
por: Razumovskaia, Evgeniia, et al.
Publicado: (2023)
AfriMTEB and AfriE5: Benchmarking and Adapting Text Embedding Models for African Languages
por: Uemura, Kosei, et al.
Publicado: (2025)
por: Uemura, Kosei, et al.
Publicado: (2025)
AFD-SLU: Adaptive Feature Distillation for Spoken Language Understanding
por: Xie, Yan, et al.
Publicado: (2025)
por: Xie, Yan, et al.
Publicado: (2025)
Compositional Steering of Large Language Models with Steering Tokens
por: Radevski, Gorjan, et al.
Publicado: (2026)
por: Radevski, Gorjan, et al.
Publicado: (2026)
The Token Tax: Systematic Bias in Multilingual Tokenization
por: Lundin, Jessica M., et al.
Publicado: (2025)
por: Lundin, Jessica M., et al.
Publicado: (2025)
Specialising and Analysing Instruction-Tuned and Byte-Level Language Models for Organic Reaction Prediction
por: Pang, Jiayun, et al.
Publicado: (2024)
por: Pang, Jiayun, et al.
Publicado: (2024)
Machine Translation Hallucination Detection for Low and High Resource Languages using Large Language Models
por: Benkirane, Kenza, et al.
Publicado: (2024)
por: Benkirane, Kenza, et al.
Publicado: (2024)
mSTEB: Massively Multilingual Evaluation of LLMs on Speech and Text Tasks
por: Beyene, Luel Hagos, et al.
Publicado: (2025)
por: Beyene, Luel Hagos, et al.
Publicado: (2025)
M3-SLU: Evaluating Speaker-Attributed Reasoning in Multimodal Large Language Models
por: Kwon, Yejin, et al.
Publicado: (2025)
por: Kwon, Yejin, et al.
Publicado: (2025)
Multilinguality as Sense Adaptation
por: Cruz, Jan Christian Blaise, et al.
Publicado: (2026)
por: Cruz, Jan Christian Blaise, et al.
Publicado: (2026)
MMTEB: Massive Multilingual Text Embedding Benchmark
por: Enevoldsen, Kenneth, et al.
Publicado: (2025)
por: Enevoldsen, Kenneth, et al.
Publicado: (2025)
Multi-Intent Spoken Language Understanding: Methods, Trends, and Challenges
por: Wu, Di, et al.
Publicado: (2025)
por: Wu, Di, et al.
Publicado: (2025)
WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines
por: Winata, Genta Indra, et al.
Publicado: (2024)
por: Winata, Genta Indra, et al.
Publicado: (2024)
ECLM: Entity Level Language Model for Spoken Language Understanding with Chain of Intent
por: Yin, Shangjian, et al.
Publicado: (2024)
por: Yin, Shangjian, et al.
Publicado: (2024)
Improving Multilingual Math Reasoning for African Languages
por: Ogundepo, Odunayo, et al.
Publicado: (2025)
por: Ogundepo, Odunayo, et al.
Publicado: (2025)
SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?
por: Li, Senyu, et al.
Publicado: (2025)
por: Li, Senyu, et al.
Publicado: (2025)
Translation-Enhanced Multilingual Text-to-Image Generation
por: Li, Yaoyiran, et al.
Publicado: (2023)
por: Li, Yaoyiran, et al.
Publicado: (2023)
Ejemplares similares
-
Natural language processing for African languages
por: Adelani, David Ifeoluwa
Publicado: (2025) -
MVL-SIB: A Massively Multilingual Vision-Language Benchmark for Cross-Modal Topical Matching
por: Schmidt, Fabian David, et al.
Publicado: (2025) -
ReCoVeR the Target Language: Language Steering without Sacrificing Task Performance
por: Sterz, Hannah, et al.
Publicado: (2025) -
ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Model
por: Quinjica, Osvaldo Luamba, et al.
Publicado: (2024) -
Large Language Models are Miscalibrated In-Context Learners
por: Li, Chengzu, et al.
Publicado: (2023)