Copertina

MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Xuan, Weihao, Yang, Rui, Qi, Heli, Zeng, Qingcheng, Xiao, Yunze, Feng, Aosong, Liu, Dairui, Xing, Yun, Wang, Junjue, Gao, Fan, Lu, Jinghui, Jiang, Yuang, Li, Huitao, Li, Xin, Yu, Kunyu, Dong, Ruihai, Gu, Shangding, Li, Yuekang, Xie, Xiaofei, Juefei-Xu, Felix, Khomh, Foutse, Yoshie, Osamu, Chen, Qingyu, Teodoro, Douglas, Liu, Nan, Goebel, Randy, Ma, Lei, Marrese-Taylor, Edison, Lu, Shijian, Iwasawa, Yusuke, Matsuo, Yutaka, Li, Irene
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

The Confidence Dichotomy: Analyzing and Mitigating Miscalibration in Tool-Use Agents
di: Xuan, Weihao, et al.
Pubblicazione: (2026)

Large Language Models on Wikipedia-Style Survey Generation: an Evaluation in NLP Concepts
di: Gao, Fan, et al.
Pubblicazione: (2023)

Seeing is Believing, but How Much? A Comprehensive Analysis of Verbalized Calibration in Vision-Language Models
di: Xuan, Weihao, et al.
Pubblicazione: (2025)

Topic-Centric Explanations for News Recommendation
di: Liu, Dairui, et al.
Pubblicazione: (2023)

On the Effectiveness of Log Representation for Log-based Anomaly Detection
di: Wu, Xingfang, et al.
Pubblicazione: (2023)

Protecting Privacy in Software Logs: What Should Be Anonymized?
di: Aghili, Roozbeh, et al.
Pubblicazione: (2024)

What Information Contributes to Log-based Anomaly Detection? Insights from a Configurable Transformer-Based Approach
di: Wu, Xingfang, et al.
Pubblicazione: (2024)

Representation Improvement in Latent Space for Search-Based Testing of Autonomous Robotic Systems
di: Humeniuk, Dmytro, et al.
Pubblicazione: (2025)

An Efficient Model Maintenance Approach for MLOps
di: Majidi, Forough, et al.
Pubblicazione: (2024)

Understanding Web Application Workloads and Their Applications: Systematic Literature Review and Characterization
di: Aghili, Roozbeh, et al.
Pubblicazione: (2024)

Adversarial Attack Classification and Robustness Testing for Large Language Models for Code
di: Liu, Yang, et al.
Pubblicazione: (2025)

Tracing Optimization for Performance Modeling and Regression Detection
di: Shahedi, Kaveh, et al.
Pubblicazione: (2024)

SDLog: A Deep Learning Framework for Detecting Sensitive Information in Software Logs
di: Aghili, Roozbeh, et al.
Pubblicazione: (2025)

Machine Learning Robustness: A Primer
di: Braiek, Houssem Ben, et al.
Pubblicazione: (2024)

Leveraging Large Language Models for Concept Graph Recovery and Question Answering in NLP Education
di: Yang, Rui, et al.
Pubblicazione: (2024)

Graphusion: Leveraging Large Language Models for Scientific Knowledge Graph Fusion and Construction in NLP Education
di: Yang, Rui, et al.
Pubblicazione: (2024)

From Chains to Graphs: Self-Structured Reasoning for General-Domain LLMs
di: Chen, Yingjian, et al.
Pubblicazione: (2026)

Evaluating Implicit Regulatory Compliance in LLM Tool Invocation via Logic-Guided Synthesis
di: Song, Da, et al.
Pubblicazione: (2026)

Trained Without My Consent: Detecting Code Inclusion In Language Models Trained on Code
di: Majdinasab, Vahid, et al.
Pubblicazione: (2024)

GIST: Generated Inputs Sets Transferability in Deep Learning
di: Tambon, Florian, et al.
Pubblicazione: (2023)

DeepCodeProbe: Towards Understanding What Models Trained on Code Learn
di: Majdinasab, Vahid, et al.
Pubblicazione: (2024)

Reinforcement Learning Informed Evolutionary Search for Autonomous Systems Testing
di: Humeniuk, Dmytro, et al.
Pubblicazione: (2023)

Evaluating and Enhancing Segmentation Model Robustness with Metamorphic Testing
di: Mzoughi, Seif, et al.
Pubblicazione: (2025)

Prism: Dynamic and Flexible Benchmarking of LLMs Code Generation with Monte Carlo Tree Search
di: Majdinasab, Vahid, et al.
Pubblicazione: (2025)

PathOCL: Path-Based Prompt Augmentation for OCL Generation with GPT-4
di: Abukhalaf, Seif, et al.
Pubblicazione: (2024)

RefAgent: A Multi-agent LLM-based Framework for Automatic Software Refactoring
di: Oueslati, Khouloud, et al.
Pubblicazione: (2025)

Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspective
di: Yang, Rui, et al.
Pubblicazione: (2024)

An Empirical Study on Method-Level Performance Evolution in Open-Source Java Projects
di: Shahedi, Kaveh, et al.
Pubblicazione: (2025)

From Technical Excellence to Practical Adoption: Lessons Learned Building an ML-Enhanced Trace Analysis Tool
di: Shahedi, Kaveh, et al.
Pubblicazione: (2025)

Improving the Robustness of Large Language Models for Code Tasks via Fine-tuning with Perturbed Data
di: Liu, Yang, et al.
Pubblicazione: (2026)

Structural Anchors and Reasoning Fragility:Understanding CoT Robustness in LLM4Code
di: Liu, Yang, et al.
Pubblicazione: (2026)

QMon: Monitoring the Execution of Quantum Circuits with Mid-Circuit Measurement and Reset
di: Ma, Ning, et al.
Pubblicazione: (2025)

Refining GPT-3 Embeddings with a Siamese Structure for Technical Post Duplicate Detection
di: Wu, Xingfang, et al.
Pubblicazione: (2023)

RecPrompt: A Self-tuning Prompting Framework for News Recommendation Using Large Language Models
di: Liu, Dairui, et al.
Pubblicazione: (2023)

Transformers4NewsRec: A Transformer-based News Recommendation Framework
di: Liu, Dairui, et al.
Pubblicazione: (2024)

Direction-aware 3D Large Multimodal Models
di: Liu, Quan, et al.
Pubblicazione: (2026)

An Empirical Study on Logging Evolution On Stack Overflow: Trends, Topics, and Challenges
di: Foalem, Patrick Loic, et al.
Pubblicazione: (2026)

LLMs and Stack Overflow Discussions: Reliability, Impact, and Challenges
di: Da Silva, Leuson, et al.
Pubblicazione: (2024)

One Size Does Not Fit All: Architecture-Aware Adaptive Batch Scheduling with DEBA
di: Belias, François, et al.
Pubblicazione: (2025)

Fault Localization in Deep Learning-based Software: A System-level Approach
di: Morovati, Mohammad Mehdi, et al.
Pubblicazione: (2024)