Imagen de Portada

RefactorCoderQA: Benchmarking LLMs for Multi-Domain Coding Question Solutions in Cloud and Edge Deployment

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Rahman, Shadikur, Hameed, Aroosa, Srivastava, Gautam, Danish, Syed Muhammad
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DashboardQA: Benchmarking Multimodal Agents for Question Answering on Interactive Dashboards
por: Kartha, Aaryaman, et al.
Publicado: (2025)

Sustainable Code Generation Using Large Language Models: A Systematic Literature Review
por: Ali, Sabiya Banu Masthan, et al.
Publicado: (2026)

Toward Green Code: Prompting Small Language Models for Energy-Efficient Code Generation
por: Ashraf, Humza, et al.
Publicado: (2025)

Compound-QA: A Benchmark for Evaluating LLMs on Compound Questions
por: Hou, Yutao, et al.
Publicado: (2024)

BEnQA: A Question Answering and Reasoning Benchmark for Bengali and English
por: Shafayat, Sheikh, et al.
Publicado: (2024)

ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering
por: Masry, Ahmed, et al.
Publicado: (2025)

Comparative Efficiency Analysis of Lightweight Transformer Models: A Multi-Domain Empirical Benchmark for Enterprise NLP Deployment
por: Khan, Muhammad Shahmeer
Publicado: (2026)

AutoVecCoder: Teaching LLMs to Generate Explicitly Vectorized Code
por: Li, Shangzhan, et al.
Publicado: (2026)

TigerCoder: A Novel Suite of LLMs for Code Generation in Bangla
por: Raihan, Nishat, et al.
Publicado: (2025)

FairCoder: Evaluating Social Bias of LLMs in Code Generation
por: Du, Yongkang, et al.
Publicado: (2025)

RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content
por: Monteiro, Joao, et al.
Publicado: (2024)

MedEthicsQA: A Comprehensive Question Answering Benchmark for Medical Ethics Evaluation of LLMs
por: Wei, Jianhui, et al.
Publicado: (2025)

PRIV-QA: Privacy-Preserving Question Answering for Cloud Large Language Models
por: Li, Guangwei, et al.
Publicado: (2025)

RespondeoQA: a Benchmark for Bilingual Latin-English Question Answering
por: Hudspeth, Marisa, et al.
Publicado: (2026)

Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code
por: Zhang, Jipeng, et al.
Publicado: (2024)

AfriMed-QA: A Pan-African, Multi-Specialty, Medical Question-Answering Benchmark Dataset
por: Olatunji, Tobi, et al.
Publicado: (2024)

SWE-QA: Can Language Models Answer Repository-level Code Questions?
por: Peng, Weihan, et al.
Publicado: (2025)

ThReadMed-QA: A Multi-Turn Medical Dialogue Benchmark from Real Patient Questions
por: Munnangi, Monica, et al.
Publicado: (2026)

ReCoQA: A Benchmark for Tool-Augmented and Multi-Step Reasoning in Real Estate Question and Answering
por: Zhang, Yindong, et al.
Publicado: (2026)

NovelQA: Benchmarking Question Answering on Documents Exceeding 200K Tokens
por: Wang, Cunxiang, et al.
Publicado: (2024)

CondAmbigQA: A Benchmark and Dataset for Conditional Ambiguous Question Answering
por: Li, Zongxi, et al.
Publicado: (2025)

DisastQA: A Comprehensive Benchmark for Evaluating Question Answering in Disaster Management
por: Chen, Zhitong, et al.
Publicado: (2026)

AmharicStoryQA: A Multicultural Story Question Answering Benchmark in Amharic
por: Azime, Israel Abebe, et al.
Publicado: (2026)

Factuality or Fiction? Benchmarking Modern LLMs on Ambiguous QA with Citations
por: Patel, Maya, et al.
Publicado: (2024)

M2QA: Multi-domain Multilingual Question Answering
por: Engländer, Leon, et al.
Publicado: (2024)

AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation
por: Huang, Dong, et al.
Publicado: (2023)

VisCoder2: Building Multi-Language Visualization Coding Agents
por: Ni, Yuansheng, et al.
Publicado: (2025)

FanOutQA: A Multi-Hop, Multi-Document Question Answering Benchmark for Large Language Models
por: Zhu, Andrew, et al.
Publicado: (2024)

RefactorBench: Evaluating Stateful Reasoning in Language Agents Through Code
por: Gautam, Dhruv, et al.
Publicado: (2025)

NCTB-QA: A Large-Scale Bangla Educational Question Answering Dataset and Benchmarking Performance
por: Eyasir, Abrar, et al.
Publicado: (2026)

AdversaRiskQA: An Adversarial Factuality Benchmark for High-Risk Domains
por: Szelestey, Adam, et al.
Publicado: (2026)

ASTRA-QA: A Benchmark for Abstract Question Answering over Documents
por: Wang, Shu, et al.
Publicado: (2026)

SensorQA: A Question Answering Benchmark for Daily-Life Monitoring
por: Reichman, Benjamin, et al.
Publicado: (2025)

MedExQA: Medical Question Answering Benchmark with Multiple Explanations
por: Kim, Yunsoo, et al.
Publicado: (2024)

UnSeenTimeQA: Time-Sensitive Question-Answering Beyond LLMs' Memorization
por: Uddin, Md Nayem, et al.
Publicado: (2024)

MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answering
por: Alonso, Iñigo, et al.
Publicado: (2024)

Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
por: Wang, Minzheng, et al.
Publicado: (2024)

MapCoder: Multi-Agent Code Generation for Competitive Problem Solving
por: Islam, Md. Ashraful, et al.
Publicado: (2024)

DisasterQA: A Benchmark for Assessing the performance of LLMs in Disaster Response
por: Rawat, Rajat
Publicado: (2024)

AlchemistCoder: Harmonizing and Eliciting Code Capability by Hindsight Tuning on Multi-source Data
por: Song, Zifan, et al.
Publicado: (2024)