Imagen de Portada

Position: AI Competitions Provide the Gold Standard for Empirical Rigor in GenAI Evaluation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sculley, D., Cukierski, Will, Culliton, Phil, Dane, Sohier, Demkin, Maggie, Holbrook, Ryan, Howard, Addison, Mooney, Paul, Reade, Walter, Risdal, Megan, Keating, Nate
Formato:	Preprint
Publicado:	2025
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Human to Document, AI to Code: Comparing GenAI for Notebook Competitions
por: Settewong, Tasha, et al.
Publicado: (2025)

Putting GenAI on Notice: GenAI Exceptionalism and Contract Law
por: Atkinson, David
Publicado: (2025)

GenAI Distortion: The Effect of GenAI Fluency and Positive Affect
por: Yang, Xiantong, et al.
Publicado: (2024)

OSS GenAI Governance
por: Anonymous
Publicado: (2026)

Haptic Repurposing with GenAI
por: Wang, Haoyu
Publicado: (2024)

GenAI-Powered Inference
por: Imai, Kosuke, et al.
Publicado: (2025)

Duplicate Detection with GenAI
por: Ormesher, Ian
Publicado: (2024)

GenAI in Higher Education
por: Illingworth, Sam, et al.
Publicado: (2026)

GenAIOps for GenAI Model-Agility
por: Ueno, Ken, et al.
Publicado: (2024)

AI as "Co-founder": GenAI for Entrepreneurship
por: Cai, Junhui Jeff, et al.
Publicado: (2025)

Lessons for GenAI Literacy From a Field Study of Human-GenAI Augmentation in the Workplace
por: Johri, Aditya, et al.
Publicado: (2025)

GenAI-Enabled Backlog Grooming in Agile Software Projects: An Empirical Study
por: Oftebro, Kasper Lien, et al.
Publicado: (2025)

Collaborating with GenAI: Incentives and Replacements
por: Taitler, Boaz, et al.
Publicado: (2025)

Selective Response Strategies for GenAI
por: Taitler, Boaz, et al.
Publicado: (2025)

Role of Databases in GenAI Applications
por: Bhupathi, Santosh
Publicado: (2025)

Troubling Taxonomies in GenAI Evaluation
por: Berman, Glen, et al.
Publicado: (2024)

GenAI Assisting Medical Training
por: Fritsch, Stefan, et al.
Publicado: (2024)

Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiency
por: Wang, Xijun, et al.
Publicado: (2024)

AI-Assisted Systematization for Evaluating GenAI Systems
por: Agarwal, Dhruv, et al.
Publicado: (2026)

From Prompts to Reflection: Designing Reflective Play for GenAI Literacy
por: Ma, Qianou, et al.
Publicado: (2025)

"So what if I used GenAI?" -- Implications of Using Cloud-based GenAI in Software Engineering Research
por: Ginde, Gouri
Publicado: (2024)

SynthAI Suite - A GenAI SaaS Platform
por: Sandeep Raskar, et al.
Publicado: (2025)

Coping with generative AI's (GenAI) perpetuation of epistemic uncertainties
por: Olivia Ng, et al.
Publicado: (2025)

The Fast and Spurious: Developer Productivity with GenAI
por: Afroz, Sadia, et al.
Publicado: (2025)

GenAI Voice Mode in Programming Education
por: Jacobs, Sven, et al.
Publicado: (2025)

Securing the Future of GenAI: Policy and Technology
por: Christodorescu, Mihai, et al.
Publicado: (2024)

Why it is worth making an effort with GenAI
por: Rogers, Yvonne
Publicado: (2025)

Face Consistency Benchmark for GenAI Video
por: Podstawski, Michal, et al.
Publicado: (2025)

The Evolving Usage of GenAI by Computing Students
por: Hou, Irene, et al.
Publicado: (2024)

Approaches to Responsible Governance of GenAI in Organizations
por: Gandhi, Dhari, et al.
Publicado: (2025)

A Jailbroken GenAI Model Can Cause Substantial Harm: GenAI-powered Applications are Vulnerable to PromptWares
por: Cohen, Stav, et al.
Publicado: (2024)

"We need to avail ourselves of GenAI to enhance knowledge distribution": Empowering Older Adults through GenAI Literacy
por: Ko, Eunhye Grace, et al.
Publicado: (2025)

Navigating Uncertainties: How GenAI Developers Document Their Models on Open-Source Platforms
por: Tang, Ningjing, et al.
Publicado: (2025)

Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprints
por: Qi, Minfeng, et al.
Publicado: (2025)

Can GenAI Move from Individual Use to Collaborative Work? Experiences, Challenges, and Opportunities of Coordinating GenAI into Collaborative Newswork
por: Xiao, Qing, et al.
Publicado: (2025)

Understanding User Privacy Perceptions of GenAI Smartphones
por: Jin, Ran, et al.
Publicado: (2026)

Intentionally Unintentional: GenAI Exceptionalism and the First Amendment
por: Atkinson, David, et al.
Publicado: (2025)

Paradigm shift on Coding Productivity Using GenAI
por: Yu, Liang
Publicado: (2025)

Challenges in GenAI and Authentication: a scoping review
por: Bezerra, Wesley dos Reis, et al.
Publicado: (2025)

Unfair Learning: GenAI Exceptionalism and Copyright Law
por: Atkinson, David
Publicado: (2025)