Copertina

A Benchmarking Framework for Model Datasets

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Glaser, Philipp-Lorenz, Burgueño, Lola, Bork, Dominik
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Software Engineering
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LLM-based Generation of Semantically Diverse and Realistic Domain Model Instances
di: Coman, Andrei, et al.
Pubblicazione: (2026)

A framework for assessing the capabilities of code generation of constraint domain-specific languages with large language models
di: Delgado, David, et al.
Pubblicazione: (2026)

Detecting Semantic Alignments between Textual Specifications and Domain Models
di: Shimangaud, Shwetali, et al.
Pubblicazione: (2026)

Exploring Actions, Interactions and Challenges in Software Modelling Tasks: An Empirical Investigation with Students
di: Chakraborty, Shalini, et al.
Pubblicazione: (2024)

Automation in Model-Driven Engineering: A look back, and ahead
di: Burgueño, Lola, et al.
Pubblicazione: (2024)

Lost in Code Generation: Reimagining the Role of Software Models in AI-driven Software Engineering
di: Cito, Jürgen, et al.
Pubblicazione: (2025)

Vanilla-Converter: A Tool for Converting Camunda 7 BPMN Models into Camunda 8 Models
di: Sunaric, Dragana, et al.
Pubblicazione: (2025)

Mind the Ethics! The Overlooked Ethical Dimensions of GenAI in Software Modeling Education
di: Chakraborty, Shalini, et al.
Pubblicazione: (2025)

On the Utility of Domain Modeling Assistance with Large Language Models
di: Chaaben, Meriem Ben, et al.
Pubblicazione: (2024)

Digital Twin Evolution for Sustainable Smart Ecosystems
di: Michael, Judith, et al.
Pubblicazione: (2024)

Circular Systems Engineering
di: David, Istvan, et al.
Pubblicazione: (2023)

Different Debt: An Addition to the Technical Debt Dataset and a Demonstration Using Developer Personality
di: Graf-Vlachy, Lorenz, et al.
Pubblicazione: (2024)

Babbling Suppression: Making LLMs Greener One Token at a Time
di: Solovyeva, Lola, et al.
Pubblicazione: (2026)

KGym: A Platform and Dataset to Benchmark Large Language Models on Linux Kernel Crash Resolution
di: Mathai, Alex, et al.
Pubblicazione: (2024)

The Risk-Taking Software Engineer: A Framed Portrait
di: Graf-Vlachy, Lorenz
Pubblicazione: (2023)

AI-Powered, But Power-Hungry? Energy Efficiency of LLM-Generated Code
di: Solovyeva, Lola, et al.
Pubblicazione: (2025)

Generative AI in Systems Engineering: A Framework for Risk Assessment of Large Language Models
di: Otten, Stefan, et al.
Pubblicazione: (2026)

From Bugs to Benchmarks: A Comprehensive Survey of Software Defect Datasets
di: Zhu, Hao-Nan, et al.
Pubblicazione: (2025)

A Benchmark Dataset And LLMs Comparison For NFR Classification With Explainable AI
di: Sakib, Esrat Ebtida, et al.
Pubblicazione: (2025)

JunoBench: A Benchmark Dataset of Crashes in Python Machine Learning Jupyter Notebooks
di: Wang, Yiran, et al.
Pubblicazione: (2025)

Towards Green AI: Decoding the Energy of LLM Inference in Software Development
di: Solovyeva, Lola, et al.
Pubblicazione: (2026)

The Type to Take Out a Loan? A Study of Developer Personality and Technical Debt
di: Graf-Vlachy, Lorenz, et al.
Pubblicazione: (2023)

Claim against Measurement: Statistical Artefacts in Quantum Error Mitigation Benchmarks
di: Köster, Dominik, et al.
Pubblicazione: (2026)

ScarfBench: A Benchmark for Cross-Framework Application Migration in Enterprise Java
di: Pavuluri, Advait, et al.
Pubblicazione: (2026)

Leveraging LLMs for Automated Translation of Legacy Code: A Case Study on PL/SQL to Java Transformation
di: Solovyeva, Lola, et al.
Pubblicazione: (2025)

Beyond AI Delegation: A Prompt Pattern Framework for Productive Struggle and Evaluative Judgement in Secure Coding Education
di: Haindl, Philipp, et al.
Pubblicazione: (2026)

Towards A Double-Edged Sword: Modelling the Impact in Agile Software Development
di: Neumann, Michael, et al.
Pubblicazione: (2024)

SWE-QA: A Dataset and Benchmark for Complex Code Understanding
di: Elkoussy, Laïla, et al.
Pubblicazione: (2026)

Engineering Reasoning and Instruction (ERI) Benchmark: A Large Taxonomy-driven Dataset for Foundation Models and Agents
di: Naser, MZ, et al.
Pubblicazione: (2026)

A Benchmark for Language Models in Real-World System Building
di: Jin, Weilin, et al.
Pubblicazione: (2026)

SEMODS: A Validated Dataset of Open-Source Software Engineering Models
di: González, Alexandra, et al.
Pubblicazione: (2026)

CPRet: A Dataset, Benchmark, and Model for Retrieval in Competitive Programming
di: Deng, Han, et al.
Pubblicazione: (2025)

A System Model Generation Benchmark from Natural Language Requirements
di: Jin, Dongming, et al.
Pubblicazione: (2025)

A Dataset For Computational Reproducibility
di: Costa, Lázaro, et al.
Pubblicazione: (2025)

BinMetric: A Comprehensive Binary Analysis Benchmark for Large Language Models
di: Shang, Xiuwei, et al.
Pubblicazione: (2025)

A Multi-Language Object-Oriented Programming Benchmark for Large Language Models
di: Wang, Shuai, et al.
Pubblicazione: (2025)

A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends
di: Zheng, Zibin, et al.
Pubblicazione: (2023)

A Tool for Automatically Cataloguing and Selecting Pre-Trained Models and Datasets for Software Engineering
di: González, Alexandra, et al.
Pubblicazione: (2026)

Benchmark Dataset Generation and Evaluation for Excel Formula Repair with LLMs
di: Singha, Ananya, et al.
Pubblicazione: (2025)

A Tool for Benchmarking Large Language Models' Robustness in Assessing the Realism of Driving Scenarios
di: Wu, Jiahui, et al.
Pubblicazione: (2025)