Cover Image

SCOPE: A Dataset of Stereotyped Prompts for Counterfactual Fairness Assessment of LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Parziale, Alessandra, Voria, Gianmario, Pontillo, Valeria, De Lucia, Andrea, Catolino, Gemma, Palomba, Fabio
Format:	Preprint
Published:	2026
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Toward Systematic Counterfactual Fairness Evaluation of Large Language Models: The CAFFE Framework
by: Parziale, Alessandra, et al.
Published: (2025)

Contextual Fairness-Aware Practices in ML: A Cost-Effective Empirical Evaluation
by: Parziale, Alessandra, et al.
Published: (2025)

Once Upon a Team: Investigating Bias in LLM-Driven Software Team Composition and Task Allocation
by: Parziale, Alessandra, et al.
Published: (2026)

Bias Ahead: Sensitive Prompts as Early Warnings for Fairness in Large Language Models
by: Voria, Gianmario, et al.
Published: (2026)

Tracing Stereotypes in Pre-trained Transformers: From Biased Neurons to Fairer Models
by: Voria, Gianmario, et al.
Published: (2026)

Data Preparation for Fairness-Performance Trade-Offs: A Practitioner-Friendly Alternative?
by: Voria, Gianmario, et al.
Published: (2024)

From Expectation to Habit: Why Do Software Practitioners Adopt Fairness Toolkits?
by: Voria, Gianmario, et al.
Published: (2024)

RECOVER: Toward Requirements Generation from Stakeholders' Conversations
by: Voria, Gianmario, et al.
Published: (2024)

A Catalog of Fairness-Aware Practices in Machine Learning Engineering
by: Voria, Gianmario, et al.
Published: (2024)

Exploring Individual Factors in the Adoption of LLMs for Specific Software Engineering Purposes
by: Lambiase, Stefano, et al.
Published: (2025)

Motivations, Challenges, Best Practices, and Benefits for Bots and Conversational Agents in Software Engineering: A Multivocal Literature Review
by: Lambiase, Stefano, et al.
Published: (2024)

How Do Communities of ML-Enabled Systems Smell? A Cross-Sectional Study on the Prevalence of Community Smells
by: Annunziata, Giusy, et al.
Published: (2025)

Investigating the Role of Cultural Values in Adopting Large Language Models for Software Engineering
by: Lambiase, Stefano, et al.
Published: (2024)

Do Prompt Patterns Affect Code Quality? A First Empirical Assessment of ChatGPT-Generated Code
by: Della Porta, Antonio, et al.
Published: (2025)

Classification, Challenges, and Automated Approaches to Handle Non-Functional Requirements in ML-Enabled Systems: A Systematic Literature Review
by: De Martino, Vincenzo, et al.
Published: (2023)

Socio-Technical Well-Being of Quantum Software Communities: An Overview on Community Smells
by: Lambiase, Stefano, et al.
Published: (2026)

Do Developers Adopt Green Architectural Tactics for ML-Enabled Systems? A Mining Software Repository Study
by: De Martino, Vincenzo, et al.
Published: (2024)

REST in Pieces: RESTful Design Rule Violations in Student-Built Web Apps
by: Di Meglio, Sergio, et al.
Published: (2025)

Green Architectural Tactics in ML-enabled Systems: An LLM-based Repository Mining Study
by: De Martino, Vincenzo, et al.
Published: (2026)

A Framework for Using LLMs for Repository Mining Studies in Empirical Software Engineering
by: de Martino, Vincenzo, et al.
Published: (2024)

A First Look at the Lifecycle of DL-Specific Self-Admitted Technical Debt
by: Recupito, Gilberto, et al.
Published: (2025)

Fairness Mediator: Neutralize Stereotype Associations to Mitigate Bias in Large Language Models
by: Xiao, Yisong, et al.
Published: (2025)

SCOPE: Performance Testing for Serverless Computing
by: Wen, Jinfeng, et al.
Published: (2023)

Investigating Technical Debt Types, Issues, and Solutions in Serverless Computing
by: Perera, Hasini Sumalee, et al.
Published: (2026)

A Methodological Framework for LLM-Based Mining of Software Repositories
by: De Martino, Vincenzo, et al.
Published: (2025)

Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code
by: Shin, Jiho, et al.
Published: (2023)

What Does a Software Engineer Look Like? Exploring Societal Stereotypes in LLMs
by: Bano, Muneera, et al.
Published: (2025)

PromptSet: A Programmer's Prompting Dataset
by: Pister, Kaiser, et al.
Published: (2024)

LLM-Assisted Empirical Software Engineering: Systematic Literature Review and Research Agenda
by: Gomes, Victoria, et al.
Published: (2026)

In Search of Metrics to Guide Developer-Based Refactoring Recommendations
by: Robredo, Mikel, et al.
Published: (2024)

Advances in Artificial Intelligence forDiabetes Prediction: Insights from a Systematic Literature Review
by: Khokhar, Pir Bakhsh, et al.
Published: (2024)

Sustainability of Machine Learning-Enabled Systems: The Machine Learning Practitioner's Perspective
by: De Martino, Vincenzo, et al.
Published: (2025)

Test Oracle Automation in the era of LLMs
by: Molina, Facundo, et al.
Published: (2024)

Investigating the Performance of Small Language Models in Detecting Test Smells in Manual Test Cases
by: Lucas, Keila, et al.
Published: (2025)

Teaching Mining Software Repositories
by: Codabux, Zadia, et al.
Published: (2025)

LLMs Are Not a Silver Bullet: A Case Study on Software Fairness
by: Li, Xinyue, et al.
Published: (2026)

On the Impact of 3D Visualization of Repository Metrics in Software Engineering Education
by: Di Dario, Dario, et al.
Published: (2024)

A Prompt-Based Framework for Loop Vulnerability Detection Using Local LLMs
by: Adeseye, Adeyemi, et al.
Published: (2026)

From Specifications to Prompts: On the Future of Generative LLMs in Requirements Engineering
by: Vogelsang, Andreas
Published: (2024)

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking
by: Wang, Zichong, et al.
Published: (2023)