IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineering
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914439155941376 |
|---|---|
| author | Watkiss-Leek, Elliott Alharbi, Reham Rostron, Harry Ng, Andrew Johnson, Ewan Mitchell, Andrew Payne, Terry R. Tamma, Valentina de Berardinis, Jacopo |
| author_facet | Watkiss-Leek, Elliott Alharbi, Reham Rostron, Harry Ng, Andrew Johnson, Ewan Mitchell, Andrew Payne, Terry R. Tamma, Valentina de Berardinis, Jacopo |
| contents | Competency question (CQ) elicitation represents a critical but resource-intensive bottleneck in ontology engineering. This foundational phase is often hampered by the communication gap between domain experts, who possess the necessary knowledge, and ontology engineers, who formalise it. This paper introduces IDEA2, a novel, semi-automated workflow that integrates Large Language Models (LLMs) within a collaborative, expert-in-the-loop process to address this challenge. The methodology is characterised by a core iterative loop: an initial LLM-based extraction of CQs from requirement documents, a co-creational review and feedback phase by domain experts on an accessible collaborative platform, and an iterative, feedback-driven reformulation of rejected CQs by an LLM until consensus is achieved. To ensure transparency and reproducibility, the entire lifecycle of each CQ is tracked using a provenance model that captures the full lineage of edits, anonymised feedback, and generation parameters. The workflow was validated in 2 real-world scenarios (scientific data, cultural heritage), demonstrating that IDEA2 can accelerate the requirements engineering process, improve the acceptance and relevance of the resulting CQs, and exhibit high usability and effectiveness among domain experts. We release all code and experiments at https://github.com/KE-UniLiv/IDEA2 |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_01344 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineering Watkiss-Leek, Elliott Alharbi, Reham Rostron, Harry Ng, Andrew Johnson, Ewan Mitchell, Andrew Payne, Terry R. Tamma, Valentina de Berardinis, Jacopo Artificial Intelligence Competency question (CQ) elicitation represents a critical but resource-intensive bottleneck in ontology engineering. This foundational phase is often hampered by the communication gap between domain experts, who possess the necessary knowledge, and ontology engineers, who formalise it. This paper introduces IDEA2, a novel, semi-automated workflow that integrates Large Language Models (LLMs) within a collaborative, expert-in-the-loop process to address this challenge. The methodology is characterised by a core iterative loop: an initial LLM-based extraction of CQs from requirement documents, a co-creational review and feedback phase by domain experts on an accessible collaborative platform, and an iterative, feedback-driven reformulation of rejected CQs by an LLM until consensus is achieved. To ensure transparency and reproducibility, the entire lifecycle of each CQ is tracked using a provenance model that captures the full lineage of edits, anonymised feedback, and generation parameters. The workflow was validated in 2 real-world scenarios (scientific data, cultural heritage), demonstrating that IDEA2 can accelerate the requirements engineering process, improve the acceptance and relevance of the resulting CQs, and exhibit high usability and effectiveness among domain experts. We release all code and experiments at https://github.com/KE-UniLiv/IDEA2 |
| title | IDEA2: Expert-in-the-loop competency question elicitation for collaborative ontology engineering |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2604.01344 |