Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.03012 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914964219887616 |
|---|---|
| author | Tsyganok, Vitaliy Olenko, Andriy Roik, Pavlo Vlasenko, Oksana |
| author_facet | Tsyganok, Vitaliy Olenko, Andriy Roik, Pavlo Vlasenko, Oksana |
| contents | To obtain reliable results of expertise, which usually use individual and group expert pairwise comparisons, it is important to summarize (aggregate) expert estimates provided that they are sufficiently consistent. There are several ways to determine the threshold level of consistency sufficient for aggregation of estimates. They can be used for different consistency indices, but none of them relates the threshold value to the requirements for the reliability of the expertise's results. Therefore, a new approach to determining this consistency threshold is required. The proposed approach is based on simulation modeling of expert pairwise comparisons and a targeted search for the most inconsistent among the modeled pairwise comparison matrices. Thus, the search for the least consistent matrix is carried out for a given perturbation of the perfectly consistent matrix. This allows for determining the consistency threshold corresponding to a given permissible relative deviation of the resulting weight of an alternative from its hypothetical reference value. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_03012 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Determining adequate consistency levels for aggregation of expert estimates Tsyganok, Vitaliy Olenko, Andriy Roik, Pavlo Vlasenko, Oksana Methodology To obtain reliable results of expertise, which usually use individual and group expert pairwise comparisons, it is important to summarize (aggregate) expert estimates provided that they are sufficiently consistent. There are several ways to determine the threshold level of consistency sufficient for aggregation of estimates. They can be used for different consistency indices, but none of them relates the threshold value to the requirements for the reliability of the expertise's results. Therefore, a new approach to determining this consistency threshold is required. The proposed approach is based on simulation modeling of expert pairwise comparisons and a targeted search for the most inconsistent among the modeled pairwise comparison matrices. Thus, the search for the least consistent matrix is carried out for a given perturbation of the perfectly consistent matrix. This allows for determining the consistency threshold corresponding to a given permissible relative deviation of the resulting weight of an alternative from its hypothetical reference value. |
| title | Determining adequate consistency levels for aggregation of expert estimates |
| topic | Methodology |
| url | https://arxiv.org/abs/2410.03012 |