Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2602.08033 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911432086388736 |
|---|---|
| author | Fageot, Julien Grossglauser, Matthias Hoang, Lê-Nguyên Tacchi-Bénard, Matteo Villemaud, Oscar |
| author_facet | Fageot, Julien Grossglauser, Matthias Hoang, Lê-Nguyên Tacchi-Bénard, Matteo Villemaud, Oscar |
| contents | Should humans be asked to evaluate entities individually or comparatively? This question has been the subject of long debates. In this work, we show that, interestingly, combining both forms of preference elicitation can outperform the focus on a single kind. More specifically, we introduce SCoRa (Scoring from Comparisons and Ratings), a unified probabilistic model that allows to learn from both signals. We prove that the MAP estimator of SCoRa is well-behaved. It verifies monotonicity and robustness guarantees. We then empirically show that SCoRa recovers accurate scores, even under model mismatch. Most interestingly, we identify a realistic setting where combining comparisons and ratings outperforms using either one alone, and when the accurate ordering of top entities is critical. Given the de facto availability of signals of multiple forms, SCoRa additionally offers a versatile foundation for preference learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_08033 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | The Benefits of Diversity: Combining Comparisons and Ratings for Efficient Scoring Fageot, Julien Grossglauser, Matthias Hoang, Lê-Nguyên Tacchi-Bénard, Matteo Villemaud, Oscar Machine Learning Should humans be asked to evaluate entities individually or comparatively? This question has been the subject of long debates. In this work, we show that, interestingly, combining both forms of preference elicitation can outperform the focus on a single kind. More specifically, we introduce SCoRa (Scoring from Comparisons and Ratings), a unified probabilistic model that allows to learn from both signals. We prove that the MAP estimator of SCoRa is well-behaved. It verifies monotonicity and robustness guarantees. We then empirically show that SCoRa recovers accurate scores, even under model mismatch. Most interestingly, we identify a realistic setting where combining comparisons and ratings outperforms using either one alone, and when the accurate ordering of top entities is critical. Given the de facto availability of signals of multiple forms, SCoRa additionally offers a versatile foundation for preference learning. |
| title | The Benefits of Diversity: Combining Comparisons and Ratings for Efficient Scoring |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2602.08033 |