Performance Evaluation in Multimedia Retrieval
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913538986999808 |
|---|---|
| author | Sauter, Loris Gasser, Ralph Schuldt, Heiko Bernstein, Abraham Rossetto, Luca |
| author_facet | Sauter, Loris Gasser, Ralph Schuldt, Heiko Bernstein, Abraham Rossetto, Luca |
| contents | Performance evaluation in multimedia retrieval, as in the information retrieval domain at large, relies heavily on retrieval experiments, employing a broad range of techniques and metrics. These can involve human-in-the-loop and machine-only settings for the retrieval process itself and the subsequent verification of results. Such experiments can be elaborate and use-case-specific, which can make them difficult to compare or replicate. In this paper, we present a formal model to express all relevant aspects of such retrieval experiments, as well as a flexible open-source evaluation infrastructure that implements the model. These contributions intend to make a step towards lowering the hurdles for conducting retrieval experiments and improving their reproducibility. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_06654 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Performance Evaluation in Multimedia Retrieval Sauter, Loris Gasser, Ralph Schuldt, Heiko Bernstein, Abraham Rossetto, Luca Information Retrieval Multimedia Performance evaluation in multimedia retrieval, as in the information retrieval domain at large, relies heavily on retrieval experiments, employing a broad range of techniques and metrics. These can involve human-in-the-loop and machine-only settings for the retrieval process itself and the subsequent verification of results. Such experiments can be elaborate and use-case-specific, which can make them difficult to compare or replicate. In this paper, we present a formal model to express all relevant aspects of such retrieval experiments, as well as a flexible open-source evaluation infrastructure that implements the model. These contributions intend to make a step towards lowering the hurdles for conducting retrieval experiments and improving their reproducibility. |
| title | Performance Evaluation in Multimedia Retrieval |
| topic | Information Retrieval Multimedia |
| url | https://arxiv.org/abs/2410.06654 |