Consecutive Preferential Bayesian Optimization
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912693434187776 |
|---|---|
| author | Erarslan, Aras Salcedo, Carlos Sevilla Tanskanen, Ville Nisov, Anni Päiväkumpu, Eero Aisala, Heikki Honkapää, Kaisu Klami, Arto Mikkola, Petrus |
| author_facet | Erarslan, Aras Salcedo, Carlos Sevilla Tanskanen, Ville Nisov, Anni Päiväkumpu, Eero Aisala, Heikki Honkapää, Kaisu Klami, Arto Mikkola, Petrus |
| contents | Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate solutions for evaluation is also often expensive, but this cost is ignored by existing methods. We generalize preference-based optimization to explicitly account for production and evaluation costs with Consecutive Preferential Bayesian Optimization, reducing production cost by constraining comparisons to involve previously generated candidates. We also account for the perceptual ambiguity of the oracle providing the feedback by incorporating a Just-Noticeable Difference threshold into a probabilistic preference model to capture indifference to small utility differences. We adapt an information-theoretic acquisition strategy to this setting, selecting new configurations that are most informative about the unknown optimum under a preference model accounting for the perceptual ambiguity. We empirically demonstrate a notable increase in accuracy in setups with high production costs or with indifference feedback. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_05163 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Consecutive Preferential Bayesian Optimization Erarslan, Aras Salcedo, Carlos Sevilla Tanskanen, Ville Nisov, Anni Päiväkumpu, Eero Aisala, Heikki Honkapää, Kaisu Klami, Arto Mikkola, Petrus Machine Learning Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate solutions for evaluation is also often expensive, but this cost is ignored by existing methods. We generalize preference-based optimization to explicitly account for production and evaluation costs with Consecutive Preferential Bayesian Optimization, reducing production cost by constraining comparisons to involve previously generated candidates. We also account for the perceptual ambiguity of the oracle providing the feedback by incorporating a Just-Noticeable Difference threshold into a probabilistic preference model to capture indifference to small utility differences. We adapt an information-theoretic acquisition strategy to this setting, selecting new configurations that are most informative about the unknown optimum under a preference model accounting for the perceptual ambiguity. We empirically demonstrate a notable increase in accuracy in setups with high production costs or with indifference feedback. |
| title | Consecutive Preferential Bayesian Optimization |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2511.05163 |