Explainable data-driven modeling via mixture of experts: towards effective blending of grey and black-box models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913215787565056 |
|---|---|
| author | Leoni, Jessica Breschi, Valentina Formentin, Simone Tanelli, Mara |
| author_facet | Leoni, Jessica Breschi, Valentina Formentin, Simone Tanelli, Mara |
| contents | Traditional models grounded in first principles often struggle with accuracy as the system's complexity increases. Conversely, machine learning approaches, while powerful, face challenges in interpretability and in handling physical constraints. Efforts to combine these models often often stumble upon difficulties in finding a balance between accuracy and complexity. To address these issues, we propose a comprehensive framework based on a "mixture of experts" rationale. This approach enables the data-based fusion of diverse local models, leveraging the full potential of first-principle-based priors. Our solution allows independent training of experts, drawing on techniques from both machine learning and system identification, and it supports both collaborative and competitive learning paradigms. To enhance interpretability, we penalize abrupt variations in the expert's combination. Experimental results validate the effectiveness of our approach in producing an interpretable combination of models closely resembling the target phenomena. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_17118 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Explainable data-driven modeling via mixture of experts: towards effective blending of grey and black-box models Leoni, Jessica Breschi, Valentina Formentin, Simone Tanelli, Mara Machine Learning Systems and Control Traditional models grounded in first principles often struggle with accuracy as the system's complexity increases. Conversely, machine learning approaches, while powerful, face challenges in interpretability and in handling physical constraints. Efforts to combine these models often often stumble upon difficulties in finding a balance between accuracy and complexity. To address these issues, we propose a comprehensive framework based on a "mixture of experts" rationale. This approach enables the data-based fusion of diverse local models, leveraging the full potential of first-principle-based priors. Our solution allows independent training of experts, drawing on techniques from both machine learning and system identification, and it supports both collaborative and competitive learning paradigms. To enhance interpretability, we penalize abrupt variations in the expert's combination. Experimental results validate the effectiveness of our approach in producing an interpretable combination of models closely resembling the target phenomena. |
| title | Explainable data-driven modeling via mixture of experts: towards effective blending of grey and black-box models |
| topic | Machine Learning Systems and Control |
| url | https://arxiv.org/abs/2401.17118 |