Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914579989135360 |
|---|---|
| author | Chen, Ruoyu Sun, Shangquan Guo, Xiaoqing Zhang, Sanyi Liu, Kangwei Liu, Shiming Wang, Zhangcheng Zhang, Qunli Zhang, Hua Cao, Xiaochun |
| author_facet | Chen, Ruoyu Sun, Shangquan Guo, Xiaoqing Zhang, Sanyi Liu, Kangwei Liu, Shiming Wang, Zhangcheng Zhang, Qunli Zhang, Hua Cao, Xiaochun |
| contents | Reliable models should not only predict correctly, but also justify decisions with acceptable evidence. Yet conventional supervised learning typically provides only class-level labels, allowing models to achieve high accuracy through shortcut correlations rather than the intended evidence. Human priors can help constrain such behavior, but aligning models to these priors remains challenging because learned representations often diverge from human perception. To address this challenge, we propose an attribution-based human prior alignment method. We encode human priors as input regions that the model is expected to rely on (e.g., bounding boxes), and leverage a highly faithful subset-selection-based attribution approach to expose the model's decision evidence during training. When the attribution region deviates substantially from the prior regions, we penalize reliance on off-prior evidence, encouraging the model to shift its attribution toward the intended regions. This is achieved through a training objective that imposes attribution constraints induced by the human prior. We validate our method on both image classification and click decision tasks in MLLM-based GUI agent models. Across conventional classification and autoregressive generation settings, human prior alignment consistently improves task accuracy while also enhancing the model's decision reasonability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_07008 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making Chen, Ruoyu Sun, Shangquan Guo, Xiaoqing Zhang, Sanyi Liu, Kangwei Liu, Shiming Wang, Zhangcheng Zhang, Qunli Zhang, Hua Cao, Xiaochun Computer Vision and Pattern Recognition Machine Learning Reliable models should not only predict correctly, but also justify decisions with acceptable evidence. Yet conventional supervised learning typically provides only class-level labels, allowing models to achieve high accuracy through shortcut correlations rather than the intended evidence. Human priors can help constrain such behavior, but aligning models to these priors remains challenging because learned representations often diverge from human perception. To address this challenge, we propose an attribution-based human prior alignment method. We encode human priors as input regions that the model is expected to rely on (e.g., bounding boxes), and leverage a highly faithful subset-selection-based attribution approach to expose the model's decision evidence during training. When the attribution region deviates substantially from the prior regions, we penalize reliance on off-prior evidence, encouraging the model to shift its attribution toward the intended regions. This is achieved through a training objective that imposes attribution constraints induced by the human prior. We validate our method on both image classification and click decision tasks in MLLM-based GUI agent models. Across conventional classification and autoregressive generation settings, human prior alignment consistently improves task accuracy while also enhancing the model's decision reasonability. |
| title | Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making |
| topic | Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2602.07008 |