Interpreting Reinforcement Learning Agents with Susceptibilities
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909027231858688 |
|---|---|
| author | Elliott, Chris Urdshals, Einar Quarel, David Murfet, Daniel |
| author_facet | Elliott, Chris Urdshals, Einar Quarel, David Murfet, Daniel |
| contents | Susceptibilities are a technique for neural network interpretability that studies the response of posterior expectation values of observables to perturbations of the loss. We generalize this construction to the setting of the regret in deep reinforcement learning and investigate the utility of susceptibilities in a simple gridworld model that nevertheless exhibits non-trivial stagewise development. We argue that susceptibilities reveal internal features of the development of the model in parameter space that one cannot detect purely by studying the development of the learned policy. We validate these results with activation-steering, and discuss the framework's extension to RLHF post-training. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_08007 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Interpreting Reinforcement Learning Agents with Susceptibilities Elliott, Chris Urdshals, Einar Quarel, David Murfet, Daniel Machine Learning Susceptibilities are a technique for neural network interpretability that studies the response of posterior expectation values of observables to perturbations of the loss. We generalize this construction to the setting of the regret in deep reinforcement learning and investigate the utility of susceptibilities in a simple gridworld model that nevertheless exhibits non-trivial stagewise development. We argue that susceptibilities reveal internal features of the development of the model in parameter space that one cannot detect purely by studying the development of the learned policy. We validate these results with activation-steering, and discuss the framework's extension to RLHF post-training. |
| title | Interpreting Reinforcement Learning Agents with Susceptibilities |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2605.08007 |