Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.12782 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918203952726016 |
|---|---|
| author | Rivasseau, Thomas |
| author_facet | Rivasseau, Thomas |
| contents | Current Large Language Model alignment research mostly focuses on improving model robustness against adversarial attacks and misbehavior by training on examples and prompting. Research has shown that LLM jailbreak probability increases with the size of the user input or conversation length. There is a lack of appropriate research into means of strengthening alignment which also scale with user input length. We propose interruptions as a possible solution to this problem. Interruptions are control sentences added to the user input approximately every x tokens for some arbitrary x. We suggest that this can be generalized to the Chain-of-Thought process to prevent scheming. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_12782 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | LLM Reinforcement in Context Rivasseau, Thomas Computation and Language Cryptography and Security Current Large Language Model alignment research mostly focuses on improving model robustness against adversarial attacks and misbehavior by training on examples and prompting. Research has shown that LLM jailbreak probability increases with the size of the user input or conversation length. There is a lack of appropriate research into means of strengthening alignment which also scale with user input length. We propose interruptions as a possible solution to this problem. Interruptions are control sentences added to the user input approximately every x tokens for some arbitrary x. We suggest that this can be generalized to the Chain-of-Thought process to prevent scheming. |
| title | LLM Reinforcement in Context |
| topic | Computation and Language Cryptography and Security |
| url | https://arxiv.org/abs/2511.12782 |