Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.19649 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918156051677184 |
|---|---|
| author | Wehner, Jan Abdelnabi, Sahar Tan, Daniel Krueger, David Fritz, Mario |
| author_facet | Wehner, Jan Abdelnabi, Sahar Tan, Daniel Krueger, David Fritz, Mario |
| contents | Representation Engineering (RepE) is a novel paradigm for controlling the behavior of LLMs. Unlike traditional approaches that modify inputs or fine-tune the model, RepE directly manipulates the model's internal representations. As a result, it may offer more effective, interpretable, data-efficient, and flexible control over models' behavior. We present the first comprehensive survey of RepE for LLMs, reviewing the rapidly growing literature to address key questions: What RepE methods exist and how do they differ? For what concepts and problems has RepE been applied? What are the strengths and weaknesses of RepE compared to other methods? To answer these, we propose a unified framework describing RepE as a pipeline comprising representation identification, operationalization, and control. We posit that while RepE methods offer significant potential, challenges remain, including managing multiple concepts, ensuring reliability, and preserving models' performance. Towards improving RepE, we identify opportunities for experimental and methodological improvements and construct a guide for best practices. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_19649 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Taxonomy, Opportunities, and Challenges of Representation Engineering for Large Language Models Wehner, Jan Abdelnabi, Sahar Tan, Daniel Krueger, David Fritz, Mario Machine Learning Computation and Language Representation Engineering (RepE) is a novel paradigm for controlling the behavior of LLMs. Unlike traditional approaches that modify inputs or fine-tune the model, RepE directly manipulates the model's internal representations. As a result, it may offer more effective, interpretable, data-efficient, and flexible control over models' behavior. We present the first comprehensive survey of RepE for LLMs, reviewing the rapidly growing literature to address key questions: What RepE methods exist and how do they differ? For what concepts and problems has RepE been applied? What are the strengths and weaknesses of RepE compared to other methods? To answer these, we propose a unified framework describing RepE as a pipeline comprising representation identification, operationalization, and control. We posit that while RepE methods offer significant potential, challenges remain, including managing multiple concepts, ensuring reliability, and preserving models' performance. Towards improving RepE, we identify opportunities for experimental and methodological improvements and construct a guide for best practices. |
| title | Taxonomy, Opportunities, and Challenges of Representation Engineering for Large Language Models |
| topic | Machine Learning Computation and Language |
| url | https://arxiv.org/abs/2502.19649 |