Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.12357 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913796883218432 |
|---|---|
| author | Adamson, Reece Song, Erin |
| author_facet | Adamson, Reece Song, Erin |
| contents | Validating Large Language Models with ReLM explores the application of formal languages to evaluate and control Large Language Models (LLMs) for memorization, bias, and zero-shot performance. Current approaches for evaluating these types behavior are often slow, imprecise, costly, or introduce biases of their own, but are necessary due to the importance of this behavior when productionizing LLMs. This project reproduces key results from the original ReLM paper and expounds on the approach and applications with an emphasis on the relevance to the field of systems for machine learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_12357 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Replicating ReLM Results: Validating Large Language Models with ReLM Adamson, Reece Song, Erin Computation and Language Validating Large Language Models with ReLM explores the application of formal languages to evaluate and control Large Language Models (LLMs) for memorization, bias, and zero-shot performance. Current approaches for evaluating these types behavior are often slow, imprecise, costly, or introduce biases of their own, but are necessary due to the importance of this behavior when productionizing LLMs. This project reproduces key results from the original ReLM paper and expounds on the approach and applications with an emphasis on the relevance to the field of systems for machine learning. |
| title | Replicating ReLM Results: Validating Large Language Models with ReLM |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2504.12357 |