Formal Aspects of Language Modeling
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917642197008384 |
|---|---|
| author | Cotterell, Ryan Svete, Anej Meister, Clara Liu, Tianyu Du, Li |
| author_facet | Cotterell, Ryan Svete, Anej Meister, Clara Liu, Tianyu Du, Li |
| contents | Large language models have become one of the most commonly deployed NLP inventions. In the past half-decade, their integration into core natural language processing tools has dramatically increased the performance of such tools, and they have entered the public discourse surrounding artificial intelligence. Consequently, it is important for both developers and researchers alike to understand the mathematical foundations of large language models, as well as how to implement them. These notes are the accompaniment to the theoretical portion of the ETH Zürich course on large language models, covering what constitutes a language model from a formal, theoretical perspective. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_04329 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Formal Aspects of Language Modeling Cotterell, Ryan Svete, Anej Meister, Clara Liu, Tianyu Du, Li Computation and Language Large language models have become one of the most commonly deployed NLP inventions. In the past half-decade, their integration into core natural language processing tools has dramatically increased the performance of such tools, and they have entered the public discourse surrounding artificial intelligence. Consequently, it is important for both developers and researchers alike to understand the mathematical foundations of large language models, as well as how to implement them. These notes are the accompaniment to the theoretical portion of the ETH Zürich course on large language models, covering what constitutes a language model from a formal, theoretical perspective. |
| title | Formal Aspects of Language Modeling |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2311.04329 |