Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.06906 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916242788450304 |
|---|---|
| author | Jiang, Guangyuan Hofer, Matthias Mao, Jiayuan Wong, Lionel Tenenbaum, Joshua B. Levy, Roger P. |
| author_facet | Jiang, Guangyuan Hofer, Matthias Mao, Jiayuan Wong, Lionel Tenenbaum, Joshua B. Levy, Roger P. |
| contents | One hallmark of human language is its combinatoriality -- reusing a relatively small inventory of building blocks to create a far larger inventory of increasingly complex structures. In this paper, we explore the idea that combinatoriality in language reflects a human inductive bias toward representational efficiency in symbol systems. We develop a computational framework for discovering structure in a writing system. Built on top of state-of-the-art library learning and program synthesis techniques, our computational framework discovers known linguistic structures in the Chinese writing system and reveals how the system evolves towards simplification under pressures for representational efficiency. We demonstrate how a library learning approach, utilizing learned abstractions and compression, may help reveal the fundamental computational principles that underlie the creation of combinatorial structures in human cognition, and offer broader insights into the evolution of efficient communication systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_06906 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Finding structure in logographic writing with library learning Jiang, Guangyuan Hofer, Matthias Mao, Jiayuan Wong, Lionel Tenenbaum, Joshua B. Levy, Roger P. Computation and Language One hallmark of human language is its combinatoriality -- reusing a relatively small inventory of building blocks to create a far larger inventory of increasingly complex structures. In this paper, we explore the idea that combinatoriality in language reflects a human inductive bias toward representational efficiency in symbol systems. We develop a computational framework for discovering structure in a writing system. Built on top of state-of-the-art library learning and program synthesis techniques, our computational framework discovers known linguistic structures in the Chinese writing system and reveals how the system evolves towards simplification under pressures for representational efficiency. We demonstrate how a library learning approach, utilizing learned abstractions and compression, may help reveal the fundamental computational principles that underlie the creation of combinatorial structures in human cognition, and offer broader insights into the evolution of efficient communication systems. |
| title | Finding structure in logographic writing with library learning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.06906 |