Natural Language Processing RELIES on Linguistics

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Opitz, Juri, Wein, Shira, Schneider, Nathan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911212444319744
author Opitz, Juri
Wein, Shira
Schneider, Nathan
author_facet Opitz, Juri
Wein, Shira
Schneider, Nathan
contents Large Language Models (LLMs) have become capable of generating highly fluent text in certain languages, without modules specially designed to capture grammar or semantic coherence. What does this mean for the future of linguistic expertise in NLP? We highlight several aspects in which NLP (still) relies on linguistics, or where linguistic thinking can illuminate new directions. We argue our case around the acronym RELIES that encapsulates six major facets where linguistics contributes to NLP: Resources, Evaluation, Low-resource settings, Interpretability, Explanation, and the Study of language. This list is not exhaustive, nor is linguistics the main point of reference for every effort under these themes; but at a macro level, these facets highlight the enduring importance of studying machine systems vis-à-vis systems of human language.
format Preprint
id arxiv_https___arxiv_org_abs_2405_05966
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Natural Language Processing RELIES on Linguistics
Opitz, Juri
Wein, Shira
Schneider, Nathan
Computation and Language
Artificial Intelligence
Large Language Models (LLMs) have become capable of generating highly fluent text in certain languages, without modules specially designed to capture grammar or semantic coherence. What does this mean for the future of linguistic expertise in NLP? We highlight several aspects in which NLP (still) relies on linguistics, or where linguistic thinking can illuminate new directions. We argue our case around the acronym RELIES that encapsulates six major facets where linguistics contributes to NLP: Resources, Evaluation, Low-resource settings, Interpretability, Explanation, and the Study of language. This list is not exhaustive, nor is linguistics the main point of reference for every effort under these themes; but at a macro level, these facets highlight the enduring importance of studying machine systems vis-à-vis systems of human language.
title Natural Language Processing RELIES on Linguistics
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2405.05966