Saved in:
Bibliographic Details
Main Authors: Min, Junghyun, Lee, Minho, Lee, Woochul, Lee, Yeonsoo
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.08382
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917970224087040
author Min, Junghyun
Lee, Minho
Lee, Woochul
Lee, Yeonsoo
author_facet Min, Junghyun
Lee, Minho
Lee, Woochul
Lee, Yeonsoo
contents Unsupervised learning objectives like autoregressive and masked language modeling constitute a significant part in producing pre-trained representations that perform various downstream applications from natural language understanding to conversational tasks. However, despite impressive generative capabilities of recent large language models, their abilities to capture syntactic or semantic structure within text lag behind. We hypothesize that the mismatch between linguistic performance and competence in machines is attributable to insufficient learning of linguistic structure knowledge via currently popular pre-training objectives. Working with English, we show that punctuation restoration as a learning objective improves performance on structure-related tasks like named entity recognition, open information extraction, chunking, and part-of-speech tagging. Punctuation restoration results in $\blacktriangle$$\geq2\%$p improvement in 16 out of 18 experiments, across 6 out of 7 tasks. Our results show that punctuation restoration is an effective learning objective that can improve structure understanding and yield a more robust structure-aware representations of natural language in base-sized models.
format Preprint
id arxiv_https___arxiv_org_abs_2402_08382
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Punctuation Restoration Improves Structure Understanding Without Supervision
Min, Junghyun
Lee, Minho
Lee, Woochul
Lee, Yeonsoo
Computation and Language
Unsupervised learning objectives like autoregressive and masked language modeling constitute a significant part in producing pre-trained representations that perform various downstream applications from natural language understanding to conversational tasks. However, despite impressive generative capabilities of recent large language models, their abilities to capture syntactic or semantic structure within text lag behind. We hypothesize that the mismatch between linguistic performance and competence in machines is attributable to insufficient learning of linguistic structure knowledge via currently popular pre-training objectives. Working with English, we show that punctuation restoration as a learning objective improves performance on structure-related tasks like named entity recognition, open information extraction, chunking, and part-of-speech tagging. Punctuation restoration results in $\blacktriangle$$\geq2\%$p improvement in 16 out of 18 experiments, across 6 out of 7 tasks. Our results show that punctuation restoration is an effective learning objective that can improve structure understanding and yield a more robust structure-aware representations of natural language in base-sized models.
title Punctuation Restoration Improves Structure Understanding Without Supervision
topic Computation and Language
url https://arxiv.org/abs/2402.08382