Parsing Through Boundaries in Chinese Word Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Yige, Li, Zelong, Zhang, Cindy, Yang, Changbing, Cady, Amandisa, Lee, Ai Ka, Zeng, Zejiao, Jo, Eunkyul Leah, Pan, Haihua, Park, Jungyeul
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912464273145856
author Chen, Yige
Li, Zelong
Zhang, Cindy
Yang, Changbing
Cady, Amandisa
Lee, Ai Ka
Zeng, Zejiao
Jo, Eunkyul Leah
Pan, Haihua
Park, Jungyeul
author_facet Chen, Yige
Li, Zelong
Zhang, Cindy
Yang, Changbing
Cady, Amandisa
Lee, Ai Ka
Zeng, Zejiao
Jo, Eunkyul Leah
Pan, Haihua
Park, Jungyeul
contents Chinese word segmentation is a foundational task in natural language processing (NLP), with far-reaching effects on syntactic analysis. Unlike alphabetic languages like English, Chinese lacks explicit word boundaries, making segmentation both necessary and inherently ambiguous. This study highlights the intricate relationship between word segmentation and syntactic parsing, providing a clearer understanding of how different segmentation strategies shape dependency structures in Chinese. Focusing on the Chinese GSD treebank, we analyze multiple word boundary schemes, each reflecting distinct linguistic and computational assumptions, and examine how they influence the resulting syntactic structures. To support detailed comparison, we introduce an interactive web-based visualization tool that displays parsing outcomes across segmentation methods.
format Preprint
id arxiv_https___arxiv_org_abs_2503_23091
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Parsing Through Boundaries in Chinese Word Segmentation
Chen, Yige
Li, Zelong
Zhang, Cindy
Yang, Changbing
Cady, Amandisa
Lee, Ai Ka
Zeng, Zejiao
Jo, Eunkyul Leah
Pan, Haihua
Park, Jungyeul
Computation and Language
Chinese word segmentation is a foundational task in natural language processing (NLP), with far-reaching effects on syntactic analysis. Unlike alphabetic languages like English, Chinese lacks explicit word boundaries, making segmentation both necessary and inherently ambiguous. This study highlights the intricate relationship between word segmentation and syntactic parsing, providing a clearer understanding of how different segmentation strategies shape dependency structures in Chinese. Focusing on the Chinese GSD treebank, we analyze multiple word boundary schemes, each reflecting distinct linguistic and computational assumptions, and examine how they influence the resulting syntactic structures. To support detailed comparison, we introduce an interactive web-based visualization tool that displays parsing outcomes across segmentation methods.
title Parsing Through Boundaries in Chinese Word Segmentation
topic Computation and Language
url https://arxiv.org/abs/2503.23091