The Large Language Model GreekLegalRoBERTa

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Saketos, Vasileios, Pantazi, Despina-Athanasia, Koubarakis, Manolis
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909352671051776
author Saketos, Vasileios
Pantazi, Despina-Athanasia
Koubarakis, Manolis
author_facet Saketos, Vasileios
Pantazi, Despina-Athanasia
Koubarakis, Manolis
contents We develop four versions of GreekLegalRoBERTa, which are four large language models trained on Greek legal and nonlegal text. We show that our models surpass the performance of GreekLegalBERT, Greek- LegalBERT-v2, and GreekBERT in two tasks involving Greek legal documents: named entity recognition and multi-class legal topic classification. We view our work as a contribution to the study of domain-specific NLP tasks in low-resource languages, like Greek, using modern NLP techniques and methodologies.
format Preprint
id arxiv_https___arxiv_org_abs_2410_12852
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Large Language Model GreekLegalRoBERTa
Saketos, Vasileios
Pantazi, Despina-Athanasia
Koubarakis, Manolis
Computation and Language
Machine Learning
We develop four versions of GreekLegalRoBERTa, which are four large language models trained on Greek legal and nonlegal text. We show that our models surpass the performance of GreekLegalBERT, Greek- LegalBERT-v2, and GreekBERT in two tasks involving Greek legal documents: named entity recognition and multi-class legal topic classification. We view our work as a contribution to the study of domain-specific NLP tasks in low-resource languages, like Greek, using modern NLP techniques and methodologies.
title The Large Language Model GreekLegalRoBERTa
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2410.12852