RuOpinionNE-2024: Extraction of Opinion Tuples from Russian News Texts
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912318259986432 |
|---|---|
| author | Loukachevitch, Natalia Tkachenko, Natalia Lapanitsyna, Anna Tikhomirov, Mikhail Rusnachenko, Nicolay |
| author_facet | Loukachevitch, Natalia Tkachenko, Natalia Lapanitsyna, Anna Tikhomirov, Mikhail Rusnachenko, Nicolay |
| contents | In this paper, we introduce the Dialogue Evaluation shared task on extraction of structured opinions from Russian news texts. The task of the contest is to extract opinion tuples for a given sentence; the tuples are composed of a sentiment holder, its target, an expression and sentiment from the holder to the target. In total, the task received more than 100 submissions. The participants experimented mainly with large language models in zero-shot, few-shot and fine-tuning formats. The best result on the test set was obtained with fine-tuning of a large language model. We also compared 30 prompts and 11 open source language models with 3-32 billion parameters in the 1-shot and 10-shot settings and found the best models and prompts. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_06947 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RuOpinionNE-2024: Extraction of Opinion Tuples from Russian News Texts Loukachevitch, Natalia Tkachenko, Natalia Lapanitsyna, Anna Tikhomirov, Mikhail Rusnachenko, Nicolay Computation and Language I.2.7 In this paper, we introduce the Dialogue Evaluation shared task on extraction of structured opinions from Russian news texts. The task of the contest is to extract opinion tuples for a given sentence; the tuples are composed of a sentiment holder, its target, an expression and sentiment from the holder to the target. In total, the task received more than 100 submissions. The participants experimented mainly with large language models in zero-shot, few-shot and fine-tuning formats. The best result on the test set was obtained with fine-tuning of a large language model. We also compared 30 prompts and 11 open source language models with 3-32 billion parameters in the 1-shot and 10-shot settings and found the best models and prompts. |
| title | RuOpinionNE-2024: Extraction of Opinion Tuples from Russian News Texts |
| topic | Computation and Language I.2.7 |
| url | https://arxiv.org/abs/2504.06947 |