Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2408.10141 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916362028318720 |
|---|---|
| author | Kabongo, Salomon D'Souza, Jennifer |
| author_facet | Kabongo, Salomon D'Souza, Jennifer |
| contents | This study demonstrates the application of instruction finetuning of pretrained Large Language Models (LLMs) to automate the generation of AI research leaderboards, extracting (Task, Dataset, Metric, Score) quadruples from articles. It aims to streamline the dissemination of advancements in AI research by transitioning from traditional, manual community curation, or otherwise taxonomy-constrained natural language inference (NLI) models, to an automated, generative LLM-based approach. Utilizing the FLAN-T5 model, this research enhances LLMs' adaptability and reliability in information extraction, offering a novel method for structured knowledge representation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_10141 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Instruction Finetuning for Leaderboard Generation from Empirical AI Research Kabongo, Salomon D'Souza, Jennifer Computation and Language This study demonstrates the application of instruction finetuning of pretrained Large Language Models (LLMs) to automate the generation of AI research leaderboards, extracting (Task, Dataset, Metric, Score) quadruples from articles. It aims to streamline the dissemination of advancements in AI research by transitioning from traditional, manual community curation, or otherwise taxonomy-constrained natural language inference (NLI) models, to an automated, generative LLM-based approach. Utilizing the FLAN-T5 model, this research enhances LLMs' adaptability and reliability in information extraction, offering a novel method for structured knowledge representation. |
| title | Instruction Finetuning for Leaderboard Generation from Empirical AI Research |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2408.10141 |