DeFine: A Decomposed and Fine-Grained Annotated Dataset for Long-form Article Generation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909532620324864 |
|---|---|
| author | Wang, Ming Wang, Fang Hu, Minghao He, Li Wang, Haiyang Zhang, Jun Yan, Tianwei Li, Li Luo, Zhunchen Luo, Wei Bai, Xiaoying Geng, Guotong |
| author_facet | Wang, Ming Wang, Fang Hu, Minghao He, Li Wang, Haiyang Zhang, Jun Yan, Tianwei Li, Li Luo, Zhunchen Luo, Wei Bai, Xiaoying Geng, Guotong |
| contents | Long-form article generation (LFAG) presents challenges such as maintaining logical consistency, comprehensive topic coverage, and narrative coherence across extended articles. Existing datasets often lack both the hierarchical structure and fine-grained annotation needed to effectively decompose tasks, resulting in shallow, disorganized article generation. To address these limitations, we introduce DeFine, a Decomposed and Fine-grained annotated dataset for long-form article generation. DeFine is characterized by its hierarchical decomposition strategy and the integration of domain-specific knowledge with multi-level annotations, ensuring granular control and enhanced depth in article generation. To construct the dataset, a multi-agent collaborative pipeline is proposed, which systematically segments the generation process into four parts: Data Miner, Cite Retreiver, Q&A Annotator and Data Cleaner. To validate the effectiveness of DeFine, we designed and tested three LFAG baselines: the web retrieval, the local retrieval, and the grounded reference. We fine-tuned the Qwen2-7b-Instruct model using the DeFine training dataset. The experimental results showed significant improvements in text quality, specifically in topic coverage, depth of information, and content fidelity. Our dataset publicly available to facilitate future research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_07170 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DeFine: A Decomposed and Fine-Grained Annotated Dataset for Long-form Article Generation Wang, Ming Wang, Fang Hu, Minghao He, Li Wang, Haiyang Zhang, Jun Yan, Tianwei Li, Li Luo, Zhunchen Luo, Wei Bai, Xiaoying Geng, Guotong Computation and Language Artificial Intelligence Long-form article generation (LFAG) presents challenges such as maintaining logical consistency, comprehensive topic coverage, and narrative coherence across extended articles. Existing datasets often lack both the hierarchical structure and fine-grained annotation needed to effectively decompose tasks, resulting in shallow, disorganized article generation. To address these limitations, we introduce DeFine, a Decomposed and Fine-grained annotated dataset for long-form article generation. DeFine is characterized by its hierarchical decomposition strategy and the integration of domain-specific knowledge with multi-level annotations, ensuring granular control and enhanced depth in article generation. To construct the dataset, a multi-agent collaborative pipeline is proposed, which systematically segments the generation process into four parts: Data Miner, Cite Retreiver, Q&A Annotator and Data Cleaner. To validate the effectiveness of DeFine, we designed and tested three LFAG baselines: the web retrieval, the local retrieval, and the grounded reference. We fine-tuned the Qwen2-7b-Instruct model using the DeFine training dataset. The experimental results showed significant improvements in text quality, specifically in topic coverage, depth of information, and content fidelity. Our dataset publicly available to facilitate future research. |
| title | DeFine: A Decomposed and Fine-Grained Annotated Dataset for Long-form Article Generation |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2503.07170 |