Cover Image

The Fellowship of the LLMs: Multi-Model Workflows for Synthetic Preference Optimization Dataset Generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Arif, Samee, Farid, Sualeha, Azeemi, Abdul Hameed, Athar, Awais, Raza, Agha Ali
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

UQA: Corpus for Urdu Question Answering
by: Arif, Samee, et al.
Published: (2024)

Generalists vs. Specialists: Evaluating Large Language Models for Urdu
by: Arif, Samee, et al.
Published: (2024)

WER We Stand: Benchmarking Urdu ASR Models
by: Arif, Samee, et al.
Published: (2024)

With a Grain of SALT: Are LLMs Fair Across Social Dimensions?
by: Arif, Samee, et al.
Published: (2024)

Language Model-Driven Data Pruning Enables Efficient Active Learning
by: Azeemi, Abdul Hameed, et al.
Published: (2024)

To Label or Not to Label: Hybrid Active Learning for Neural Machine Translation
by: Azeemi, Abdul Hameed, et al.
Published: (2024)

Kahaani: A Multimodal Co-Creative Storytelling System
by: Arif, Samee, et al.
Published: (2024)

From Press to Pixels: Evolving Urdu Text Recognition
by: Arif, Samee, et al.
Published: (2025)

One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning
by: Farid, Sualeha, et al.
Published: (2025)

Scaling Truth: The Confidence Paradox in AI Fact-Checking
by: Qazi, Ihsan A., et al.
Published: (2025)

PakBBQ: A Culturally Adapted Bias Benchmark for QA
by: Hashmat, Abdullah, et al.
Published: (2025)

Meta-Thinking in LLMs via Multi-Agent Reinforcement Learning: A Survey
by: Bilal, Ahsan, et al.
Published: (2025)

LLMs-Healthcare : Current Applications and Challenges of Large Language Models in various Medical Specialties
by: Mumtaz, Ummara, et al.
Published: (2023)

FlowMind: Automatic Workflow Generation with LLMs
by: Zeng, Zhen, et al.
Published: (2024)

Can LLMs Capture Human Preferences?
by: Goli, Ali, et al.
Published: (2023)

Generating Planning Feedback for Open-Ended Programming Exercises with LLMs
by: Demirtaş, Mehmet Arif, et al.
Published: (2025)

Self-Boosting Large Language Models with Synthetic Preference Data
by: Dong, Qingxiu, et al.
Published: (2024)

Configurable Safety Tuning of Language Models with Synthetic Preference Data
by: Gallego, Victor
Published: (2024)

MPPO: Multi Pair-wise Preference Optimization for LLMs with Arbitrary Negative Samples
by: Xie, Shuo, et al.
Published: (2024)

Multi-Domain ABSA Conversation Dataset Generation via LLMs for Real-World Evaluation and Model Comparison
by: Pandit, Tejul, et al.
Published: (2025)

Synthetic Dialogue Dataset Generation using LLM Agents
by: Abdullin, Yelaman, et al.
Published: (2024)

Generating Synthetic Datasets for Few-shot Prompt Tuning
by: Guo, Xu, et al.
Published: (2024)

MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance
by: Peper, Joseph J., et al.
Published: (2025)

Personalizing LLMs with Binary Feedback: A Preference-Corrected Optimization Framework
by: Ma, Xilai, et al.
Published: (2026)

POPI: Personalizing LLMs via Optimized Natural Language Preference Inference
by: Chen, Yizhuo, et al.
Published: (2025)

Preference Packing: Efficient Preference Optimization for Large Language Models
by: Cho, Jaekyung
Published: (2026)

IndoPref: A Multi-Domain Pairwise Preference Dataset for Indonesian
by: Wiyono, Vanessa Rebecca, et al.
Published: (2025)

When Data is the Algorithm: A Systematic Study and Curation of Preference Optimization Datasets
by: Djuhera, Aladin, et al.
Published: (2025)

Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
by: Xu, Wanghan, et al.
Published: (2025)

Measuring Diversity in Synthetic Datasets
by: Zhu, Yuchang, et al.
Published: (2025)

Fact or Fiction? Can LLMs be Reliable Annotators for Political Truths?
by: Chatrath, Veronica, et al.
Published: (2024)

Preference Curriculum: LLMs Should Always Be Pretrained on Their Preferred Data
by: Zhang, Xuemiao, et al.
Published: (2025)

Configurable Preference Tuning with Rubric-Guided Synthetic Data
by: Gallego, Víctor
Published: (2025)

Multi-Preference Optimization: Generalizing DPO via Set-Level Contrasts
by: Gupta, Taneesh, et al.
Published: (2024)

IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization
by: Zhang, Xinghua, et al.
Published: (2024)

Multi-Document Grounded Multi-Turn Synthetic Dialog Generation
by: Lee, Young-Suk, et al.
Published: (2024)

Self-supervised Preference Optimization: Enhance Your Language Model with Preference Degree Awareness
by: Li, Jian, et al.
Published: (2024)

Lost-in-the-Middle in Long-Text Generation: Synthetic Dataset, Evaluation Framework, and Mitigation
by: Zhang, Junhao, et al.
Published: (2025)

Developing a Tutoring Dialog Dataset to Optimize LLMs for Educational Use
by: Fateen, Menna, et al.
Published: (2024)

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference
by: Ji, Jiaming, et al.
Published: (2024)