Cover Image

UNA: A Unified Supervised Framework for Efficient LLM Alignment Across Feedback Types

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Zhichao, Bi, Bin, Huang, Can, Pentyala, Shiva Kumar, Zhu, Zixu James, Asur, Sitaram, Cheng, Na Claire, Wan, Cheng, Nie, Dong, Hong, Lingzi
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PAFT: A Parallel Training Paradigm for Effective LLM Fine-Tuning
by: Pentyala, Shiva Kumar, et al.
Published: (2024)

Reinforcement Learning for LLM Post-Training: A Survey
by: Wang, Zhichao, et al.
Published: (2024)

Diversity Enhances an LLM's Performance in RAG and Long-context Task
by: Wang, Zhichao, et al.
Published: (2025)

UFT: Unifying Fine-Tuning of SFT and RLHF/DPO/UNA through a Generalized Implicit Reward Function
by: Wang, Zhichao, et al.
Published: (2024)

Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language Models
by: Hsu, Aliyah R., et al.
Published: (2024)

Review of Inference-Time Scaling Strategies: Reasoning, Search and RAG
by: Wang, Zhichao, et al.
Published: (2025)

FeedbackLLM: Metadata driven Multi-Agentic Language Agnostic Test Case Generator with Evolving prompt and Coverage Feedback
by: Jasti, Kushal, et al.
Published: (2026)

The Importance of Directional Feedback for LLM-based Optimizers
by: Nie, Allen, et al.
Published: (2024)

Mutation invariants of cluster algebras of rank 2
by: Chen, Zhichao, et al.
Published: (2024)

A cluster theory approach from mutation invariants to Diophantine equations
by: Chen, Zhichao, et al.
Published: (2025)

Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agents
by: Choubey, Prafulla Kumar, et al.
Published: (2025)

CultureLLM: Incorporating Cultural Differences into Large Language Models
by: Li, Cheng, et al.
Published: (2024)

M5 -- A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks
by: Schneider, Florian, et al.
Published: (2024)

DxHF: Providing High-Quality Human Feedback for LLM Alignment via Interactive Decomposition
by: Shi, Danqing, et al.
Published: (2025)

Toward measuring data literacy for higher education: Developing and validating a data literacy self‐efficacy scale
by: Jeonghyun Kim, et al.
Published: (2024)

A multi-phase-field model for fiber-reinforced composite laminates based on puck failure theory
by: Kumar, Pavan Kumar Asur Vijaya, et al.
Published: (2026)

Q-realign: Piggybacking Realignment on Quantization for Safe and Efficient LLM Deployment
by: Tan, Qitao, et al.
Published: (2026)

A Unified Framework and Dataset for Assessing Societal Bias in Vision-Language Models
by: Sathe, Ashutosh, et al.
Published: (2024)

Trace is the Next AutoDiff: Generative Optimization with Rich Feedback, Execution Traces, and LLMs
by: Cheng, Ching-An, et al.
Published: (2024)

TCMA: Text-Conditioned Multi-granularity Alignment for Drone Cross-Modal Text-Video Retrieval
by: Zhao, Zixu, et al.
Published: (2025)

Feedback-Driven Vision-Language Alignment with Minimal Human Supervision
by: Giannone, Giorgio, et al.
Published: (2025)

INT: Instance-Specific Negative Mining for Task-Generic Promptable Segmentation
by: Hu, Jian, et al.
Published: (2025)

Grounding Video Reasoning in Physical Signals
by: Osmanli, Alibay, et al.
Published: (2026)

Multifeature Fusion for Enhanced Content‐Based Image Retrieval Across Diverse Data Types
by: Punit Soni, et al.
Published: (2025)

RLTHF: Targeted Human Feedback for LLM Alignment
by: Xu, Yifei, et al.
Published: (2025)

Fluent but Foreign: Even Regional LLMs Lack Cultural Alignment
by: Agarwal, Dhruv, et al.
Published: (2025)

ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment
by: Hu, Xiwei, et al.
Published: (2024)

Bayesimax Theory: Selecting Priors by Minimizing Total Information
by: Vangala, Sitaram
Published: (2025)

Unified Emergence of Gauge Symmetries and Quantum Phenomena from Volume-Preserving Dynamics in the Golden-Rhombohedral Vacuum
by: Meucci, Shiva
Published: (2025)

Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning
by: Pang, Jinlong, et al.
Published: (2025)

Unified Mechanical Erosion Model for Multi-phase Mass Flows
by: Pudasaini, Shiva P.
Published: (2022)

Fresnel's Mechanical Legacy Recovered: How Bubble Acoustics Unifies Partial Drag, Velocity Addition, and Atomic Polarization
by: Meucci, Shiva
Published: (2025)

Uniform volume estimates and maximal functions on generalized Heisenberg-type groups
by: Bi, Cheng, et al.
Published: (2026)

MuFFIN: Multifaceted Pronunciation Feedback Model with Interactive Hierarchical Neural Modeling
by: Yan, Bi-Cheng, et al.
Published: (2025)

Synergistic Effects of Knowledge Distillation and Structured Pruning for Self-Supervised Speech Models
by: C, Shiva Kumar, et al.
Published: (2025)

Incremental Summarization for Customer Support via Progressive Note-Taking and Agent Feedback
by: Wu, Yisha, et al.
Published: (2025)

EnchTable: Unified Safety Alignment Transfer in Fine-tuned Large Language Models
by: Wu, Jialin, et al.
Published: (2025)

Autotransplantation of a Third Molar to Replace Compromised Molar With the Individual Three‐Dimensional Printed Ultrasonic Osteotome: A Case Report
by: Cheng Bi, et al.
Published: (2025)

Conformal Feedback Alignment: Quantifying Answer-Level Reliability for Robust LLM Alignment
by: Chen, Tiejin, et al.
Published: (2026)

Self-Supervised Alignment Learning for Medical Image Segmentation
by: Li, Haofeng, et al.
Published: (2024)