Icon$^{2}$: Aligning Large Language Models Using Self-Synthetic Preference Data via Inherent Regulation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Qiyuan, Huang, Hongsen, Shao, Qian, Chen, Jiahe, Chen, Jintai, Xu, Hongxia, Hua, Renjie, Chuan, Ren, Wu, Jian
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning What Matters: Dynamic Dimension Selection and Aggregation for Interpretable Vision-Language Reward Modeling
by: Chen, Qiyuan, et al.
Published: (2026)

CC-GSEO-Bench: A Content-Centric Benchmark for Measuring Source Influence in Generative Search Engines
by: Chen, Qiyuan, et al.
Published: (2025)

Curing Semantic Drift: A Dynamic Approach to Grounding Generation in Large Vision-Language Models
by: Chen, Jiahe, et al.
Published: (2025)

MM-DADM: Multimodal Drug-Aware Diffusion Model for Virtual Clinical Trials
by: Shao, Qian, et al.
Published: (2025)

Mind's Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models
by: Liu, Weize, et al.
Published: (2023)

Towards Clinical Practice in CT-Based Pulmonary Disease Screening: An Efficient and Reliable Framework
by: Shao, Qian, et al.
Published: (2024)

Dynamic Noise Preference Optimization: Self-Improvement of Large Language Models with Self-Synthetic Data
by: Yang, Haoyan, et al.
Published: (2025)

Cross-Table Pretraining towards a Universal Function Space for Heterogeneous Tabular Data
by: Chen, Jintai, et al.
Published: (2024)

Aligning Large Language Models via Fully Self-Synthetic Data
by: Yin, Shangjian, et al.
Published: (2025)

ExcelFormer: A neural network surpassing GBDTs on tabular data
by: Chen, Jintai, et al.
Published: (2023)

Self-Boosting Large Language Models with Synthetic Preference Data
by: Dong, Qingxiu, et al.
Published: (2024)

Multi-rater Prompting for Ambiguous Medical Image Segmentation
by: Wang, Jinhong, et al.
Published: (2024)

LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation
by: Wang, Jinhong, et al.
Published: (2024)

Med-Scout: Curing MLLMs' Geometric Blindness in Medical Perception via Geometry-Aware RL Post-Training
by: Liu, Anglin, et al.
Published: (2026)

Safer-Instruct: Aligning Language Models with Automated Preference Data
by: Shi, Taiwei, et al.
Published: (2023)

Aligning Large Language Models with Searcher Preferences
by: Wu, Wei, et al.
Published: (2026)

TeleOR: Real-time Telemedicine System for Full-Scene Operating Room
by: Wu, Yixuan, et al.
Published: (2024)

Making Pre-trained Language Models Great on Tabular Prediction
by: Yan, Jiahuan, et al.
Published: (2024)

Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications
by: Liu, Weize, et al.
Published: (2024)

Enhancing Semi-Supervised Learning via Representative and Diverse Sample Selection
by: Shao, Qian, et al.
Published: (2024)

A New Synthetic Route to Daidzein
by: Jian Huang, et al.
Published: (2026)

Efficient Response Generation Strategy Selection for Fine-Tuning Large Language Models Through Self-Aligned Perplexity
by: Ren, Xuan, et al.
Published: (2025)

AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender
by: Zhao, Weixiang, et al.
Published: (2025)

Synth-Align: Improving Trustworthiness in Vision-Language Model with Synthetic Preference Data Alignment
by: Wijaya, Robert, et al.
Published: (2024)

ClinicalAgent: Clinical Trial Multi-Agent System with Large Language Model-based Reasoning
by: Yue, Ling, et al.
Published: (2024)

TrialEnroll: Predicting Clinical Trial Enrollment Success with Deep & Cross Network and Large Language Models
by: Yue, Ling, et al.
Published: (2024)

Synthetically Trained Icon Proposals for Parsing and Summarizing Infographics
by: Madan, Spandan, et al.
Published: (2018)

Utilizing Training Data to Improve LLM Reasoning for Tabular Understanding
by: Gao, Chufan, et al.
Published: (2025)

Enhancing Health Fact-Checking with LLM-Generated Synthetic Data
by: Zhang, Jingze, et al.
Published: (2025)

CodecLM: Aligning Language Models with Tailored Synthetic Data
by: Wang, Zifeng, et al.
Published: (2024)

Course-Correction: Safety Alignment Using Synthetic Preferences
by: Xu, Rongwu, et al.
Published: (2024)

STORM: Benchmarking Visual Rating of MLLMs with a Comprehensive Ordinal Regression Dataset
by: Wang, Jinhong, et al.
Published: (2025)

SecAlign: Defending Against Prompt Injection with Preference Optimization
by: Chen, Sizhe, et al.
Published: (2024)

Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities
by: Lin, Zheng, et al.
Published: (2023)

Beyond In-Context Learning: Aligning Long-form Generation of Large Language Models via Task-Inherent Attribute Guidelines
by: Long, Do Xuan, et al.
Published: (2025)

Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement
by: Zhao, Weixiang, et al.
Published: (2025)

Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representations
by: Zhu, Jian-Qiao, et al.
Published: (2025)

Efficient Safety Alignment of Large Language Models via Preference Re-ranking and Representation-based Reward Modeling
by: Deng, Qiyuan, et al.
Published: (2025)

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data
by: Li, Haolong, et al.
Published: (2024)

MetaAlign: Align Large Language Models with Diverse Preferences during Inference Time
by: Zhang, Mozhi, et al.
Published: (2024)