Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Weixiang, Sui, Xingyu, Hu, Yulin, Guo, Jiahe, Liu, Haixiao, Li, Biye, Zhao, Yanyan, Qin, Bing, Liu, Ting
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Comprehensive Post Safety Alignment of Large Language Models via Safety Patching
by: Zhao, Weixiang, et al.
Published: (2024)

OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents
by: Hu, Yulin, et al.
Published: (2026)

Lens: Rethinking Multilingual Enhancement for Large Language Models
by: Zhao, Weixiang, et al.
Published: (2024)

Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter
by: Zhao, Weixiang, et al.
Published: (2025)

TEA-Bench: A Systematic Benchmarking of Tool-enhanced Emotional Support Dialogue Agent
by: Sui, Xingyu, et al.
Published: (2026)

Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs
by: Zhao, Weixiang, et al.
Published: (2025)

Trade-offs in Large Reasoning Models: An Empirical Analysis of Deliberative and Adaptive Reasoning over Foundational Capabilities
by: Zhao, Weixiang, et al.
Published: (2025)

When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners
by: Zhao, Weixiang, et al.
Published: (2025)

AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak Defender
by: Zhao, Weixiang, et al.
Published: (2025)

MPO: Multilingual Safety Alignment via Reward Gap Optimization
by: Zhao, Weixiang, et al.
Published: (2025)

Rethinking Experience Utilization in Self-Evolving Language Model Agents
by: Zhao, Weixiang, et al.
Published: (2026)

Exploring and Exploiting the Inherent Efficiency within Large Reasoning Models for Self-Guided Efficiency Enhancement
by: Zhao, Weixiang, et al.
Published: (2025)

Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence
by: Zhao, Weixiang, et al.
Published: (2024)

When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents
by: Guo, Jiahe, et al.
Published: (2026)

Large Language Model Agents Are Not Always Faithful Self-Evolvers
by: Zhao, Weixiang, et al.
Published: (2026)

SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models
by: Zhao, Weixiang, et al.
Published: (2024)

On Safety Risks in Experience-Driven Self-Evolving Agents
by: Zhao, Weixiang, et al.
Published: (2026)

Separate the Wheat from the Chaff: A Post-Hoc Approach to Safety Re-Alignment for Fine-Tuned Language Models
by: Wu, Di, et al.
Published: (2024)

ENPMR-Bench: Benchmarking Proactive Memory Retrieval for Emotional Support Agents
by: Fu, Xing, et al.
Published: (2026)

RKLD: Reverse KL-Divergence-based Knowledge Distillation for Unlearning Personal Information in Large Language Models
by: Wang, Bichen, et al.
Published: (2024)

How Does Sequence Modeling Architecture Influence Base Capabilities of Pre-trained Language Models? Exploring Key Architecture Design Principles to Avoid Base Capabilities Degradation
by: Lu, Xin, et al.
Published: (2025)

ConflictBench: Evaluating Human-AI Conflict via Interactive and Visually Grounded Environments
by: Zhao, Weixiang, et al.
Published: (2026)

Improving the Downstream Performance of Mixture-of-Experts Transformers via Weak Vanilla Transformers
by: Lu, Xin, et al.
Published: (2024)

Elo-Evolve: A Co-evolutionary Framework for Language Model Alignment
by: Zhao, Jing, et al.
Published: (2026)

DeepSight: Bridging Depth Maps and Language with a Depth-Driven Multimodal Model
by: Yang, Hao, et al.
Published: (2026)

Learning to Learn from Multimodal Experience
by: Sui, Xingyu, et al.
Published: (2026)

STAR-S: Improving Safety Alignment through Self-Taught Reasoning on Safety Rules
by: Wu, Di, et al.
Published: (2026)

MUSE: Multi-Domain Chinese User Simulation via Self-Evolving Profiles and Rubric-Guided Alignment
by: Liu, Zihao, et al.
Published: (2026)

Understanding the Role of User Profile in the Personalization of Large Language Models
by: Wu, Bin, et al.
Published: (2024)

Self-Evolving GPT: A Lifelong Autonomous Experiential Learner
by: Gao, Jinglong, et al.
Published: (2024)

Evolving Knowledge Distillation for Lightweight Neural Machine Translation
by: Zhang, Xuewen, et al.
Published: (2026)

How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers
by: Lu, Xin, et al.
Published: (2024)

Simulating Before Planning: Constructing Intrinsic User World Model for User-Tailored Dialogue Policy Planning
by: He, Tao, et al.
Published: (2025)

FedPDPO: Federated Personalized Direct Preference Optimization for Large Language Model Alignment
by: Zhu, Kewen, et al.
Published: (2026)

ControlLM: Crafting Diverse Personalities for Language Models
by: Weng, Yixuan, et al.
Published: (2024)

Inside Out: Evolving User-Centric Core Memory Trees for Long-Term Personalized Dialogue Systems
by: Zhao, Jihao, et al.
Published: (2026)

AS-ES Learning: Towards Efficient CoT Learning in Small Models
by: Xi, Nuwa, et al.
Published: (2024)

Personality Alignment of Large Language Models
by: Zhu, Minjun, et al.
Published: (2024)

Data Uncertainty-Aware Learning for Multimodal Aspect-based Sentiment Analysis
by: Yang, Hao, et al.
Published: (2024)

Evolving Knowledge Distillation with Large Language Models and Active Learning
by: Liu, Chengyuan, et al.
Published: (2024)