Imagen de Portada

SDA: Steering-Driven Distribution Alignment for Open LLMs without Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xia, Wei, Deng, Zhi-Hong
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Steering Out-of-Distribution Generalization with Concept Ablation Fine-Tuning
por: Casademunt, Helena, et al.
Publicado: (2025)

Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs
por: Liu, Danni, et al.
Publicado: (2025)

When Do LLMs Reason? A Dynamical Systems View via Entropy Phase Transitions
por: Xia, Wei, et al.
Publicado: (2026)

Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs
por: Goel, Raghavv, et al.
Publicado: (2024)

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation
por: Chen, Zihong, et al.
Publicado: (2025)

Re-Emergent Misalignment: How Narrow Fine-Tuning Erodes Safety Alignment in LLMs
por: Giordani, Jeremiah
Publicado: (2025)

NeuronTune: Fine-Grained Neuron Modulation for Balanced Safety-Utility Alignment in LLMs
por: Pan, Birong, et al.
Publicado: (2025)

Sparse but Critical: A Token-Level Analysis of Distributional Shifts in RLVR Fine-Tuning of LLMs
por: Meng, Haoming, et al.
Publicado: (2026)

Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic Forgetting
por: Hong, Yijie, et al.
Publicado: (2025)

GradPruner: Gradient-Guided Layer Pruning Enabling Efficient Fine-Tuning and Inference for LLMs
por: Huang, Wei, et al.
Publicado: (2026)

Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
por: Hua, Ermo, et al.
Publicado: (2024)

Scaling Data Diversity for Fine-Tuning Language Models in Human Alignment
por: Song, Feifan, et al.
Publicado: (2024)

On the Limitations of Steering in Language Model Alignment
por: Niranjan, Chebrolu, et al.
Publicado: (2025)

LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard
por: Rao, Varun, et al.
Publicado: (2025)

CoSToM:Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models
por: Li, Mengfan, et al.
Publicado: (2026)

Fine-Tuning LLMs for Reliable Medical Question-Answering Services
por: Anaissi, Ali, et al.
Publicado: (2024)

Step-On-Feet Tuning: Scaling Self-Alignment of LLMs via Bootstrapping
por: Wang, Haoyu, et al.
Publicado: (2024)

Fine-Tuning LLMs for Low-Resource Dialect Translation: The Case of Lebanese
por: Yakhni, Silvana, et al.
Publicado: (2025)

Supervised Fine-Tuning or In-Context Learning? Evaluating LLMs for Clinical NER
por: Baroian, Andrei
Publicado: (2025)

Question Answering on Patient Medical Records with Private Fine-Tuned LLMs
por: Kothari, Sara, et al.
Publicado: (2025)

TuCo: Measuring the Contribution of Fine-Tuning to Individual Responses of LLMs
por: Nuti, Felipe, et al.
Publicado: (2025)

Diffusion-Inspired Masked Fine-Tuning for Knowledge Injection in Autoregressive LLMs
por: Pan, Xu, et al.
Publicado: (2025)

Incivility and Rigidity: Evaluating the Risks of Fine-Tuning LLMs for Political Argumentation
por: Churina, Svetlana, et al.
Publicado: (2024)

60 Data Points are Sufficient to Fine-Tune LLMs for Question-Answering
por: Ye, Junjie, et al.
Publicado: (2024)

Aloe: A Family of Fine-tuned Open Healthcare LLMs
por: Gururajan, Ashwin Kumar, et al.
Publicado: (2024)

NEFMind: Parameter-Efficient Fine-Tuning of Open-Source LLMs for Telecom APIs Automation
por: Khan, Zainab, et al.
Publicado: (2025)

TACOS: Open Tagging and Comparative Scoring for Instruction Fine-Tuning Data Selection
por: He, Xixiang, et al.
Publicado: (2025)

Prompting and Fine-Tuning Open-Sourced Large Language Models for Stance Classification
por: Cruickshank, Iain J., et al.
Publicado: (2023)

Inference-time Alignment via Sparse Junction Steering
por: Hu, Runyi, et al.
Publicado: (2026)

Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
por: Li, Wu, et al.
Publicado: (2026)

A Comparative Analysis of Instruction Fine-Tuning LLMs for Financial Text Classification
por: Fatemi, Sorouralsadat, et al.
Publicado: (2024)

PAFT: Prompt-Agnostic Fine-Tuning
por: Wei, Chenxing, et al.
Publicado: (2025)

Hierarchical Alignment: Surgical Fine-Tuning via Functional Layer Specialization in Large Language Models
por: Zhang, Yukun, et al.
Publicado: (2025)

Psychological Steering in LLMs: An Evaluation of Effectiveness and Trustworthiness
por: Banayeeanzade, Amin, et al.
Publicado: (2025)

KV Cache Steering for Controlling Frozen LLMs
por: Belitsky, Max, et al.
Publicado: (2025)

Tuning LLMs with Contrastive Alignment Instructions for Machine Translation in Unseen, Low-resource Languages
por: Mao, Zhuoyuan, et al.
Publicado: (2024)

Rethinking Scale: The Efficacy of Fine-Tuned Open-Source LLMs in Large-Scale Reproducible Social Science Research
por: Carammia, Marcello, et al.
Publicado: (2024)

SafeSteer: Localized On-Policy Distillation for Efficient Safety Alignment
por: Li, Hao, et al.
Publicado: (2026)

Tradeoffs Between Alignment and Helpfulness in Language Models with Steering Methods
por: Wolf, Yotam, et al.
Publicado: (2024)

Teaching LLMs How to Learn with Contextual Fine-Tuning
por: Choi, Younwoo, et al.
Publicado: (2025)