Cover Image

Toward Preference-aligned Large Language Models via Residual-based Model Steering

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	La Cava, Lucio, Tagarelli, Andrea
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Computers and Society Machine Learning Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Bringing order into the realm of Transformer-based language models for artificial intelligence and law
by: Greco, Candida M., et al.
Published: (2023)

Open Models, Closed Minds? On Agents Capabilities in Mimicking Human Personalities through Open Large Language Models
by: La Cava, Lucio, et al.
Published: (2024)

MAR: Efficient Large Language Models via Module-aware Architecture Refinement
by: Cai, Junhong, et al.
Published: (2026)

LLM-SR: Scientific Equation Discovery via Programming with Large Language Models
by: Shojaee, Parshin, et al.
Published: (2024)

Hyperbolic Fine-Tuning for Large Language Models
by: Yang, Menglin, et al.
Published: (2024)

EvoMerge: Neuroevolution for Large Language Models
by: Jiang, Yushu
Published: (2024)

H-Node Attack and Defense in Large Language Models
by: Yocam, Eric, et al.
Published: (2026)

Large Language Models and Emergence: A Complex Systems Perspective
by: Krakauer, David C., et al.
Published: (2025)

Fleet of Agents: Coordinated Problem Solving with Large Language Models
by: Klein, Lars, et al.
Published: (2024)

Assessing the Emergent Symbolic Reasoning Abilities of Llama Large Language Models
by: Petruzzellis, Flavio, et al.
Published: (2024)

OpenTuringBench: An Open-Model-based Benchmark and Framework for Machine-Generated Text Detection and Attribution
by: La Cava, Lucio, et al.
Published: (2025)

Evolutionary Multi-Objective Optimization of Large Language Model Prompts for Balancing Sentiments
by: Baumann, Jill, et al.
Published: (2024)

When Large Language Models Meet Evolutionary Algorithms: Potential Enhancements and Challenges
by: Wang, Chao, et al.
Published: (2024)

Fine-Tuning and Evaluating Open-Source Large Language Models for the Army Domain
by: Ruiz, Daniel C., et al.
Published: (2024)

Evaluating Large Language Models with Grid-Based Game Competitions: An Extensible LLM Benchmark and Leaderboard
by: Topsakal, Oguzhan, et al.
Published: (2024)

Luminol-AIDetect: Fast Zero-shot Machine-Generated Text Detection based on Perplexity under Text Shuffling
by: La Cava, Lucio, et al.
Published: (2026)

Recent Advances in Federated Learning Driven Large Language Models: A Survey on Architecture, Performance, and Security
by: Qu, Youyang, et al.
Published: (2024)

Diffusion Language Models for Speech Recognition
by: Naveriani, Davyd, et al.
Published: (2026)

Elastic Architecture Search for Efficient Language Models
by: Wang, Shang
Published: (2025)

Solve the Loop: Attractor Models for Language and Reasoning
by: Fein-Ashley, Jacob, et al.
Published: (2026)

W-PCA Based Gradient-Free Proxy for Efficient Search of Lightweight Language Models
by: Wang, Shang
Published: (2025)

Language Models Learn Universal Representations of Numbers and Here's Why You Should Care
by: Štefánik, Michal, et al.
Published: (2025)

Towards Explainable Evolution Strategies with Large Language Models
by: Baumann, Jill, et al.
Published: (2024)

Culturally Grounded Personas in Large Language Models: Characterization and Alignment with Socio-Psychological Value Frameworks
by: Greco, Candida M., et al.
Published: (2026)

Mitigating Unfairness via Evolutionary Multi-objective Ensemble Learning
by: Zhang, Qingquan, et al.
Published: (2022)

Topic Modelling Black Box Optimization
by: Akramov, Roman, et al.
Published: (2025)

RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models
by: Hussien, Mohamed Manzour, et al.
Published: (2024)

Talking the Talk Does Not Entail Walking the Walk: On the Limits of Large Language Models in Lexical Entailment Recognition
by: Greco, Candida M., et al.
Published: (2024)

Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings
by: Tan, Rong-Xi, et al.
Published: (2025)

Jailbreaking LLMs' Safeguard with Universal Magic Words for Text Embedding Models
by: Liang, Haoyu, et al.
Published: (2025)

Accelerating Training Speed of Tiny Recursive Models with Curriculum Guided Adaptive Recursion
by: Qasim, Kaleem Ullah, et al.
Published: (2025)

Large Language Models As Evolution Strategies
by: Lange, Robert Tjarko, et al.
Published: (2024)

Agent Skill Acquisition for Large Language Models via CycleQD
by: Kuroki, So, et al.
Published: (2024)

A Gauge Theory of Superposition: Toward a Sheaf-Theoretic Atlas of Neural Representations
by: Javidnia, Hossein
Published: (2026)

A Transformer-based Neural Architecture Search Method
by: Wang, Shang, et al.
Published: (2025)

EvoGPT-f: An Evolutionary GPT Framework for Benchmarking Formal Math Languages
by: Mercer, Johnathan
Published: (2024)

Interlocking-free Selective Rationalization Through Genetic-based Learning
by: Ruggeri, Federico, et al.
Published: (2024)

BlackDAN: A Black-Box Multi-Objective Approach for Effective and Contextual Jailbreaking of Large Language Models
by: Wang, Xinyuan, et al.
Published: (2024)

LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimization
by: Nasir, Muhammad U., et al.
Published: (2023)

NNGPT: Rethinking AutoML with Large Language Models
by: Kochnev, Roman, et al.
Published: (2025)