Imagen de Portada

SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignment

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhu, Wenqiao, Liu, Ji, Wang, Lulu, Wu, Jun, Zhang, Yulun
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Backpropagation-Free Multi-modal On-Device Model Adaptation via Cloud-Device Collaboration
por: Ji, Wei, et al.
Publicado: (2024)

Federated Variational Preference Alignment with Gumbel-Softmax Prior for Personalized User Preferences
por: Koo, Jabin, et al.
Publicado: (2026)

From Coordinate Matching to Structural Alignment: Rethinking Prototype Alignment in Heterogeneous Federated Learning
por: Wu, Xinghao, et al.
Publicado: (2026)

CG-FedLLM: How to Compress Gradients in Federated Fune-tuning for Large Language Models
por: Wu, Huiwen, et al.
Publicado: (2024)

Gradient Correction in Federated Learning with Adaptive Optimization
por: Chen, Evan, et al.
Publicado: (2025)

Beyond Aggregation: Guiding Clients in Heterogeneous Federated Learning
por: Wang, Zijian, et al.
Publicado: (2025)

PIPO: Pipelined Offloading for Efficient Inference on Consumer Devices
por: Liu, Yangyijian, et al.
Publicado: (2025)

Efficient Onboard Vision-Language Inference in UAV-Enabled Low-Altitude Economy Networks via LLM-Enhanced Optimization
por: Li, Yang, et al.
Publicado: (2025)

Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey
por: Liu, Jing, et al.
Publicado: (2025)

Federated Graph Learning with Structure Proxy Alignment
por: Fu, Xingbo, et al.
Publicado: (2024)

HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
por: Lin, Zheng, et al.
Publicado: (2025)

A Survey on Inference Optimization Techniques for Mixture of Experts Models
por: Liu, Jiacheng, et al.
Publicado: (2024)

EdgeRL: Reinforcement Learning-driven Deep Learning Model Inference Optimization at Edge
por: Mounesan, Motahare, et al.
Publicado: (2024)

When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions
por: Zhuang, Weiming, et al.
Publicado: (2023)

POPri: Private Federated Learning using Preference-Optimized Synthetic Data
por: Hou, Charlie, et al.
Publicado: (2025)

Efficient Federated Fine-Tuning of Large Language Models with Layer Dropout
por: Wang, Shilong, et al.
Publicado: (2025)

FedTrans: Efficient Federated Learning via Multi-Model Transformation
por: Zhu, Yuxuan, et al.
Publicado: (2024)

Enhancing Large-Scale AI Training Efficiency: The C4 Solution for Real-Time Anomaly Detection and Communication Optimization
por: Dong, Jianbo, et al.
Publicado: (2024)

Application of Machine Learning Optimization in Cloud Computing Resource Scheduling and Management
por: Zhang, Yifan, et al.
Publicado: (2024)

Deploying Atmospheric and Oceanic AI Models on Chinese Hardware and Framework: Migration Strategies, Performance Optimization and Analysis
por: Sun, Yuze, et al.
Publicado: (2025)

Galvatron: An Automatic Distributed System for Efficient Foundation Model Training
por: Liu, Xinyi, et al.
Publicado: (2025)

Leyline: KV Cache Directives for Agentic Inference
por: Ma, Bole, et al.
Publicado: (2026)

Cloud Atlas: Efficient Fault Localization for Cloud Systems using Language Models and Causal Insight
por: Xie, Zhiqiang, et al.
Publicado: (2024)

When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devices
por: Zhang, Pengyu, et al.
Publicado: (2024)

The Future of Large Language Model Pre-training is Federated
por: Sani, Lorenzo, et al.
Publicado: (2024)

SATER: A Self-Aware and Token-Efficient Approach to Routing and Cascading
por: Shen, Yuanzhe, et al.
Publicado: (2025)

Echo: Efficient Co-Scheduling of Hybrid Online-Offline Tasks for Large Language Model Serving
por: Wang, Zhibin, et al.
Publicado: (2025)

Enhancing Trust and Privacy in Distributed Networks: A Comprehensive Survey on Blockchain-based Federated Learning
por: Liu, Ji, et al.
Publicado: (2024)

Systematic Optimization of Real-Time Diffusion Model Inference on Apple M3 Ultra
por: Ochiai, Yoichi
Publicado: (2026)

Towards One-shot Federated Learning: Advances, Challenges, and Future Directions
por: Amato, Flora, et al.
Publicado: (2025)

A Survey of Resource-efficient LLM and Multimodal Foundation Models
por: Xu, Mengwei, et al.
Publicado: (2024)

AIConfigurator: Lightning-Fast Configuration Optimization for Multi-Framework LLM Serving
por: Xu, Tianhao, et al.
Publicado: (2026)

Scalable Pretraining of Large Mixture of Experts Language Models on Aurora Super Computer
por: Vooturi, Dharma Teja, et al.
Publicado: (2026)

SPD: Sync-Point Drop for Efficient Tensor Parallelism of Large Language Models
por: Kim, Han-Byul, et al.
Publicado: (2025)

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer
por: Yao, Jinghan, et al.
Publicado: (2024)

Efficient Federated Learning Using Dynamic Update and Adaptive Pruning with Momentum on Shared Server Data
por: Liu, Ji, et al.
Publicado: (2024)

Online Parallel Multi-Task Relationship Learning via Alternating Direction Method of Multipliers
por: Li, Ruiyu, et al.
Publicado: (2024)

Learn How to Query from Unlabeled Data Streams in Federated Learning
por: Sun, Yuchang, et al.
Publicado: (2024)

Efficient Serving of LLM Applications with Probabilistic Demand Modeling
por: Liu, Yifei, et al.
Publicado: (2025)

SFPrompt: Communication-Efficient Split Federated Fine-Tuning for Large Pre-Trained Models over Resource-Limited Devices
por: Cao, Linxiao, et al.
Publicado: (2024)