Cover Image

Align Anything: Training All-Modality Models to Follow Instructions with Language Feedback

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ji, Jiaming, Zhou, Jiayi, Lou, Hantao, Chen, Boyuan, Hong, Donghai, Wang, Xuyao, Chen, Wenqi, Wang, Kaile, Pan, Rui, Li, Jiahao, Wang, Mohan, Dai, Josef, Qiu, Tianyi, Xu, Hua, Li, Dong, Chen, Weipeng, Song, Jun, Zheng, Bo, Yang, Yaodong
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Stream Aligner: Efficient Sentence-Level Alignment via Distribution Induction
by: Lou, Hantao, et al.
Published: (2025)

InterMT: Multi-Turn Interleaved Preference Alignment with Human Feedback
by: Chen, Boyuan, et al.
Published: (2025)

Language Models Resist Alignment: Evidence From Data Compression
by: Ji, Jiaming, et al.
Published: (2024)

Debate with Images: Detecting Deceptive Behaviors in Multimodal Large Language Models
by: Fang, Sitong, et al.
Published: (2025)

Mitigating Deceptive Alignment via Self-Monitoring
by: Ji, Jiaming, et al.
Published: (2025)

Aligner: Efficient Alignment by Learning to Correct
by: Ji, Jiaming, et al.
Published: (2024)

Safe RLHF-V: Safe Reinforcement Learning from Multi-modal Human Feedback
by: Ji, Jiaming, et al.
Published: (2025)

Generative RLHF-V: Learning Principles from Multi-modal Human Preference
by: Zhou, Jiayi, et al.
Published: (2025)

PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference
by: Ji, Jiaming, et al.
Published: (2024)

SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset
by: Dai, Josef, et al.
Published: (2024)

SAE-V: Interpreting Multimodal Models for Enhanced Alignment
by: Lou, Hantao, et al.
Published: (2025)

Reward Generalization in RLHF: A Topological Perspective
by: Qiu, Tianyi, et al.
Published: (2024)

FormalJudge: A Neuro-Symbolic Paradigm for Agentic Oversight
by: Zhou, Jiayi, et al.
Published: (2026)

Sequence to Sequence Reward Modeling: Improving RLHF by Language Feedback
by: Zhou, Jiayi, et al.
Published: (2024)

OneLLM: One Framework to Align All Modalities with Language
by: Han, Jiaming, et al.
Published: (2023)

When Slower Isn't Truer: Inverse Scaling Law of Truthfulness in Multimodal Reasoning
by: Fang, Sitong, et al.
Published: (2025)

AI Alignment: A Comprehensive Survey
by: Ji, Jiaming, et al.
Published: (2023)

AlignVSR: Audio-Visual Cross-Modal Alignment for Visual Speech Recognition
by: Liu, Zehua, et al.
Published: (2024)

Large dimensional Spearman's rank correlation matrices: The central limit theorem and its applications
by: Chen, Hantao, et al.
Published: (2024)

Spectral analysis of spatial-sign covariance matrices for heavy-tailed data with dependence
by: Chen, Hantao, et al.
Published: (2025)

Instruction Embedding: Latent Representations of Instructions Towards Task Identification
by: Li, Yiwei, et al.
Published: (2024)

All‐Optical Physical Field Recognition Via Sparse Feature Extraction
by: Haotong Qi, et al.
Published: (2024)

Matcher: Segment Anything with One Shot Using All-Purpose Feature Matching
by: Liu, Yang, et al.
Published: (2023)

MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Models
by: Yang, Tianzhuo, et al.
Published: (2026)

CursorCore: Assist Programming through Aligning Anything
by: Jiang, Hao, et al.
Published: (2024)

CDF-Glove: A Cable-Driven Force Feedback Glove for Dexterous Teleoperation
by: Liang, Huayue, et al.
Published: (2026)

AlignFormer: Modality Matching Can Achieve Better Zero-shot Instruction-Following Speech-LLM
by: Fan, Ruchao, et al.
Published: (2024)

Unsegment Anything by Simulating Deformation
by: Lu, Jiahao, et al.
Published: (2024)

Meeseeks: A Feedback-Driven, Iterative Self-Correction Benchmark evaluating LLMs' Instruction Following Capability
by: wang, Jiaming, et al.
Published: (2025)

Judge Anything: MLLM as a Judge Across Any Modality
by: Pu, Shu, et al.
Published: (2025)

Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering
by: Si, Shuzheng, et al.
Published: (2025)

Dual-Modality Computational Ophthalmic Imaging with Deep Learning and Coaxial Optical Design
by: Peng, Boyuan, et al.
Published: (2025)

Q2A: Querying Implicit Fully Continuous Feature Pyramid to Align Features for Medical Image Segmentation
by: Yu, Jiahao, et al.
Published: (2024)

RAG-Anything: All-in-One RAG Framework
by: Guo, Zirui, et al.
Published: (2025)

GENMANIP: LLM-driven Simulation for Generalizable Instruction-Following Manipulation
by: Gao, Ning, et al.
Published: (2025)

Pref-GUIDE: Continual Policy Learning from Real-Time Human Feedback via Preference-Based Learning
by: Ji, Zhengran, et al.
Published: (2025)

SAM3-I: Segment Anything with Instructions
by: Li, Jingjing, et al.
Published: (2025)

Toward Zero-Shot Instruction Following
by: Lou, Renze, et al.
Published: (2023)

EchoMimicV3: 1.3B Parameters are All You Need for Unified Multi-Modal and Multi-Task Human Animation
by: Meng, Rang, et al.
Published: (2025)

InteractAnything: Zero-shot Human Object Interaction Synthesis via LLM Feedback and Object Affordance Parsing
by: Zhang, Jinlu, et al.
Published: (2025)