Cover Image

When Policy Entropy Constraint Fails: Preserving Diversity in Flow-based RLHF via Perceptual Entropy

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tan, Xiaofeng, Liu, Jun, Gao, Bin-Bin, Fan, Yuanting, Jiang, Xi, Wang, Chengjie, Wang, Hongsong, Zheng, Feng
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ConsistentRFT: Reducing Visual Hallucinations in Flow-based Reinforcement Fine-Tuning
by: Tan, Xiaofeng, et al.
Published: (2026)

FedRLHF: A Convergence-Guaranteed Federated Framework for Privacy-Preserving and Personalized RLHF
by: Fan, Flint Xiaofeng, et al.
Published: (2024)

Flow Matching Policy Optimization with Mirror Descent and Entropy Constraints
by: Gao, Ting, et al.
Published: (2026)

Towards Fine-Grained Vision-Language Alignment for Few-Shot Anomaly Detection
by: Fan, Yuanting, et al.
Published: (2025)

Large-Scale Universal Defect Generation: Foundation Models and Datasets
by: Fan, Yuanting, et al.
Published: (2026)

One Language-Free Foundation Model Is Enough for Universal Vision Anomaly Detection
by: Gao, Bin-Bin, et al.
Published: (2026)

When Maximum Entropy Misleads Policy Optimization
by: Zhang, Ruipeng, et al.
Published: (2025)

Failure Modes of Maximum Entropy RLHF
by: Çağatan, Ömer Veysel, et al.
Published: (2025)

SoftPatch+: Fully Unsupervised Anomaly Classification and Segmentation
by: Wang, Chengjie, et al.
Published: (2024)

Why Semantic Entropy Fails: Geometry-Aware and Calibrated Uncertainty for Policy Optimization
by: Zhang, Zheyuan, et al.
Published: (2026)

Entropy-Based Evidence for Bitcoin's Discrete Time Mechanism
by: Chen, Bin, et al.
Published: (2025)

SoftPatch: Unsupervised Anomaly Detection with Noisy Data
by: Jiang, Xi, et al.
Published: (2024)

Geometric Entropies and their Hamiltonian Flows
by: Dong, Xi, et al.
Published: (2025)

Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection
by: Tan, Xiaofeng, et al.
Published: (2024)

Understanding and Preventing Entropy Collapse in RLVR with On-Policy Entropy Flow Optimization
by: Xu, Huimin, et al.
Published: (2026)

AD-Copilot: A Vision-Language Assistant for Industrial Anomaly Detection via Visual In-context Comparison
by: Jiang, Xi, et al.
Published: (2026)

EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation
by: Tan, Xiaofeng, et al.
Published: (2026)

SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimization
by: Tan, Xiaofeng, et al.
Published: (2024)

ReAlign: Bilingual Text-to-Motion Generation via Step-Aware Reward-Guided Alignment
by: Weng, Wanjiang, et al.
Published: (2025)

MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection
by: Jiang, Xi, et al.
Published: (2024)

Few-Shot Anomaly-Driven Generation for Anomaly Classification and Segmentation
by: Gui, Guan, et al.
Published: (2025)

EGSS: Entropy-guided Stepwise Scaling for Reliable Software Engineering
by: Mao, Chenhui, et al.
Published: (2026)

Decoupling Classifier for Boosting Few-shot Object Detection and Instance Segmentation
by: Gao, Bin-Bin, et al.
Published: (2025)

Rational A‐Site Entropy Engineering in Perovskites: Dual‐Exchange Enhanced Magnetoelectric Coupling for Ultra‐Efficient Microwave Absorption
by: Mengru Li, et al.
Published: (2025)

Maximum Entropy Reinforcement Learning with Diffusion Policy
by: Dong, Xiaoyi, et al.
Published: (2025)

GTPO and GRPO-S: Token and Sequence-Level Reward Shaping with Policy Entropy
by: Tan, Hongze, et al.
Published: (2025)

Study on Rényi Entropy, Tsallis Entropy, and Onicescu Information Energy of a Particle in a Quantum Well with a Uniform Electric Field
by: De‐hua Wang, et al.
Published: (2026)

Improving Diversity in Language Models: When Temperature Fails, Change the Loss
by: Verine, Alexandre, et al.
Published: (2025)

Enhancing Multi-Class Anomaly Detection via Diffusion Refinement with Dual Conditioning
by: Zhan, Jiawei, et al.
Published: (2024)

Entropy-Preserving Reinforcement Learning
by: Petrenko, Aleksei, et al.
Published: (2026)

Entropy‐Mediated Crystallization Manipulation in Glass
by: Xu Feng, et al.
Published: (2024)

OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework
by: Hu, Jian, et al.
Published: (2024)

EntropyStop: Unsupervised Deep Outlier Detection with Loss Entropy
by: Huang, Yihong, et al.
Published: (2024)

Boosting Maximum Entropy Reinforcement Learning via One-Step Flow Matching
by: Li, Zeqiao, et al.
Published: (2026)

MLIC: Multi-Reference Entropy Model for Learned Image Compression
by: Jiang, Wei, et al.
Published: (2022)

Entropy and Diversity: The Axiomatic Approach
by: Leinster, Tom
Published: (2020)

MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compression
by: Jiang, Wei, et al.
Published: (2023)

MLICv2: Enhanced Multi-Reference Entropy Modeling for Learned Image Compression
by: Jiang, Wei, et al.
Published: (2025)

Enter the Void - Planning to Seek Entropy When Reward is Scarce
by: Sundar, Ashish, et al.
Published: (2025)

Robust 3D Face Alignment with Multi-Path Neural Architecture Search
by: Jiang, Zhichao, et al.
Published: (2024)