Cover Image

Aligning Dialogue Agents with Global Feedback via Large Language Model Multimodal Reward Decomposition

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lee, Dong Won, Park, Hae Won, Breazeal, Cynthia, Morency, Louis-Philippe
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Improving Dialogue Agents by Decomposing One Global Explicit Annotation with Local Implicit Multimodal Feedback
by: Lee, Dong Won, et al.
Published: (2024)

Does "Reasoning" with Large Language Models Improve Recognizing, Generating, and Reframing Unhelpful Thoughts?
by: Qi, Yilin, et al.
Published: (2025)

A Modern System Recipe for Situated Embodied Human-Robot Conversation with Real-Time Multimodal LLMs and Tool-Calling
by: Lee, Dong Won, et al.
Published: (2026)

Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data
by: Kim, Yubin, et al.
Published: (2024)

Social Human Robot Embodied Conversation (SHREC) Dataset: Benchmarking Foundational Models' Social Reasoning
by: Lee, Dong Won, et al.
Published: (2025)

HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs
by: Shen, Jocelyn, et al.
Published: (2024)

InvThink: Premortem Reasoning for Safer Language Models
by: Kim, Yubin, et al.
Published: (2025)

Words Like Knives: Backstory-Personalized Modeling and Detection of Violent Communication
by: Shen, Jocelyn, et al.
Published: (2025)

EmpathicStories++: A Multimodal Dataset for Empathy towards Personal Experiences
by: Shen, Jocelyn, et al.
Published: (2024)

Ensembling Large Language Models to Characterize Affective Dynamics in Student-AI Tutor Dialogues
by: Zhang, Chenyu, et al.
Published: (2025)

The Hidden Puppet Master: Predicting Human Belief Change in Manipulative LLM Dialogues
by: Shen, Jocelyn, et al.
Published: (2026)

A Demonstration of Adaptive Collaboration of Large Language Models for Medical Decision-Making
by: Kim, Yubin, et al.
Published: (2024)

Leveraging Large Language Models to Identify Conversation Threads in Collaborative Learning
by: Ravi, Prerna, et al.
Published: (2025)

Integrating Flow Theory and Adaptive Robot Roles: A Conceptual Model of Dynamic Robot Role Adaptation for the Enhanced Flow Experience in Long-term Multi-person Human-Robot Interactions
by: Chen, Huili, et al.
Published: (2024)

Rewarding the Rare: Uniqueness-Aware RL for Creative Problem Solving in LLMs
by: Hu, Zhiyuan, et al.
Published: (2026)

Social Caption: Evaluating Social Understanding in Multimodal Models
by: Thumu, Bhaavanaa, et al.
Published: (2026)

Social Genome: Grounded Social Reasoning Abilities of Multimodal Models
by: Mathur, Leena, et al.
Published: (2025)

BehaviorSFT: Behavioral Token Conditioning for Clinical Agents Across the Proactivity Spectrum
by: Kim, Yubin, et al.
Published: (2025)

Omitted Variable Bias in Language Models Under Distribution Shift
by: Lin, Victoria, et al.
Published: (2026)

Optimizing Language Models for Human Preferences is a Causal Inference Problem
by: Lin, Victoria, et al.
Published: (2024)

Isolated Causal Effects of Natural Language
by: Lin, Victoria, et al.
Published: (2024)

IoT-LM: Large Multisensory Language Models for the Internet of Things
by: Mo, Shentong, et al.
Published: (2024)

MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts
by: Yu, Haofei, et al.
Published: (2023)

Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions
by: Mathur, Leena, et al.
Published: (2024)

Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models
by: Zhang, Ce, et al.
Published: (2025)

MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making
by: Kim, Yubin, et al.
Published: (2024)

Social Robots as Social Proxies for Fostering Connection and Empathy Towards Humanity
by: Shen, Jocelyn, et al.
Published: (2025)

Collaborative Multi-Agent Test-Time Reinforcement Learning for Reasoning
by: Hu, Zhiyuan, et al.
Published: (2026)

Empathy by Design: Aligning Large Language Models for Healthcare Dialogue
by: Umucu, Emre, et al.
Published: (2025)

Reward Collapse in Aligning Large Language Models
by: Song, Ziang, et al.
Published: (2023)

PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits
by: Jiang, Hang, et al.
Published: (2023)

ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback
by: Hou, Zhenyu, et al.
Published: (2024)

Prior Constraints-based Reward Model Training for Aligning Large Language Models
by: Zhou, Hang, et al.
Published: (2024)

Robust Reward Modeling for Large Language Models via Causal Decomposition
by: Lu, Yunsheng, et al.
Published: (2026)

HEMM: Holistic Evaluation of Multimodal Foundation Models
by: Liang, Paul Pu, et al.
Published: (2024)

From Small to Large Language Models: Revisiting the Federalist Papers
by: Jeong, So Won, et al.
Published: (2025)

LongReward: Improving Long-context Large Language Models with AI Feedback
by: Zhang, Jiajie, et al.
Published: (2024)

ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models
by: Wan, Zifu, et al.
Published: (2025)

TroL: Traversal of Layers for Large Language and Vision Models
by: Lee, Byung-Kwan, et al.
Published: (2024)

Aligning Language Models with Demonstrated Feedback
by: Shaikh, Omar, et al.
Published: (2024)