Image de couverture de livre

Speaking Beyond Language: A Large-Scale Multimodal Dataset for Learning Nonverbal Cues from Video-Grounded Dialogues

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kim, Youngmin, Chung, Jiwan, Kim, Jisoo, Lee, Sunghyun, Lee, Sangkyu, Kim, Junhyeok, Yang, Cheoljong, Yu, Youngjae
Format:	Preprint
Publié:	2025
Sujets:	Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning
par: Chung, Jiwan, et autres
Publié: (2025)

EgoSpeak: Learning When to Speak for Egocentric Conversational Agents in the Wild
par: Kim, Junhyeok, et autres
Publié: (2025)

MASS: Overcoming Language Bias in Image-Text Matching
par: Chung, Jiwan, et autres
Publié: (2025)

GuideDog: A Real-World Egocentric Multimodal Dataset for Blind and Low-Vision Accessibility-Aware Guidance
par: Kim, Junhyeok, et autres
Publié: (2025)

Aligning Large Language Models by On-Policy Self-Judgment
par: Lee, Sangkyu, et autres
Publié: (2024)

SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models
par: Hyun, Lee, et autres
Publié: (2023)

Do Language Models Associate Sound with Meaning? A Multimodal Study of Sound Symbolism
par: Jeong, Jinhong, et autres
Publié: (2025)

Visual Question Answering Instruction: Unlocking Multimodal Large Language Model To Domain-Specific Visual Multitasks
par: Lee, Jusung, et autres
Publié: (2024)

SlumpGuard: An AI-Powered Real-Time System for Automated Concrete Slump Prediction via Video Analysis
par: Kim, Youngmin, et autres
Publié: (2025)

Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding
par: Chung, Jiwan, et autres
Publié: (2024)

Teaching Metric Distance to Discrete Autoregressive Language Models
par: Chung, Jiwan, et autres
Publié: (2025)

Initiation of Interaction Detection Framework using a Nonverbal Cue for Human-Robot Interaction
par: Yun, Guhnoo, et autres
Publié: (2026)

V.I.P. : Iterative Online Preference Distillation for Efficient Video Diffusion Models
par: Kim, Jisoo, et autres
Publié: (2025)

SEAL: Entangled White-box Watermarks on Low-Rank Adaptation
par: Oh, Giyeong, et autres
Publié: (2025)

RNA: Video Editing with ROI-based Neural Atlas
par: Lee, Jaekyeong, et autres
Publié: (2024)

What MLLMs Learn about When they Learn about Multimodal Reasoning
par: Chung, Jiwan, et autres
Publié: (2025)

HIPPO-Video: Simulating Watch Histories with Large Language Models for Personalized Video Highlighting
par: Lee, Jeongeun, et autres
Publié: (2025)

Scalp Diagnostic System With Label-Free Segmentation and Training-Free Image Translation
par: Kim, Youngmin, et autres
Publié: (2024)

Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Dataset
par: Kim, Minjin, et autres
Publié: (2024)

Towards Continuous Sign Language Conversation from Isolated Signs
par: Kim, Youngmin, et autres
Publié: (2026)

Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding
par: Kang, Seil, et autres
Publié: (2025)

IWP: Token Pruning as Implicit Weight Pruning in Large Vision Language Models
par: Lee, Dong-Jae, et autres
Publié: (2026)

Can visual language models resolve textual ambiguity with visual cues? Let visual puns tell you!
par: Chung, Jiwan, et autres
Publié: (2024)

Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models
par: Chae, Hyungjoo, et autres
Publié: (2024)

Explain with Visual Keypoints Like a Real Mentor! A Benchmark for Multimodal Solution Explanation
par: Park, Jaewoo, et autres
Publié: (2025)

WoLF: Wide-scope Large Language Model Framework for CXR Understanding
par: Kang, Seil, et autres
Publié: (2024)

Global Geometry Is Not Enough for Vision Representations
par: Chung, Jiwan, et autres
Publié: (2026)

Towards Visual Text Design Transfer Across Languages
par: Choi, Yejin, et autres
Publié: (2024)

VAGUE: Visual Contexts Clarify Ambiguous Expressions
par: Nam, Heejeong, et autres
Publié: (2024)

A11YN: aligning LLMs for accessible web UI code generation
par: Yoon, Janghan, et autres
Publié: (2025)

See What You Are Told: Visual Attention Sink in Large Multimodal Models
par: Kang, Seil, et autres
Publié: (2025)

HRDexDB: A Large-Scale Dataset of Dexterous Human and Robotic Hand Grasps
par: Lim, Jongbin, et autres
Publié: (2026)

DEEPTalk: Dynamic Emotion Embedding for Probabilistic Speech-Driven 3D Face Animation
par: Kim, Jisoo, et autres
Publié: (2024)

ISR-DPO: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO
par: Ahn, Daechul, et autres
Publié: (2024)

SSG: Scaled Spatial Guidance for Multi-Scale Visual Autoregressive Generation
par: Shin, Youngwoo, et autres
Publié: (2026)

On the Reliability of Cue Conflict and Beyond
par: Kim, Pum Jun, et autres
Publié: (2026)

Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot
par: Lee, Sejin, et autres
Publié: (2024)

Cross, Dwell, or Pinch: Designing and Evaluating Around-Device Selection Methods for Unmodified Smartwatches
par: Kim, Jiwan, et autres
Publié: (2025)

When to Speak, When to Abstain: Contrastive Decoding with Abstention
par: Kim, Hyuhng Joon, et autres
Publié: (2024)

Inlier-Centric Post-Training Quantization for Object Detection Models
par: Kim, Minsu, et autres
Publié: (2026)