Imagen de Portada

Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Park, Se Jin, Kim, Chae Won, Rha, Hyeongseop, Kim, Minsu, Hong, Joanna, Yeo, Jeong Hun, Ro, Yong Man
Formato:	Preprint
Publicado:	2024
Materias:	Computer Vision and Pattern Recognition Artificial Intelligence Human-Computer Interaction
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation
por: Kim, Minsu, et al.
Publicado: (2024)

Towards Inclusive Communication: A Unified Framework for Generating Spoken Language from Sign, Lip, and Audio
por: Yeo, Jeong Hun, et al.
Publicado: (2025)

MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens
por: Yeo, Jeong Hun, et al.
Publicado: (2025)

Emotion-Coherent Reasoning for Multimodal LLMs via Emotional Rationale Verifier
por: Rha, Hyeongseop, et al.
Publicado: (2025)

Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding
por: Yeo, Jeong Hun, et al.
Publicado: (2026)

Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models
por: Choi, Jeongsoo, et al.
Publicado: (2023)

Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation
por: Park, Se Jin, et al.
Publicado: (2023)

Personalized Lip Reading: Adapting to Your Unique Lip Movements with Vision and Language
por: Yeo, Jeong Hun, et al.
Publicado: (2024)

Learning What to Attend First: Modality-Importance-Guided Reasoning for Reliable Multimodal Emotion Understanding
por: Rha, Hyeongseop, et al.
Publicado: (2025)

AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cues
por: Park, Se Jin, et al.
Publicado: (2024)

Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech Representations
por: Yeo, Jeong Hun, et al.
Publicado: (2025)

Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing
por: Yeo, Jeong Hun, et al.
Publicado: (2024)

Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge
por: Kim, Minsu, et al.
Publicado: (2023)

Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation
por: Han, Seunghee, et al.
Publicado: (2024)

Visual Speech Recognition for Languages with Limited Labeled Data using Automatic Labels from Whisper
por: Yeo, Jeong Hun, et al.
Publicado: (2023)

AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model
por: Yeo, Jeong Hun, et al.
Publicado: (2023)

TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages
por: Kim, Minsu, et al.
Publicado: (2024)

Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressor
por: Kim, Yeonju, et al.
Publicado: (2024)

AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
por: Choi, Jeongsoo, et al.
Publicado: (2023)

Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition
por: Kim, Minsu, et al.
Publicado: (2023)

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models
por: Lee, Byung-Kwan, et al.
Publicado: (2024)

CoLLaVO: Crayon Large Language and Vision mOdel
por: Lee, Byung-Kwan, et al.
Publicado: (2024)

MoAI: Mixture of All Intelligence for Large Language and Vision Models
por: Lee, Byung-Kwan, et al.
Publicado: (2024)

Remote Sensing Large Vision-Language Model: Semantic-augmented Multi-level Alignment and Semantic-aware Expert Modeling
por: Park, Sungjune, et al.
Publicado: (2025)

GCAgent: Long-Video Understanding via Schematic and Narrative Episodic Memory
por: Yeo, Jeong Hun, et al.
Publicado: (2025)

TroL: Traversal of Layers for Large Language and Vision Models
por: Lee, Byung-Kwan, et al.
Publicado: (2024)

Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
por: Kim, Minsu, et al.
Publicado: (2023)

Phantom of Latent for Large Language and Vision Models
por: Lee, Byung-Kwan, et al.
Publicado: (2024)

Long-Form Speech Generation with Spoken Language Models
por: Park, Se Jin, et al.
Publicado: (2024)

Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
por: Jang, Youngjoon, et al.
Publicado: (2024)

Robust Pedestrian Detection via Constructing Versatile Pedestrian Knowledge Bank
por: Park, Sungjune, et al.
Publicado: (2024)

Integrating Language-Derived Appearance Elements with Visual Cues in Pedestrian Detection
por: Park, Sungjune, et al.
Publicado: (2023)

STRIDE: When to Speak Meets Sequence Denoising for Streaming Video Understanding
por: Kim, Junho, et al.
Publicado: (2026)

Non-Adaptive Adversarial Face Generation
por: Kim, Sunpill, et al.
Publicado: (2025)

Cross-Modal Emotion Transfer for Emotion Editing in Talking Face Video
por: Choi, Chanhyuk, et al.
Publicado: (2026)

Language-guided Learning for Object Detection Tackling Multiple Variations in Aerial Images
por: Park, Sungjune, et al.
Publicado: (2025)

What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models
por: Kim, Junho, et al.
Publicado: (2024)

DIP-R1: Deep Inspection and Perception with RL Looking Through and Understanding Complex Scenes
por: Park, Sungjune, et al.
Publicado: (2025)

PairEval: Open-domain Dialogue Evaluation with Pairwise Comparison
por: Park, ChaeHun, et al.
Publicado: (2024)

ControlFace: Harnessing Facial Parametric Control for Face Rigging
por: Jang, Wooseok, et al.
Publicado: (2024)