Copertina

Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Park, Se Jin, Kim, Chae Won, Rha, Hyeongseop, Kim, Minsu, Hong, Joanna, Yeo, Jeong Hun, Ro, Yong Man
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence Human-Computer Interaction
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation
di: Kim, Minsu, et al.
Pubblicazione: (2024)

Towards Inclusive Communication: A Unified Framework for Generating Spoken Language from Sign, Lip, and Audio
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2025)

MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2025)

Emotion-Coherent Reasoning for Multimodal LLMs via Emotional Rationale Verifier
di: Rha, Hyeongseop, et al.
Pubblicazione: (2025)

Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2026)

Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models
di: Choi, Jeongsoo, et al.
Pubblicazione: (2023)

Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation
di: Park, Se Jin, et al.
Pubblicazione: (2023)

Personalized Lip Reading: Adapting to Your Unique Lip Movements with Vision and Language
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2024)

Learning What to Attend First: Modality-Importance-Guided Reasoning for Reliable Multimodal Emotion Understanding
di: Rha, Hyeongseop, et al.
Pubblicazione: (2025)

AV-EmoDialog: Chat with Audio-Visual Users Leveraging Emotional Cues
di: Park, Se Jin, et al.
Pubblicazione: (2024)

Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech Representations
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2025)

Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2024)

Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge
di: Kim, Minsu, et al.
Pubblicazione: (2023)

Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation
di: Han, Seunghee, et al.
Pubblicazione: (2024)

Visual Speech Recognition for Languages with Limited Labeled Data using Automatic Labels from Whisper
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2023)

AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2023)

TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages
di: Kim, Minsu, et al.
Pubblicazione: (2024)

Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressor
di: Kim, Yeonju, et al.
Pubblicazione: (2024)

AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
di: Choi, Jeongsoo, et al.
Pubblicazione: (2023)

Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition
di: Kim, Minsu, et al.
Pubblicazione: (2023)

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models
di: Lee, Byung-Kwan, et al.
Pubblicazione: (2024)

CoLLaVO: Crayon Large Language and Vision mOdel
di: Lee, Byung-Kwan, et al.
Pubblicazione: (2024)

MoAI: Mixture of All Intelligence for Large Language and Vision Models
di: Lee, Byung-Kwan, et al.
Pubblicazione: (2024)

Remote Sensing Large Vision-Language Model: Semantic-augmented Multi-level Alignment and Semantic-aware Expert Modeling
di: Park, Sungjune, et al.
Pubblicazione: (2025)

GCAgent: Long-Video Understanding via Schematic and Narrative Episodic Memory
di: Yeo, Jeong Hun, et al.
Pubblicazione: (2025)

TroL: Traversal of Layers for Large Language and Vision Models
di: Lee, Byung-Kwan, et al.
Pubblicazione: (2024)

Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation
di: Kim, Minsu, et al.
Pubblicazione: (2023)

Phantom of Latent for Large Language and Vision Models
di: Lee, Byung-Kwan, et al.
Pubblicazione: (2024)

Long-Form Speech Generation with Spoken Language Models
di: Park, Se Jin, et al.
Pubblicazione: (2024)

Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
di: Jang, Youngjoon, et al.
Pubblicazione: (2024)

Robust Pedestrian Detection via Constructing Versatile Pedestrian Knowledge Bank
di: Park, Sungjune, et al.
Pubblicazione: (2024)

Integrating Language-Derived Appearance Elements with Visual Cues in Pedestrian Detection
di: Park, Sungjune, et al.
Pubblicazione: (2023)

STRIDE: When to Speak Meets Sequence Denoising for Streaming Video Understanding
di: Kim, Junho, et al.
Pubblicazione: (2026)

Non-Adaptive Adversarial Face Generation
di: Kim, Sunpill, et al.
Pubblicazione: (2025)

Cross-Modal Emotion Transfer for Emotion Editing in Talking Face Video
di: Choi, Chanhyuk, et al.
Pubblicazione: (2026)

Language-guided Learning for Object Detection Tackling Multiple Variations in Aerial Images
di: Park, Sungjune, et al.
Pubblicazione: (2025)

What if...?: Thinking Counterfactual Keywords Helps to Mitigate Hallucination in Large Multi-modal Models
di: Kim, Junho, et al.
Pubblicazione: (2024)

DIP-R1: Deep Inspection and Perception with RL Looking Through and Understanding Complex Scenes
di: Park, Sungjune, et al.
Pubblicazione: (2025)

PairEval: Open-domain Dialogue Evaluation with Pairwise Comparison
di: Park, ChaeHun, et al.
Pubblicazione: (2024)

ControlFace: Harnessing Facial Parametric Control for Face Rigging
di: Jang, Wooseok, et al.
Pubblicazione: (2024)