Copertina

Seeing the Context: Rich Visual Context-Aware Speech Recognition via Multimodal Reasoning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Tian, Wenjie, Shao, Mingchen, Mu, Bingshen, Geng, Xuelong, Wang, Chengyou, Liao, Yujie, Zhao, Zhixian, Zhang, Ziyu, Hu, Jingbin, Wei, Mengqi, Xie, Lei
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Sound Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

dLLM-ASR: A Faster Diffusion LLM-based Framework for Speech Recognition
di: Tian, Wenjie, et al.
Pubblicazione: (2026)

Towards Building Speech Large Language Models for Multitask Understanding in Low-Resource Languages
di: Shao, Mingchen, et al.
Pubblicazione: (2025)

WenetSpeech-Wu: Datasets, Benchmarks, and Models for a Unified Chinese Wu Dialect Speech Processing Ecosystem
di: Wang, Chengyou, et al.
Pubblicazione: (2026)

Weakly Supervised Data Refinement and Flexible Sequence Compression for Efficient Thai LLM-based ASR
di: Shao, Mingchen, et al.
Pubblicazione: (2025)

Mixture of LoRA Experts with Multi-Modal and Multi-Granularity LLM Generative Error Correction for Accented Speech Recognition
di: Mu, Bingshen, et al.
Pubblicazione: (2025)

Steering Language Model to Stable Speech Emotion Recognition via Contextual Perception and Chain of Thought
di: Zhao, Zhixian, et al.
Pubblicazione: (2025)

MMGER: Multi-modal and Multi-granularity Generative Error Correction with LLM for Joint Accent and Speech Recognition
di: Mu, Bingshen, et al.
Pubblicazione: (2024)

EmoOmni: Bridging Emotional Understanding and Expression in Omni-Modal LLMs
di: Tian, Wenjie, et al.
Pubblicazione: (2026)

Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methods
di: Mu, Bingshen, et al.
Pubblicazione: (2025)

Long-Context Speech Synthesis with Context-Aware Memory
di: Li, Zhipeng, et al.
Pubblicazione: (2025)

Semantic-Aware Interruption Detection in Spoken Dialogue Systems: Benchmark, Metric, and Model
di: Xia, Kangxiang, et al.
Pubblicazione: (2026)

HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models
di: Mu, Bingshen, et al.
Pubblicazione: (2024)

Efficient Scaling for LLM-based ASR
di: Mu, Bingshen, et al.
Pubblicazione: (2025)

OSUM: Advancing Open Speech Understanding Models with Limited Resources in Academia
di: Geng, Xuelong, et al.
Pubblicazione: (2025)

Selective Invocation for Multilingual ASR: A Cost-effective Approach Adapting to Speech Recognition Difficulty
di: Xue, Hongfei, et al.
Pubblicazione: (2025)

Efficient Long-Form Speech Recognition for General Speech In-Context Learning
di: Yen, Hao, et al.
Pubblicazione: (2024)

Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasets
di: Geng, Xuelong, et al.
Pubblicazione: (2024)

LLM-ForcedAligner: A Non-Autoregressive and Accurate LLM-Based Forced Aligner for Multilingual and Long-Form Speech
di: Mu, Bingshen, et al.
Pubblicazione: (2026)

Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models
di: Gao, Xiaoxue, et al.
Pubblicazione: (2024)

Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognition
di: Bai, Ye, et al.
Pubblicazione: (2024)

End-to-End Target Speaker Speech Recognition Using Context-Aware Attention Mechanisms for Challenging Enrollment Scenario
di: Ghane, Mohsen, et al.
Pubblicazione: (2025)

Beyond the Utterance: An Empirical Study of Very Long Context Speech Recognition
di: Flynn, Robert, et al.
Pubblicazione: (2026)

Enhancing Non-Core Language Instruction-Following in Speech LLMs via Semi-Implicit Cross-Lingual CoT Reasoning
di: Xue, Hongfei, et al.
Pubblicazione: (2025)

JELLY: Joint Emotion Recognition and Context Reasoning with LLMs for Conversational Speech Synthesis
di: Cha, Jun-Hyeok, et al.
Pubblicazione: (2025)

Context-Aware Two-Step Training Scheme for Domain Invariant Speech Separation
di: Wang, Wupeng, et al.
Pubblicazione: (2025)

Improving Streaming Speech Recognition With Time-Shifted Contextual Attention And Dynamic Right Context Masking
di: Le, Khanh, et al.
Pubblicazione: (2025)

LCB-net: Long-Context Biasing for Audio-Visual Speech Recognition
di: Yu, Fan, et al.
Pubblicazione: (2024)

Findings of the 2024 Mandarin Stuttering Event Detection and Automatic Speech Recognition Challenge
di: Xue, Hongfei, et al.
Pubblicazione: (2024)

Ideal-LLM: Integrating Dual Encoders and Language-Adapted LLM for Multilingual Speech-to-Text
di: Xue, Hongfei, et al.
Pubblicazione: (2024)

HumDial-EIBench: A Human-Recorded Multi-Turn Emotional Intelligence Benchmark for Audio Language Models
di: Wang, Shuiyuan, et al.
Pubblicazione: (2026)

FleSpeech: Flexibly Controllable Speech Generation with Various Prompts
di: Li, Hanzhao, et al.
Pubblicazione: (2025)

UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding
di: Du, Chenpeng, et al.
Pubblicazione: (2023)

DialoSpeech: Dual-Speaker Dialogue Generation with LLM and Flow Matching
di: Xie, Hanke, et al.
Pubblicazione: (2025)

Retrieval Augmented Generation in Prompt-based Text-to-Speech Synthesis with Context-Aware Contrastive Language-Audio Pretraining
di: Xue, Jinlong, et al.
Pubblicazione: (2024)

Zero-Shot Recognition of Dysarthric Speech Using Commercial Automatic Speech Recognition and Multimodal Large Language Models
di: Alsayegh, Ali, et al.
Pubblicazione: (2025)

SMILE: Speech Meta In-Context Learning for Low-Resource Language Automatic Speech Recognition
di: Hsu, Ming-Hao, et al.
Pubblicazione: (2024)

E-chat: Emotion-sensitive Spoken Dialogue System with Large Language Models
di: Xue, Hongfei, et al.
Pubblicazione: (2023)

Rare Word Recognition and Translation Without Fine-Tuning via Task Vector in Speech Models
di: Jing, Ruihao, et al.
Pubblicazione: (2025)

ContextASR-Bench: A Massive Contextual Speech Recognition Benchmark
di: Wang, He, et al.
Pubblicazione: (2025)

Exploring In-Context Learning Capabilities of ChatGPT for Pathological Speech Detection
di: Amiri, Mahdi, et al.
Pubblicazione: (2025)