Copertina

Whispering Context: Distilling Syntax and Semantics for Long Speech Transcripts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Altinok, Duygu
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Smooth Operators: LLMs Translating Imperfect Hints into Disfluency-Rich Transcripts
di: Altinok, Duygu
Pubblicazione: (2025)

Introducing TrGLUE and SentiTurca: A Comprehensive Benchmark for Turkish General Language Understanding and Sentiment Analysis
di: Altinok, Duygu
Pubblicazione: (2025)

Optimal Turkish Subword Strategies at Scale: Systematic Evaluation of Data, Vocabulary, Morphology Interplay
di: Altinok, Duygu
Pubblicazione: (2026)

Mind the Gap: Entity-Preserved Context-Aware ASR Structured Transcriptions
di: Altinok, Duygu
Pubblicazione: (2025)

D-NLP at SemEval-2024 Task 2: Evaluating Clinical Inference Capabilities of Large Language Models
di: Altinok, Duygu
Pubblicazione: (2024)

Enhancing Aviation Communication Transcription: Fine-Tuning Distil-Whisper with LoRA
di: Mirzaei, Shokoufeh, et al.
Pubblicazione: (2025)

ASKD-Whisper: Adaptive Self-knowledge Distillation for Efficient and Low-Latency Automatic Speech Recognition
di: Lee, Junseok, et al.
Pubblicazione: (2026)

Analyzing and Fine-Tuning Whisper Models for Multilingual Pilot Speech Transcription in the Cockpit
di: Nareddy, Kartheek Kumar Reddy, et al.
Pubblicazione: (2025)

Boosting CTC-Based ASR Using LLM-Based Intermediate Loss Regularization
di: Altinok, Duygu
Pubblicazione: (2025)

OPSDL: On-Policy Self-Distillation for Long-Context Language Models
di: Zhang, Xinsen, et al.
Pubblicazione: (2026)

SyntaxShap: Syntax-aware Explainability Method for Text Generation
di: Amara, Kenza, et al.
Pubblicazione: (2024)

Improving Speech Recognition of Named Entities in Classroom Speech with LLM Revision and Phonetic-Semantic Context
di: Trinh, Viet Anh, et al.
Pubblicazione: (2025)

Enhancing Coreference Resolution with Pretrained Language Models: Bridging the Gap Between Syntax and Semantics
di: Liu, Xingzu, et al.
Pubblicazione: (2025)

Causal Interventions on Causal Paths: Mapping GPT-2's Reasoning From Syntax to Semantics
di: Lee, Isabelle, et al.
Pubblicazione: (2024)

Latent Context Compilation: Distilling Long Context into Compact Portable Memory
di: Li, Zeju, et al.
Pubblicazione: (2026)

Language Models Learn Constructional Semantics, Not To Mention Syntax: Investigating LM Understanding of Paired-Focus Constructions
di: Scivetti, Wesley, et al.
Pubblicazione: (2026)

Whisper Finetuning on Nepali Language
di: Rijal, Sanjay, et al.
Pubblicazione: (2024)

TSUBASA: Improving Long-Horizon Personalization via Evolving Memory and Self-Learning with Context Distillation
di: Zhang, Xinliang Frederick, et al.
Pubblicazione: (2026)

SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language Modeling
di: Liu, Dong, et al.
Pubblicazione: (2025)

LAWCAT: Efficient Distillation from Quadratic to Linear Attention with Convolution across Tokens for Long Context Modeling
di: Liu, Zeyu, et al.
Pubblicazione: (2025)

How Syntax Specialization Emerges in Language Models
di: Duan, Xufeng, et al.
Pubblicazione: (2025)

Do Slides Help? Multi-modal Context for Automatic Transcription of Conference Talks
di: Sinhamahapatra, Supriti, et al.
Pubblicazione: (2025)

LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
di: Jo, Daejin, et al.
Pubblicazione: (2025)

The Sound of Syntax: Finetuning and Comprehensive Evaluation of Language Models for Speech Pathology
di: Patel, Fagun, et al.
Pubblicazione: (2025)

Distilling Monolingual and Crosslingual Word-in-Context Representations
di: Arase, Yuki, et al.
Pubblicazione: (2024)

LooGLE: Can Long-Context Language Models Understand Long Contexts?
di: Li, Jiaqi, et al.
Pubblicazione: (2023)

Context Memorization for Efficient Long Context Generation
di: Okoshi, Yasuyuki, et al.
Pubblicazione: (2026)

Empowering Healthcare Practitioners with Language Models: Structuring Speech Transcripts in Two Real-World Clinical Applications
di: Corbeil, Jean-Philippe, et al.
Pubblicazione: (2025)

Cross-Modal Knowledge Distillation for Speech Large Language Models
di: Wang, Enzhi, et al.
Pubblicazione: (2025)

Speech Emotion Recognition Leveraging OpenAI's Whisper Representations and Attentive Pooling Methods
di: Shendabadi, Ali, et al.
Pubblicazione: (2026)

Whispering Experts: Neural Interventions for Toxicity Mitigation in Language Models
di: Suau, Xavier, et al.
Pubblicazione: (2024)

Are Long-LLMs A Necessity For Long-Context Tasks?
di: Qian, Hongjin, et al.
Pubblicazione: (2024)

Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Roles
di: Guo, Rongchen, et al.
Pubblicazione: (2025)

KV-Distill: Nearly Lossless Learnable Context Compression for LLMs
di: Chari, Vivek, et al.
Pubblicazione: (2025)

FCDS: Fusing Constituency and Dependency Syntax into Document-Level Relation Extraction
di: Zhu, Xudong, et al.
Pubblicazione: (2024)

Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation
di: Zhou, Yuhang, et al.
Pubblicazione: (2024)

Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts
di: Chen, Yingfa, et al.
Pubblicazione: (2026)

APCE: Adaptive Progressive Context Expansion for Long Context Processing
di: Lee, Baisub, et al.
Pubblicazione: (2025)

Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP
di: Goldman, Omer, et al.
Pubblicazione: (2024)

NExtLong: Toward Effective Long-Context Training without Long Documents
di: Gao, Chaochen, et al.
Pubblicazione: (2025)