Copertina

Skipformer: A Skip-and-Recover Strategy for Efficient Speech Recognition

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhu, Wenjing, Sun, Sining, Shan, Changhao, Fan, Peng, Yang, Qing
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Probe and Skip: Self-Predictive Token Skipping for Efficient Long-Context LLM Inference
di: Wu, Zimeng, et al.
Pubblicazione: (2026)

PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
di: Zhu, Dawei, et al.
Pubblicazione: (2023)

DASH: Input-Aware Dynamic Layer Skipping for Efficient LLM Inference with Markov Decision Policies
di: Yang, Ning, et al.
Pubblicazione: (2025)

FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping
di: Jaiswal, Ajay, et al.
Pubblicazione: (2024)

Recover-to-Forget: Gradient Reconstruction from LoRA for Efficient LLM Unlearning
di: Liu, Yezi, et al.
Pubblicazione: (2025)

Learning to Skip the Middle Layers of Transformers
di: Lawson, Tim, et al.
Pubblicazione: (2025)

Post-Trained MoE Can Skip Half Experts via Self-Distillation
di: Lv, Xingtai, et al.
Pubblicazione: (2026)

Skip-Connected Policy Optimization for Implicit Advantage
di: Teng, Fengwei, et al.
Pubblicazione: (2026)

MSNER: A Multilingual Speech Dataset for Named Entity Recognition
di: Meeus, Quentin, et al.
Pubblicazione: (2024)

Continuously Learning New Words in Automatic Speech Recognition
di: Huber, Christian, et al.
Pubblicazione: (2024)

Recovered in Translation: Efficient Pipeline for Automated Translation of Benchmarks and Datasets
di: Yukhymenko, Hanna, et al.
Pubblicazione: (2026)

Federated Learning with Layer Skipping: Efficient Training of Large Language Models for Healthcare NLP
di: Zhang, Lihong, et al.
Pubblicazione: (2025)

GRIP: Geometric Refinement and Adaptive Information Potential for Data Efficiency
di: Wang, Changhao, et al.
Pubblicazione: (2026)

WhisperNER: Unified Open Named Entity and Speech Recognition
di: Ayache, Gil, et al.
Pubblicazione: (2024)

Context Biasing for Pronunciation-Orthography Mismatch in Automatic Speech Recognition
di: Huber, Christian, et al.
Pubblicazione: (2025)

ConfLayers: Adaptive Confidence-based Layer Skipping for Self-Speculative Decoding
di: Amer, Walaa, et al.
Pubblicazione: (2026)

Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
di: Lu, Xudong, et al.
Pubblicazione: (2024)

Beyond Imitation: Recovering Dense Rewards from Demonstrations
di: Li, Jiangnan, et al.
Pubblicazione: (2025)

Huntington Disease Automatic Speech Recognition with Biomarker Supervision
di: Wang, Charles L., et al.
Pubblicazione: (2026)

Enhancing Speech Emotion Recognition with Graph-Based Multimodal Fusion and Prosodic Features for the Speech Emotion Recognition in Naturalistic Conditions Challenge at Interspeech 2025
di: Ferreira, Alef Iury Siqueira, et al.
Pubblicazione: (2025)

Joint Unsupervised and Supervised Training for Automatic Speech Recognition via Bilevel Optimization
di: Saif, A F M, et al.
Pubblicazione: (2024)

Supplementary Resources and Analysis for Automatic Speech Recognition Systems Trained on the Loquacious Dataset
di: Rossenbach, Nick, et al.
Pubblicazione: (2025)

On SkipGram Word Embedding Models with Negative Sampling: Unified Framework and Impact of Noise Distributions
di: Liu, Dezhi, et al.
Pubblicazione: (2020)

Streaming Decoder-Only Automatic Speech Recognition with Discrete Speech Units: A Pilot Study
di: Chen, Peikun, et al.
Pubblicazione: (2024)

ClusterUCB: Efficient Gradient-Based Data Selection for Targeted Fine-Tuning of LLMs
di: Wang, Zige, et al.
Pubblicazione: (2025)

Speaker Style-Aware Phoneme Anchoring for Improved Cross-Lingual Speech Emotion Recognition
di: Upadhyay, Shreya G., et al.
Pubblicazione: (2025)

Self-Data Distillation for Recovering Quality in Pruned Large Language Models
di: Thangarasa, Vithursan, et al.
Pubblicazione: (2024)

Polynomial Mixing for Efficient Self-supervised Speech Encoders
di: Feillet, Eva, et al.
Pubblicazione: (2026)

Fast-Slow Thinking RM: Efficient Integration of Scalar and Generative Reward Models
di: Wu, Jiayun, et al.
Pubblicazione: (2026)

Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models
di: Hartman, Max, et al.
Pubblicazione: (2025)

WhisTLE: Deeply Supervised, Text-Only Domain Adaptation for Pretrained Speech Recognition Transformers
di: Pandey, Akshat, et al.
Pubblicazione: (2025)

Speech Robust Bench: A Robustness Benchmark For Speech Recognition
di: Shah, Muhammad A., et al.
Pubblicazione: (2024)

OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models
di: Chen, William, et al.
Pubblicazione: (2025)

Position-Agnostic Pre-Projection for Transformer Attention: Nonlinear Feature Construction and Content Skip Before Q/K/V
di: Shinde, Chirag
Pubblicazione: (2026)

SSVD-O: Parameter-Efficient Fine-Tuning with Structured SVD for Speech Recognition
di: Wang, Pu, et al.
Pubblicazione: (2026)

Large Language Models are Efficient Learners of Noise-Robust Speech Recognition
di: Hu, Yuchen, et al.
Pubblicazione: (2024)

LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding
di: Elhoushi, Mostafa, et al.
Pubblicazione: (2024)

Large Language Model Data Generation for Enhanced Intent Recognition in German Speech
di: Rosin, Theresa Pekarek, et al.
Pubblicazione: (2025)

EuroSpeech: A Multilingual Speech Corpus
di: Pfisterer, Samuel, et al.
Pubblicazione: (2025)

Diffusion Language Models for Speech Recognition
di: Naveriani, Davyd, et al.
Pubblicazione: (2026)