Copertina

Adaptive Large Language Models By Layerwise Attention Shortcuts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Verma, Prateek, Pilanci, Mert
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence Machine Learning Sound Audio and Speech Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Signal Processing In Large Language Models
di: Verma, Prateek, et al.
Pubblicazione: (2024)

Large Language Models Implicitly Learn to See and Hear Just By Reading
di: Verma, Prateek, et al.
Pubblicazione: (2025)

Thinking While Listening: Simple Test Time Scaling For Audio Classification
di: Verma, Prateek, et al.
Pubblicazione: (2025)

Whisper-GPT: A Hybrid Representation Audio Large Language Model
di: Verma, Prateek
Pubblicazione: (2024)

Wavelet GPT: Wavelet Inspired Large Language Models
di: Verma, Prateek
Pubblicazione: (2024)

Content Adaptive Front End For Audio Classification
di: Verma, Prateek, et al.
Pubblicazione: (2023)

Diverse Audio Embeddings -- Bringing Features Back Outperforms CLAP!
di: Verma, Prateek
Pubblicazione: (2023)

AdaPTwin: Low-Cost Adaptive Compression of Product Twins in Transformers
di: Biju, Emil, et al.
Pubblicazione: (2024)

Spoken Language Intelligence of Large Language Models for Language Learning
di: Peng, Linkai, et al.
Pubblicazione: (2023)

A Language Model With Million Context Length For Raw Audio
di: Verma, Prateek
Pubblicazione: (2022)

Large Language Models' Internal Perception of Symbolic Music
di: Shin, Andrew, et al.
Pubblicazione: (2025)

Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair
di: Sakai, Yusuke, et al.
Pubblicazione: (2024)

PhonologyBench: Evaluating Phonological Skills of Large Language Models
di: Suvarna, Ashima, et al.
Pubblicazione: (2024)

Audio Transformers
di: Verma, Prateek, et al.
Pubblicazione: (2021)

Large Language Models are Efficient Learners of Noise-Robust Speech Recognition
di: Hu, Yuchen, et al.
Pubblicazione: (2024)

Turn-taking and Backchannel Prediction with Acoustic and Large Language Model Fusion
di: Wang, Jinhan, et al.
Pubblicazione: (2024)

GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
di: Hu, Yuchen, et al.
Pubblicazione: (2024)

SEAL: Speaker Error Correction using Acoustic-conditioned Large Language Models
di: Kumar, Anurag, et al.
Pubblicazione: (2025)

C3LLM: Conditional Multimodal Content Generation Using Large Language Models
di: Wang, Zixuan, et al.
Pubblicazione: (2024)

Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting
di: Yang, Chao-Han Huck, et al.
Pubblicazione: (2023)

Walking Through Uncertainty: An Empirical Study of Uncertainty Estimation for Audio-Aware Large Language Models
di: Kuan, Chun-Yi, et al.
Pubblicazione: (2026)

Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models
di: Hu, Yuchen, et al.
Pubblicazione: (2024)

Large Language Model Based Generative Error Correction: A Challenge and Baselines for Speech Recognition, Speaker Tagging, and Emotion Recognition
di: Yang, Chao-Han Huck, et al.
Pubblicazione: (2024)

What Do Language Models Hear? Probing for Auditory Representations in Language Models
di: Ngo, Jerry, et al.
Pubblicazione: (2024)

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model
di: Xie, Jiamin, et al.
Pubblicazione: (2023)

Advancing Speech Understanding in Speech-Aware Language Models with GRPO
di: Elmakies, Avishai, et al.
Pubblicazione: (2025)

Attention-Based Recurrent Neural Network For Automatic Behavior Laying Hen Recognition
di: Laleye, Fréjus A. A., et al.
Pubblicazione: (2024)

MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training
di: Li, Yizhi, et al.
Pubblicazione: (2023)

A Variational Framework for Improving Naturalness in Generative Spoken Language Models
di: Chen, Li-Wei, et al.
Pubblicazione: (2025)

WavLLM: Towards Robust and Adaptive Speech Large Language Model
di: Hu, Shujie, et al.
Pubblicazione: (2024)

Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models
di: Xie, Zhifei, et al.
Pubblicazione: (2025)

Imagine to Hear: Auditory Knowledge Generation can be an Effective Assistant for Language Models
di: Yoo, Suho, et al.
Pubblicazione: (2025)

Unsupervised Speech Segmentation: A General Approach Using Speech Language Models
di: Elmakies, Avishai, et al.
Pubblicazione: (2025)

Slamming: Training a Speech Language Model on One GPU in a Day
di: Maimon, Gallil, et al.
Pubblicazione: (2025)

Decoding Poultry Vocalizations -- Natural Language Processing and Transformer Models for Semantic and Emotional Analysis
di: Manikandan, Venkatraman, et al.
Pubblicazione: (2024)

Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity
di: He, Mutian, et al.
Pubblicazione: (2024)

Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models
di: Hsiao, Chi-Yuan, et al.
Pubblicazione: (2025)

RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis
di: Xin, Detai, et al.
Pubblicazione: (2024)

Towards Controllable Speech Synthesis in the Era of Large Language Models: A Systematic Survey
di: Xie, Tianxin, et al.
Pubblicazione: (2024)

NGPU-LM: GPU-Accelerated N-Gram Language Model for Context-Biasing in Greedy ASR Decoding
di: Bataev, Vladimir, et al.
Pubblicazione: (2025)