Cover Image

Efficiency at Scale: Investigating the Performance of Diminutive Language Models in Clinical Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Taylor, Niall, Ghose, Upamanyu, Rohanian, Omid, Nouriborji, Mohammadmahdi, Kormilitzin, Andrey, Clifton, David, Nevado-Holgado, Alejo
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring the Effectiveness of Instruction Tuning in Biomedical Language Processing
by: Rohanian, Omid, et al.
Published: (2023)

Efficient Interleaved Speech Modeling through Knowledge Distillation
by: Nouriborji, Mohammadmahdi, et al.
Published: (2025)

Developing Healthcare Language Model Embedding Spaces
by: Taylor, Niall, et al.
Published: (2024)

Detecting the Clinical Features of Difficult-to-Treat Depression using Synthetic Data from Large Language Models
by: Lorge, Isabelle, et al.
Published: (2024)

Improving Recursive Transformers with Mixture of LoRAs
by: Nouriborji, Mohammadmahdi, et al.
Published: (2025)

Lightweight Transformers for Clinical Natural Language Processing
by: Rohanian, Omid, et al.
Published: (2023)

Bespoke Large Language Models for Digital Triage Assistance in Mental Health Care
by: Taylor, Niall, et al.
Published: (2024)

Large Language Models Perform on Par with Experts Identifying Mental Health Factors in Adolescent Online Forums
by: Lorge, Isabelle, et al.
Published: (2024)

Rapid Biomedical Research Classification: The Pandemic PACT Advanced Categorisation Engine
by: Rohanian, Omid, et al.
Published: (2024)

Optimizing Speech Language Models for Acoustic Consistency
by: Rohanian, Morteza, et al.
Published: (2025)

Large Language Models in the Clinic: A Comprehensive Benchmark
by: Liu, Fenglin, et al.
Published: (2024)

Arbitration Failure, Not Perceptual Blindness: How Vision-Language Models Resolve Visual-Linguistic Conflicts
by: Nooralahzadeh, Farhad, et al.
Published: (2026)

Towards Scalable and Cross-Lingual Specialist Language Models for Oncology
by: Rohanian, Morteza, et al.
Published: (2025)

Pitfalls of Scale: Investigating the Inverse Task of Redefinition in Large Language Models
by: Stringli, Elena, et al.
Published: (2025)

Investigating Low-Rank Training in Transformer Language Models: Efficiency and Scaling Analysis
by: Wei, Xiuying, et al.
Published: (2024)

A Primer on the Signature Method in Machine Learning
by: Chevyrev, Ilya, et al.
Published: (2016)

Scaling Laws for Downstream Task Performance of Large Language Models
by: Isik, Berivan, et al.
Published: (2024)

Diminutive im polnisch-deutschen Uebersetzungsvergleich
by: Koecke, Bernadette
Published: (2019)

Retrieval-Augmented and Knowledge-Grounded Language Models for Faithful Clinical Medicine
by: Liu, Fenglin, et al.
Published: (2022)

Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning
by: Ye, Jiasheng, et al.
Published: (2023)

Semantic Self-Distillation for Language Model Uncertainty
by: Phillips, Edward, et al.
Published: (2026)

A Survey on Large Language Models in Multimodal Recommender Systems
by: Lopez-Avila, Alejo, et al.
Published: (2025)

Benchmarking Distilled Language Models: Performance and Efficiency in Resource-Constrained Settings
by: Wani, Sachin Gopal, et al.
Published: (2026)

ProxyLM: Predicting Language Model Performance on Multilingual Tasks via Proxy Models
by: Anugraha, David, et al.
Published: (2024)

The Acquisition of Negation in Three Mayan Languages
by: Clifton Pye
Published: (2017)

From Monolingual to Bilingual: Investigating Language Conditioning in Large Language Models for Psycholinguistic Tasks
by: Yuan, Shuzhou, et al.
Published: (2025)

What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Text
by: Kanepajs, Arturs, et al.
Published: (2025)

Task-Specific Efficiency Analysis: When Small Language Models Outperform Large Language Models
by: Cao, Jinghan, et al.
Published: (2026)

A Dual-Task Paradigm to Investigate Sentence Comprehension Strategies in Language Models
by: Emura, Rei, et al.
Published: (2026)

Fine-Tuning Open-Source Large Language Models to Improve Their Performance on Radiation Oncology Tasks: A Feasibility Study to Investigate Their Potential Clinical Applications in Radiation Oncology
by: Wang, Peilong, et al.
Published: (2025)

Predicting Task Performance with Context-aware Scaling Laws
by: Montgomery, Kyle, et al.
Published: (2025)

Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Models
by: Deshpande, Vijeta, et al.
Published: (2025)

BAS: A Decision-Theoretic Approach to Evaluating Large Language Model Confidence
by: Wu, Sean, et al.
Published: (2026)

Improving Clinical NLP Performance through Language Model-Generated Synthetic Clinical Data
by: Chen, Shan, et al.
Published: (2024)

How do Scaling Laws Apply to Knowledge Graph Engineering Tasks? The Impact of Model Size on Large Language Model Performance
by: Heim, Desiree, et al.
Published: (2025)

SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking
by: Xing, Xingrun, et al.
Published: (2024)

Scaling Down Semantic Leakage: Investigating Associative Bias in Smaller Language Models
by: Smilga, Veronika
Published: (2025)

Investigating and Scaling up Code-Switching for Multilingual Language Model Pre-Training
by: Wang, Zhijun, et al.
Published: (2025)

ReCoVeR the Target Language: Language Steering without Sacrificing Task Performance
by: Sterz, Hannah, et al.
Published: (2025)

More Room for Language: Investigating the Effect of Retrieval on Language Models
by: Samuel, David, et al.
Published: (2024)