Cover Image

Lightweight Baselines for Medical Abstract Classification: DistilBERT with Cross-Entropy as a Strong Default

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Jiaqi, Wang, Tong, Liu, Su, Hu, Xin, Tong, Ran, Wang, Lanruo, Xu, Jiexi
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Does Bigger Mean Better? Comparitive Analysis of CNNs and Biomedical Vision Language Modles in Medical Diagnosis
by: Tong, Ran, et al.
Published: (2025)

Exploring Variability in Fine-Tuned Models for Text Classification with DistilBERT
by: Lorenzoni, Giuliano, et al.
Published: (2024)

Renaissance of RNNs in Streaming Clinical Time Series: Compact Recurrence Remains Competitive with Transformers
by: Tong, Ran, et al.
Published: (2025)

Toward Causal-Visual Programming: Enhancing Agentic Reasoning in Low-Code Environments
by: Xu, Jiexi, et al.
Published: (2025)

Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews
by: Christian, William, et al.
Published: (2025)

An investigation of structures responsible for gender bias in BERT and DistilBERT
by: Leteno, Thibaud, et al.
Published: (2024)

Rainbow Noise: Stress-Testing Multimodal Harmful-Meme Detectors on LGBTQ Content
by: Tong, Ran, et al.
Published: (2025)

Exploring Genre and Success Classification through Song Lyrics using DistilBERT: A Fun NLP Venture
by: Martinez, Servando Pizarro, et al.
Published: (2024)

Improving QA Efficiency with DistilBERT: Fine-Tuning and Inference on mobile Intel CPUs
by: Yinkfu, Ngeyen
Published: (2025)

Dynamic Policy Induction for Adaptive Prompt Optimization: Bridging the Efficiency-Accuracy Gap via Lightweight Reinforcement Learning
by: Xu, Jiexi
Published: (2025)

Analyzing Examinee Comments using DistilBERT and Machine Learning to Ensure Quality Control in Exam Content
by: Ye, et al.
Published: (2025)

Tracking Emotional Dynamics in Chat Conversations: A Hybrid Approach using DistilBERT and Emoji Sentiment Analysis
by: Igali, Ayan, et al.
Published: (2024)

Dynamic Graph Neural Networks for Physiological Based Pharmacokinetic Modeling: A Novel Data Driven Approach to Drug Concentration Prediction
by: Liu, Su, et al.
Published: (2025)

Visualizing Public Opinion on X: A Real-Time Sentiment Dashboard Using VADER and DistilBERT
by: Reddy, Yanampally Abhiram, et al.
Published: (2025)

Selecting Between BERT and GPT for Text Classification in Political Science Research
by: Wang, Yu, et al.
Published: (2024)

From Correction to Mastery: Reinforced Distillation of Large Language Model Agents
by: Lyu, Yuanjie, et al.
Published: (2025)

Beyond Mimicry to Contextual Guidance: Knowledge Distillation for Interactive AI
by: Wang, Tong, et al.
Published: (2024)

Mask-guided BERT for Few Shot Text Classification
by: Liao, Wenxiong, et al.
Published: (2023)

Do BERT-Like Bidirectional Models Still Perform Better on Text Classification in the Era of LLMs?
by: Zhang, Junyan, et al.
Published: (2025)

AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation
by: Zhang, Songming, et al.
Published: (2025)

Modeling Parkinson's Disease Progression Using Longitudinal Voice Biomarkers: A Comparative Study of Statistical and Neural Mixed-Effects Models
by: Tong, Ran, et al.
Published: (2025)

Forecasting Medium-Horizon Alzheimer's Disease Progression: Residual Gap-Aware Transformers for 24-Month CDR-SB Change from ADNI Clinical and Biomarker Histories
by: Tong, Ran, et al.
Published: (2026)

Medical Dialogue: A Survey of Categories, Methods, Evaluation and Challenges
by: Shi, Xiaoming, et al.
Published: (2024)

MEDBERT.de: A Comprehensive German BERT Model for the Medical Domain
by: Bressem, Keno K., et al.
Published: (2023)

Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B People
by: Wang, Xidong, et al.
Published: (2024)

Auto-ABSA: Cross-Domain Aspect Detection and Sentiment Analysis Using Auxiliary Sentences
by: Wang, Teng, et al.
Published: (2022)

Enriched BERT Embeddings for Scholarly Publication Classification
by: Wolff, Benjamin, et al.
Published: (2024)

AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents
by: Yang, Ke, et al.
Published: (2024)

Strings from the Library of Babel: Random Sampling as a Strong Baseline for Prompt Optimisation
by: Lu, Yao, et al.
Published: (2023)

A Two-Stage Framework with Self-Supervised Distillation For Cross-Domain Text Classification
by: Feng, Yunlong, et al.
Published: (2023)

Bridge-RAG: An Abstract Bridge Tree Based Retrieval Augmented Generation Algorithm
by: Li, Zihang, et al.
Published: (2026)

AI-Generated Text Detection and Classification Based on BERT Deep Learning Algorithm
by: Wang, Hao, et al.
Published: (2024)

KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
by: Zhang, Songming, et al.
Published: (2026)

MedicalBERT: enhancing biomedical natural language processing using pretrained BERT-based model
by: Reddy, K. Sahit, et al.
Published: (2025)

Feature Structure Distillation with Centered Kernel Alignment in BERT Transferring
by: Jung, Hee-Jun, et al.
Published: (2022)

A Lightweight Multi Aspect Controlled Text Generation Solution For Large Language Models
by: Zhang, Chenyang, et al.
Published: (2024)

MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Models
by: Liu, Mianxin, et al.
Published: (2024)

No Mean Feat: Simple, Strong Baselines for Context Compression
by: Feldman, Yair, et al.
Published: (2025)

Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
by: Xu, Derong, et al.
Published: (2024)

CA-BERT: Leveraging Context Awareness for Enhanced Multi-Turn Chat Interaction
by: Liu, Minghao, et al.
Published: (2024)