Cover Image

Improving QA Efficiency with DistilBERT: Fine-Tuning and Inference on mobile Intel CPUs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Yinkfu, Ngeyen
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring Variability in Fine-Tuned Models for Text Classification with DistilBERT
by: Lorenzoni, Giuliano, et al.
Published: (2024)

An investigation of structures responsible for gender bias in BERT and DistilBERT
by: Leteno, Thibaud, et al.
Published: (2024)

Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews
by: Christian, William, et al.
Published: (2025)

Analyzing Examinee Comments using DistilBERT and Machine Learning to Ensure Quality Control in Exam Content
by: Ye, et al.
Published: (2025)

Lightweight Baselines for Medical Abstract Classification: DistilBERT with Cross-Entropy as a Strong Default
by: Liu, Jiaqi, et al.
Published: (2025)

Tracking Emotional Dynamics in Chat Conversations: A Hybrid Approach using DistilBERT and Emoji Sentiment Analysis
by: Igali, Ayan, et al.
Published: (2024)

Exploring Genre and Success Classification through Song Lyrics using DistilBERT: A Fun NLP Venture
by: Martinez, Servando Pizarro, et al.
Published: (2024)

Visualizing Public Opinion on X: A Real-Time Sentiment Dashboard Using VADER and DistilBERT
by: Reddy, Yanampally Abhiram, et al.
Published: (2025)

Comparative Analysis of YOLOv5, Faster R-CNN, SSD, and RetinaNet for Motorbike Detection in Kigali Autonomous Driving Context
by: Yinkfu, Ngeyen, et al.
Published: (2025)

Inference Acceleration for Large Language Models on CPUs
by: PS, Ditto, et al.
Published: (2024)

Energy and Carbon Considerations of Fine-Tuning BERT
by: Wang, Xiaorong, et al.
Published: (2023)

Highly Optimized Kernels and Fine-Grained Codebooks for LLM Inference on Arm CPUs
by: Gope, Dibakar, et al.
Published: (2024)

ACL: Aligned Contrastive Learning Improves BERT and Multi-exit BERT Fine-tuning
by: Li, Liz, et al.
Published: (2026)

NITRO: LLM Inference on Intel Laptop NPUs
by: Fei, Anthony, et al.
Published: (2024)

Enhancing BERT Fine-Tuning for Sentiment Analysis in Lower-Resourced Languages
by: Kubík, Jozef, et al.
Published: (2025)

SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation
by: Lv, Changze, et al.
Published: (2023)

ArcLight: A Lightweight LLM Inference Architecture for Many-Core CPUs
by: Xu, Yuzhuang, et al.
Published: (2026)

Healing Powers of BERT: How Task-Specific Fine-Tuning Recovers Corrupted Language Models
by: Han, Shijie, et al.
Published: (2024)

MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussions
by: Preniqi, Vjosa, et al.
Published: (2024)

Composable NLP Workflows for BERT-based Ranking and QA System
by: Kumar, Gaurav, et al.
Published: (2025)

Litespark Inference on Consumer CPUs: Custom SIMD Kernels for Ternary Neural Networks
by: Dade, Nii Osae Osae, et al.
Published: (2026)

ExHuBERT: Enhancing HuBERT Through Block Extension and Fine-Tuning on 37 Emotion Datasets
by: Amiriparian, Shahin, et al.
Published: (2024)

Improving Sampling Methods for Fine-tuning SentenceBERT in Text Streams
by: Garcia, Cristiano Mesquita, et al.
Published: (2024)

Domain Fine-Tuning FinBERT on Finnish Histopathological Reports: Train-Time Signals and Downstream Correlations
by: Luisto, Rami, et al.
Published: (2026)

In-Context Learning Distillation for Efficient Few-Shot Fine-Tuning
by: Duan, Yifei, et al.
Published: (2024)

Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
by: Siriwardhana, Shamane, et al.
Published: (2020)

Deep Learning for Medical Text Processing: BERT Model Fine-Tuning and Comparative Study
by: Hu, Jiacheng, et al.
Published: (2024)

Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
by: Hościłowicz, Jakub, et al.
Published: (2023)

Long-Document QA with Chain-of-Structured-Thought and Fine-Tuned SLMs
by: Liang, Zhuowen, et al.
Published: (2026)

Beyond QA Pairs: Assessing Parameter-Efficient Fine-Tuning for Fact Embedding in LLMs
by: Ratnakar, Shivam, et al.
Published: (2025)

Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning
by: Yang, Zhaorui, et al.
Published: (2024)

Benchmarking Logistic Regression, SVM, Naive Bayes, and IndoBERT Fine-Tuning for Sentiment Analysis on Indonesian Product Reviews
by: Zahra, Nabila Zakiyah, et al.
Published: (2026)

Optimized Quran Passage Retrieval Using an Expanded QA Dataset and Fine-Tuned Language Models
by: Basem, Mohamed, et al.
Published: (2024)

Skill-Aware Data Selection and Fine-Tuning for Data-Efficient Reasoning Distillation
by: Zhang, Lechen, et al.
Published: (2026)

Fine-Tuning BERT for Domain-Specific Question Answering: Toward Educational NLP Resources at University Scale
by: Montfrond, Aurélie
Published: (2025)

Memorization of Named Entities in Fine-tuned BERT Models
by: Diera, Andor, et al.
Published: (2022)

Benchmarking PyCaret AutoML Against IndoBERT Fine-Tuning for Sentiment Analysis on Indonesian IKN Twitter Data
by: Mayzaroh, Mutia Alfi, et al.
Published: (2026)

1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs
by: Wang, Jinheng, et al.
Published: (2024)

Weight-Inherited Distillation for Task-Agnostic BERT Compression
by: Wu, Taiqiang, et al.
Published: (2023)

Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models
by: Li, Zeman, et al.
Published: (2024)