Cover Image

Fine-Tuning Large Language Models with QLoRA for Offensive Language Detection in Roman Urdu-English Code-Mixed Text

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hussain, Nisar, Qasim, Amna, Mehak, Gull, Zain, Muhammad, Hafeez, Momina, Sidorov, Grigori
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Irony Detection in Urdu Text: A Comparative Study Using Machine Learning Models and Large Language Models
by: Ahmad, Fiaz, et al.
Published: (2025)

Internalizing Tool Knowledge in Small Language Models via QLoRA Fine-Tuning
by: Shemla, Yuval, et al.
Published: (2026)

Parameter-Efficient Fine-Tuning for HAR: Integrating LoRA and QLoRA into Transformer Models
by: Seregina, Irina, et al.
Published: (2025)

Hope Speech Detection in code-mixed Roman Urdu tweets: A Positive Turn in Natural Language Processing
by: Ahmad, Muhammad, et al.
Published: (2025)

Profiling LoRA/QLoRA Fine-Tuning Efficiency on Consumer GPUs: An RTX 4060 Case Study
by: Avinash, MSR
Published: (2025)

CARE: A QLoRA-Fine Tuned Multi-Domain Chatbot With Fast Learning On Minimal Hardware
by: Dutta, Ankit, et al.
Published: (2025)

LLaMA-XR: A Novel Framework for Radiology Report Generation using LLaMA and QLoRA Fine Tuning
by: Jahangir, Md. Zihad Bin, et al.
Published: (2025)

QU-NLP at QIAS 2026: Multi-Stage QLoRA Fine-Tuning for Arabic Islamic Inheritance Reasoning
by: AL-Smadi, Mohammad
Published: (2026)

Lightweight Clinical Decision Support System using QLoRA-Fine-Tuned LLMs and Retrieval-Augmented Generation
by: Ansari, Mohammad Shoaib, et al.
Published: (2025)

Output Composability of QLoRA PEFT Modules for Plug-and-Play Attribute-Controlled Text Generation
by: Lorandi, Michela, et al.
Published: (2026)

Adapting Large Language Models to a Low-Resource Agglutinative Language: A Comparative Study of LoRA and QLoRA for Bashkir
by: Arabov, Mullosharaf K., et al.
Published: (2026)

Bailong: Bilingual Transfer Learning based on QLoRA and Zip-tie Embedding
by: Chen, Lung-Chuan, et al.
Published: (2024)

Can Post-Training Quantization Benefit from an Additional QLoRA Integration?
by: Zhu, Xiliang, et al.
Published: (2025)

From Baselines to Preferences: A Comparative Study of LoRA/QLoRA and Preference Optimization for Mental Health Text Classification
by: Arcan, Mihael
Published: (2026)

Viz: A QLoRA-based Copyright Marketplace for Legally Compliant Generative AI
by: Sarkar, Dipankar
Published: (2023)

Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approach
by: Ni, Haowei, et al.
Published: (2024)

Efficient Telecom Specific LLM: TSLAM-Mini with QLoRA and Digital Twin Data
by: Ethiraj, Vignesh, et al.
Published: (2025)

Speaker attribution in German parliamentary debates with QLoRA-adapted large language models
by: Bornheim, Tobias, et al.
Published: (2023)

Advancing Sentiment Analysis in Tamil-English Code-Mixed Texts: Challenges and Transformer-Based Solutions
by: Krasitskii, Mikhail, et al.
Published: (2025)

ROMA: a Read-Only-Memory-based Accelerator for QLoRA-based On-Device LLM
by: Wang, Wenqiang, et al.
Published: (2025)

EdgeNav-QE: QLoRA Quantization and Dynamic Early Exit for LAM-based Navigation on Edge Devices
by: Liu, Mengyun, et al.
Published: (2026)

Exploring Fact Memorization and Style Imitation in LLMs Using QLoRA: An Experimental Study and Quality Assessment Methods
by: Vyborov, Eugene, et al.
Published: (2024)

QU-NLP at ArchEHR-QA 2026: Two-Stage QLoRA Fine-Tuning of Qwen3-4B for Patient-Oriented Clinical Question Answering and Evidence Sentence Alignment
by: AL-Smadi, Mohammad
Published: (2026)

ERUPD -- English to Roman Urdu Parallel Dataset
by: Furqan, Mohammed, et al.
Published: (2024)

Soft Similarity and Soft Cosine Measure: Similarity of Features in Vector Space Model
by: Grigori Sidorov
Published: (2014)

Detección automática de similitud de los programas en el lenguaje de programación Karel basado en técnicas de procesamiento de lenguaje natural
by: Grigori Sidorov
Published: (2016)

N-gramas sintácticos no-continuos
by: Grigori Sidorov
Published: (2013)

Editorial
by: Grigori Sidorov
Published: (2012)

Modelo computacional del diálogo basado en reglas aplicado a un robot guía móvil
by: Grigori Sidorov
Published: (2014)

Editorial
by: Grigori Sidorov
Published: (2012)

Overcoming linguistic barriers in code assistants: creating a QLoRA adapter to improve support for Russian-language code writing instructions
by: Pronin, C. B., et al.
Published: (2024)

Fake News Classification in Urdu: A Domain Adaptation Approach for a Low-Resource Language
by: Ali, Muhammad Zain, et al.
Published: (2025)

Suppressing Domain-Specific Hallucination in Construction LLMs: A Knowledge Graph Foundation for GraphRAG and QLoRA on River and Sediment Control Technical Standards
by: Yasuno, Takato
Published: (2026)

Multilingual Sentiment Analysis of Summarized Texts: A Cross-Language Study of Text Shortening Effects
by: Krasitskii, Mikhail, et al.
Published: (2025)

UrduFactCheck: An Agentic Fact-Checking Framework for Urdu with Evidence Boosting and Benchmarking
by: Ahmad, Sarfraz, et al.
Published: (2025)

UrduLM: A Resource-Efficient Monolingual Urdu Language Model
by: Ali, Syed Muhammad, et al.
Published: (2026)

ULTRA:Urdu Language Transformer-based Recommendation Architecture
by: Bashir, Alishbah, et al.
Published: (2026)

Leveraging Large Language Models for Multi-Class and Multi-Label Detection of Drug Use and Overdose Symptoms on Social Media
by: Ahmad, Muhammad, et al.
Published: (2025)

Detection of Human and Machine-Authored Fake News in Urdu
by: Ali, Muhammad Zain, et al.
Published: (2024)

MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
by: Li, Dengchun, et al.
Published: (2024)