Cover Image

Fine-Tuning Transformers: Vocabulary Transfer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mosin, Vladislav, Samenko, Igor, Tikhonov, Alexey, Kozlovskii, Borislav, Yamshchikov, Ivan P.
Format:	Preprint
Published:	2021
Subjects:	Computation and Language Artificial Intelligence Machine Learning 68T50, 91F20 I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Smotrom tvoja pa ander drogoj verden! Resurrecting Dead Pidgin with Generative Models: Russenorsk Case Study
by: Tikhonov, Alexey, et al.
Published: (2025)

Unveiling factors influencing judgment variation in Sentiment Analysis with Natural Language Processing and Statistics
by: Kellert, Olga, et al.
Published: (2024)

What is Wrong with Language Models that Can Not Tell a Story?
by: Yamshchikov, Ivan P., et al.
Published: (2022)

Vocabulary Transfer for Biomedical Texts: Add Tokens if You Can Not Add Data
by: Singh, Priyanka, et al.
Published: (2022)

Branching Narratives: Character Decision Points Detection
by: Tikhonov, Alexey
Published: (2024)

Large Language Models are Inconsistent and Biased Evaluators
by: Stureborg, Rickard, et al.
Published: (2024)

PLUGH: A Benchmark for Spatial Understanding and Reasoning in Large Language Models
by: Tikhonov, Alexey
Published: (2024)

Moral Semantics Survive Machine Translation: Cross-Lingual Evidence from Moral Foundations Corpora
by: Skorski, Maciej
Published: (2026)

Extracting Abstraction Dimensions by Identifying Syntax Pattern from Texts
by: Zhou, Jian, et al.
Published: (2025)

lmfaoooo at SemEval-2026 Task 1: Humor Is an Audience. Preference Modeling for Constrained Humor Generation
by: Tikhonov, Alexey, et al.
Published: (2026)

Tailoring Vaccine Messaging with Common-Ground Opinions
by: Stureborg, Rickard, et al.
Published: (2024)

Increasing the Difficulty of Automatically Generated Questions via Reinforcement Learning with Synthetic Preference
by: Thorne, William, et al.
Published: (2024)

What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluations
by: Manohar, Kavya, et al.
Published: (2024)

BERT in Plutarch's Shadows
by: Yamshchikov, Ivan P., et al.
Published: (2022)

Generative AI and Large Language Models in Language Preservation: Opportunities and Challenges
by: Koc, Vincent
Published: (2025)

NERCat: Fine-Tuning for Enhanced Named Entity Recognition in Catalan
by: Ferreres, Guillem Cadevall, et al.
Published: (2025)

MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning
by: Ren, Pengjie, et al.
Published: (2024)

Humor Mechanics: Advancing Humor Generation with Multistep Reasoning
by: Tikhonov, Alexey, et al.
Published: (2024)

Prompt Tuned Embedding Classification for Multi-Label Industry Sector Allocation
by: Buchner, Valentin Leonhard, et al.
Published: (2023)

Modeling Story Expectations to Understand Engagement: A Generative Framework Using LLMs
by: Fong, Hortense, et al.
Published: (2024)

Prompt-Efficient Fine-Tuning for GPT-like Deep Models to Reduce Hallucination and to Improve Reproducibility in Scientific Text Generation Using Stochastic Optimisation Techniques
by: Sulimov, Daniil
Published: (2024)

An Integrated Framework of Prompt Engineering and Multidimensional Knowledge Graphs for Legal Dispute Analysis
by: Zhang, Mingda, et al.
Published: (2025)

Shift-Reduce Task-Oriented Semantic Parsing with Stack-Transformers
by: Fernández-González, Daniel
Published: (2022)

Exploiting Pre-trained Encoder-Decoder Transformers for Sequence-to-Sequence Constituent Parsing
by: Fernández-González, Daniel, et al.
Published: (2026)

Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languages
by: Alam, Firoj, et al.
Published: (2026)

SAGED: A Holistic Bias-Benchmarking Pipeline for Language Models with Customisable Fairness Calibration
by: Guan, Xin, et al.
Published: (2024)

LLM-Based Multi-Task Bangla Hate Speech Detection: Type, Severity, and Target
by: Hasan, Md Arid, et al.
Published: (2025)

PropXplain: Can LLMs Enable Explainable Propaganda Detection?
by: Hasanain, Maram, et al.
Published: (2025)

Sinhala Transliteration: A Comparative Analysis Between Rule-based and Seq2Seq Approaches
by: De Mel, Yomal, et al.
Published: (2024)

Large Language Models for Propaganda Span Annotation
by: Hasanain, Maram, et al.
Published: (2023)

Targeted Lexical Injection: Unlocking Latent Cross-Lingual Alignment in Lugha-Llama via Early-Layer LoRA Fine-Tuning
by: Ngugi, Stanley
Published: (2025)

Distilling Large Language Models for Efficient Clinical Information Extraction
by: Vedula, Karthik S., et al.
Published: (2024)

PaperAudit-Bench: Benchmarking Error Detection in Research Papers for Critical Automated Peer Review
by: Tu, Songjun, et al.
Published: (2026)

An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT
by: Ma, Chong, et al.
Published: (2023)

Co-NAML-LSTUR: A Combined Model with Attentive Multi-View Learning and Long- and Short-term User Representations for News Recommendation
by: Nguyen, Minh Hoang, et al.
Published: (2025)

Named entity recognition for Serbian legal documents: Design, methodology and dataset development
by: Kalušev, Vladimir, et al.
Published: (2025)

Large Language Models Report Subjective Experience Under Self-Referential Processing
by: Berg, Cameron, et al.
Published: (2025)

Chatbots put to the test in math and logic problems: A preliminary comparison and assessment of ChatGPT-3.5, ChatGPT-4, and Google Bard
by: Plevris, Vagelis, et al.
Published: (2023)

XAutoLM: Efficient Fine-Tuning of Language Models via Meta-Learning and AutoML
by: Estevanell-Valladares, Ernesto L., et al.
Published: (2025)

Approaches to Semantic Textual Similarity in Slovak Language: From Algorithms to Transformers
by: Radosky, Lukas, et al.
Published: (2026)