Cover Image

Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning Strategies

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Koloski, Boshko, Škrlj, Blaž, Robnik-Šikonja, Marko, Pollak, Senja
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Symbolic to Neural and Back: Exploring Knowledge Graph-Large Language Model Synergies
by: Škrlj, Blaž, et al.
Published: (2025)

Incremental Graph Construction Enables Robust Spectral Clustering of Texts
by: Pranjić, Marko, et al.
Published: (2026)

FuDoBa: Fusing Document and Knowledge Graph-based Representations with Bayesian Optimisation
by: Koloski, Boshko, et al.
Published: (2025)

AutoML-guided Fusion of Entity and LLM-based Representations for Document Classification
by: Koloski, Boshko, et al.
Published: (2024)

TT-XAI: Trustworthy Clinical Text Explanations via Keyword Distillation and LLM Reasoning
by: Miok, Kristian, et al.
Published: (2025)

HorNets: Learning from Discrete and Continuous Signals with Routing Neural Networks
by: Koloski, Boshko, et al.
Published: (2025)

Challenges in Explaining Pretrained Clinical Text Classifiers
by: Miok, Kristian, et al.
Published: (2026)

Sarcasm Detection in a Less-Resourced Language
by: Đoković, Lazar, et al.
Published: (2024)

SEKE: Specialised Experts for Keyword Extraction
by: Martinc, Matej, et al.
Published: (2024)

Environmental, Social and Governance Sentiment Analysis on Slovene News: A Novel Dataset and Models
by: Dodig, Paula, et al.
Published: (2026)

A Computational Analysis of the Dehumanisation of Migrants from Syria and Ukraine in Slovene News Media
by: Caporusso, Jaya, et al.
Published: (2024)

LLM Embeddings for Deep Learning on Tabular Data
by: Koloski, Boshko, et al.
Published: (2025)

Evaluating and explaining training strategies for zero-shot cross-lingual news sentiment analysis
by: Andrenšek, Luka, et al.
Published: (2024)

Multi-Task Learning for Features Extraction in Financial Annual Reports
by: Montariol, Syrielle, et al.
Published: (2024)

Building a Strong Instruction Language Model for a Less-Resourced Language
by: Vreš, Domen, et al.
Published: (2026)

Solving Word-Sense Disambiguation and Word-Sense Induction with Dictionary Examples
by: Škvorc, Tadej, et al.
Published: (2025)

Retrieval-augmented code completion for local projects using large language models
by: Hostnik, Marko, et al.
Published: (2024)

QFS-Composer: Query-focused summarization pipeline for less resourced languages
by: Đuranović, Vuk, et al.
Published: (2026)

Evolutionary Strategies lead to Catastrophic Forgetting in LLMs
by: Abdi, Immanuel, et al.
Published: (2026)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
by: Ren, Weijieying, et al.
Published: (2024)

Multilingual Cognitive Impairment Detection in the Era of Foundation Models
by: Hoogland, Damar, et al.
Published: (2026)

Improving LLMs for Machine Translation Using Synthetic Preference Data
by: Vajda, Dario, et al.
Published: (2025)

Transformer verbatim in-context retrieval across time and scale
by: Armeni, Kristijan, et al.
Published: (2024)

Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting
by: Watts, Ishaan, et al.
Published: (2026)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
by: Fawi, Muhammad
Published: (2024)

Large language models for folktale type automation based on motifs: Cinderella case study
by: Arčon, Tjaša, et al.
Published: (2025)

Understanding Catastrophic Forgetting in Language Models via Implicit Inference
by: Kotha, Suhas, et al.
Published: (2023)

Mitigating Catastrophic Forgetting in Mathematical Reasoning Finetuning through Mixed Training
by: Reynolds, John Graham
Published: (2025)

Review of Natural Language Processing in Pharmacology
by: Trajanov, Dimitar, et al.
Published: (2022)

Real-time News Story Identification
by: Škvorc, Tadej, et al.
Published: (2025)

Evaluating Metalinguistic Knowledge in Large Language Models across the World's Languages
by: Arčon, Tjaša, et al.
Published: (2026)

Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching
by: Li, Zhuoran, et al.
Published: (2024)

CREST: Universal Safety Guardrails Through Cluster-Guided Cross-Lingual Transfer
by: Bansal, Lavish, et al.
Published: (2025)

Attractor Patch Networks: Reducing Catastrophic Forgetting with Routed Low-Rank Patch Experts
by: Shashank
Published: (2026)

Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers
by: Kenneweg, Philip, et al.
Published: (2024)

Language-specific Neurons Do Not Facilitate Cross-Lingual Transfer
by: Mondal, Soumen Kumar, et al.
Published: (2025)

DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer
by: Simon, Sona Elza, et al.
Published: (2025)

Can Embedding Similarity Predict Cross-Lingual Transfer? A Systematic Study on African Languages
by: Idris, Tewodros Kederalah, et al.
Published: (2026)

Neural spell-checker: Beyond words with synthetic data generation
by: Klemen, Matej, et al.
Published: (2024)

Universal Cross-Lingual Text Classification
by: Savant, Riya, et al.
Published: (2024)