Copertina

From Robustness to Improved Generalization and Calibration in Pre-trained Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jukić, Josip, Šnajder, Jan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Disentangling Latent Shifts of In-Context Learning with Weak Supervision
di: Jukić, Josip, et al.
Pubblicazione: (2024)

Context Parametrization with Compositional Adapters
di: Jukić, Josip, et al.
Pubblicazione: (2025)

Improving Data and Parameter Efficiency of Neural Language Models Using Representation Analysis
di: Jukić, Josip
Pubblicazione: (2025)

Out-of-Distribution Detection by Leveraging Between-Layer Transformation Smoothness
di: Jelenić, Fran, et al.
Pubblicazione: (2023)

Claim Check-Worthiness Detection: How Well do LLMs Grasp Annotation Guidelines?
di: Majer, Laura, et al.
Pubblicazione: (2024)

Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labeling
di: Dukić, David, et al.
Pubblicazione: (2024)

Sequence Repetition Enhances Token Embeddings and Improves Sequence Labeling with Decoder-only Language Models
di: Kukić, Matija Luka, et al.
Pubblicazione: (2026)

Supervised In-Context Fine-Tuning for Generative Sequence Labeling
di: Dukić, David, et al.
Pubblicazione: (2025)

Characterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings
di: Dukić, David, et al.
Pubblicazione: (2025)

Leveraging Open Information Extraction for More Robust Domain Transfer of Event Trigger Detection
di: Dukić, David, et al.
Pubblicazione: (2023)

Are ELECTRA's Sentence Embeddings Beyond Repair? The Case of Semantic Textual Similarity
di: Rep, Ivan, et al.
Pubblicazione: (2024)

LLMs for Targeted Sentiment in News Headlines: Exploring the Descriptive-Prescriptive Dilemma
di: Juroš, Jana, et al.
Pubblicazione: (2024)

Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
di: Guo, Xu, et al.
Pubblicazione: (2026)

What Makes You CLIC: Detection of Croatian Clickbait Headlines
di: Anđelić, Marija, et al.
Pubblicazione: (2025)

TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models
di: Yan, Junbing, et al.
Pubblicazione: (2024)

Aligning Pre-trained Models for Spoken Language Translation
di: Sedláček, Šimon, et al.
Pubblicazione: (2024)

TakeLab Retriever: AI-Driven Search Engine for Articles from Croatian News Outlets
di: Dukić, David, et al.
Pubblicazione: (2024)

Improving Transfer Learning for Sequence Labeling Tasks by Adapting Pre-trained Neural Language Models
di: Dukić, David
Pubblicazione: (2025)

From N-grams to Pre-trained Multilingual Models For Language Identification
di: Sindane, Thapelo, et al.
Pubblicazione: (2024)

On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation
di: Wu, Di, et al.
Pubblicazione: (2024)

On The Origin of Cultural Biases in Language Models: From Pre-training Data to Linguistic Phenomena
di: Naous, Tarek, et al.
Pubblicazione: (2025)

Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study
di: Wu, Di, et al.
Pubblicazione: (2022)

Development of Cognitive Intelligence in Pre-trained Language Models
di: Shah, Raj Sanjay, et al.
Pubblicazione: (2024)

Metadata Conditioning Accelerates Language Model Pre-training
di: Gao, Tianyu, et al.
Pubblicazione: (2025)

Evaluating Discourse Cohesion in Pre-trained Language Models
di: He, Jie, et al.
Pubblicazione: (2025)

Performance Trade-offs of Optimizing Small Language Models for E-Commerce
di: Licardo, Josip Tomo, et al.
Pubblicazione: (2025)

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization
di: Zhang, Haode, et al.
Pubblicazione: (2022)

B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainability
di: Wang, Yifan, et al.
Pubblicazione: (2025)

SongSage: A Large Musical Language Model with Lyric Generative Pre-training
di: Guo, Jiani, et al.
Pubblicazione: (2026)

G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks
di: Wan, Zhongwei, et al.
Pubblicazione: (2022)

Calibrating Pre-trained Language Classifiers on LLM-generated Noisy Labels via Iterative Refinement
di: Ye, Liqin, et al.
Pubblicazione: (2025)

RepCali: High Efficient Fine-tuning Via Representation Calibration in Latent Space for Pre-trained Language Models
di: Zhang, Fujun, et al.
Pubblicazione: (2025)

Bag of Lies: Robustness in Continuous Pre-training BERT
di: Gevers, Ine, et al.
Pubblicazione: (2024)

From Unfamiliar to Familiar: Detecting Pre-training Data via Gradient Deviations in Large Language Models
di: Zhang, Ruiqi, et al.
Pubblicazione: (2026)

Stable Language Model Pre-training by Reducing Embedding Variability
di: Chung, Woojin, et al.
Pubblicazione: (2024)

Tracr-Injection: Distilling Algorithms into Pre-trained Language Models
di: Vergara-Browne, Tomás, et al.
Pubblicazione: (2025)

How Ready Are Generative Pre-trained Large Language Models for Explaining Bengali Grammatical Errors?
di: Maity, Subhankar, et al.
Pubblicazione: (2024)

Model Merging in Pre-training of Large Language Models
di: Li, Yunshui, et al.
Pubblicazione: (2025)

PrahokBART: A Pre-trained Sequence-to-Sequence Model for Khmer Natural Language Generation
di: Kaing, Hour, et al.
Pubblicazione: (2025)

From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan
di: Yang, Lei, et al.
Pubblicazione: (2025)