Image de couverture de livre

Novel-WD: Exploring acquisition of Novel World Knowledge in LLMs Using Prefix-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Méloux, Maxime, Cerisara, Christophe
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Ladder Up, Memory Down: Low-Cost Fine-Tuning With Side Nets
par: Zheng, Estelle, et autres
Publié: (2025)

Mechanistic Interpretability as Statistical Estimation: A Variance Analysis
par: Méloux, Maxime, et autres
Publié: (2025)

Everything, Everywhere, All at Once: Is Mechanistic Interpretability Identifiable?
par: Méloux, Maxime, et autres
Publié: (2025)

Evaluating LLMs for Quotation Attribution in Literary Texts: A Case Study of LLaMa3
par: Michel, Gaspard, et autres
Publié: (2024)

PrefixMemory-Tuning: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention
par: Wang, Haonan, et autres
Publié: (2025)

Cross-lingual Matryoshka Representation Learning across Speech and Text
par: Sy, Yaya, et autres
Publié: (2026)

BaldWhisper: Faster Whisper with Head Shearing and Layer Merging
par: Sy, Yaya, et autres
Publié: (2025)

L-TUNING: Synchronized Label Tuning for Prompt and Prefix in LLMs
par: Kowsher, Md., et autres
Publié: (2023)

Distinguishing Fictional Voices: a Study of Authorship Verification Models for Quotation Attribution
par: Michel, Gaspard, et autres
Publié: (2024)

Improving Quotation Attribution with Fictional Character Embeddings
par: Michel, Gaspard, et autres
Publié: (2024)

Computational Narrative Understanding for Expressive Text-to-Speech
par: Michel, Gaspard, et autres
Publié: (2025)

S-VoCAL: A Dataset and Evaluation Framework for Inferring Speaking Voice Character Attributes in Literature
par: Berthe-Pardo, Abigail, et autres
Publié: (2026)

Mix-Initiative Response Generation with Dynamic Prefix Tuning
par: Nie, Yuxiang, et autres
Publié: (2024)

How Does Prefix Matter in Reasoning Model Tuning?
par: Tomar, Raj Vardhan, et autres
Publié: (2026)

Speech Language Models for Under-Represented Languages: Insights from Wolof
par: Sy, Yaya, et autres
Publié: (2025)

GraphLit: Learning Text-Enriched Dynamic Character Network Representations for Literary Study
par: Michel, Gaspard, et autres
Publié: (2026)

CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification
par: Li, Yang, et autres
Publié: (2022)

Fine-Tuning vs. RAG for Multi-Hop Question Answering with Novel Knowledge
par: Yang, Zhuoyi, et autres
Publié: (2026)

Path-Consistency with Prefix Enhancement for Efficient Inference in LLMs
par: Zhu, Jiace, et autres
Publié: (2024)

Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling
par: Huang, Zeyu, et autres
Publié: (2025)

Context-aware Visual Storytelling with Visual Prefix Tuning and Contrastive Learning
par: Song, Yingjin, et autres
Publié: (2024)

LIFT: A Novel Framework for Enhancing Long-Context Understanding of LLMs via Long Input Fine-Tuning
par: Mao, Yansheng, et autres
Publié: (2025)

SAND-Math: Using LLMs to Generate Novel, Difficult and Useful Mathematics Questions and Answers
par: Manem, Chaitanya, et autres
Publié: (2025)

LLMs in Education: Novel Perspectives, Challenges, and Opportunities
par: Alhafni, Bashar, et autres
Publié: (2024)

Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMs
par: Jin, Ruihan, et autres
Publié: (2026)

Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains
par: Yuan, Zhonghang, et autres
Publié: (2026)

Ancient Greek to Modern Greek Machine Translation: A Novel Benchmark and Fine-Tuning Experiments on LLMs and NMT Models
par: Mavromatis, Spyridon, et autres
Publié: (2026)

A Novel Hierarchical Multi-Agent System for Payments Using LLMs
par: Chua, Joon Kiat, et autres
Publié: (2026)

When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations
par: Petrov, Aleksandar, et autres
Publié: (2023)

Editing Knowledge Representation of Language Model via Rephrased Prefix Prompts
par: Cai, Yuchen, et autres
Publié: (2024)

Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?
par: Gekhman, Zorik, et autres
Publié: (2024)

Prefix Parsing is Just Parsing
par: Pasti, Clemente, et autres
Publié: (2026)

Speech Prefix-Tuning with RNNT Loss for Improving LLM Predictions
par: Baskar, Murali Karthick, et autres
Publié: (2024)

Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning
par: Wang, Jianing, et autres
Publié: (2023)

PrefixQuant: Eliminating Outliers by Prefixed Tokens for Large Language Models Quantization
par: Chen, Mengzhao, et autres
Publié: (2024)

Enhancing Short-Text Topic Modeling with LLM-Driven Context Expansion and Prefix-Tuned VAEs
par: Akash, Pritom Saha, et autres
Publié: (2024)

Exploring Robustness of Multilingual LLMs on Real-World Noisy Data
par: Aliakbarzadeh, Amirhossein, et autres
Publié: (2025)

The First Few Tokens Are All You Need: An Efficient and Effective Unsupervised Prefix Fine-Tuning Method for Reasoning Models
par: Ji, Ke, et autres
Publié: (2025)

KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledge
par: Jiang, Pengcheng, et autres
Publié: (2024)

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
par: Lee, Nicholas, et autres
Publié: (2024)