Cover Image

Comparing Template-based and Template-free Language Model Probing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shaier, Sagi, Bennett, Kevin, Hunter, Lawrence E, von der Wense, Katharina
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MALAMUTE: A Multilingual, Highly-granular, Template-free, Education-based Probing Dataset
by: Shaier, Sagi, et al.
Published: (2024)

Who Are All The Stochastic Parrots Imitating? They Should Tell Us!
by: Shaier, Sagi, et al.
Published: (2023)

Desiderata for the Context Use of Question Answering Systems
by: Shaier, Sagi, et al.
Published: (2024)

It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension
by: Shaier, Sagi, et al.
Published: (2024)

Lost in the Middle, and In-Between: Enhancing Language Models' Ability to Reason Over Long Contexts in Multi-Hop QA
by: Baker, George Arthur, et al.
Published: (2024)

More Experts Than Galaxies: Conditionally-overlapping Experts With Biologically-Inspired Fixed Routing
by: Shaier, Sagi, et al.
Published: (2024)

Asking Again and Again: Exploring LLM Robustness to Repeated Questions
by: Shaier, Sagi, et al.
Published: (2024)

Excitation: Momentum For Experts
by: Shaier, Sagi
Published: (2026)

Training and Evaluating Language Models with Template-based Data Generation
by: Zhang, Yifan
Published: (2024)

TemplateRL: Structured Template-Guided Reinforcement Learning for LLM Reasoning
by: Wu, Jinyang, et al.
Published: (2025)

From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation
by: Marashian, Ali, et al.
Published: (2024)

RingSQL: Generating Synthetic Data with Schema-Independent Templates for Text-to-SQL Reasoning Models
by: Sterbentz, Marko, et al.
Published: (2026)

Template-Based Probes Are Imperfect Lenses for Counterfactual Bias Evaluation in LLMs
by: Kohankhaki, Farnaz, et al.
Published: (2024)

Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citations
by: Shaier, Sagi, et al.
Published: (2024)

Evaluating the Robustness of Adverse Drug Event Classification Models Using Templates
by: MacPhail, Dorothea, et al.
Published: (2024)

Mitigating Label Length Bias in Large Language Models
by: Sanz-Guerrero, Mario, et al.
Published: (2025)

Corrective In-Context Learning: Evaluating Self-Correction in Large Language Models
by: Sanz-Guerrero, Mario, et al.
Published: (2025)

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates
by: Sakai, Yusuke, et al.
Published: (2024)

Copy-Augmented Representation for Structure Invariant Template-Free Retrosynthesis
by: Zhuang, Jiaxi, et al.
Published: (2025)

MMUTF: Multimodal Multimedia Event Argument Extraction with Unified Template Filling
by: Seeberger, Philipp, et al.
Published: (2024)

Model-Based Ranking of Source Languages for Zero-Shot Cross-Lingual Transfer
by: Ebrahimi, Abteen, et al.
Published: (2025)

Single-Position Intervention Fails: Distributed Output Templates Drive In-Context Learning
by: Cheng, Bryan, et al.
Published: (2026)

Improving Low-Resource Morphological Inflection via Self-Supervised Objectives
by: Wiemerslage, Adam, et al.
Published: (2025)

Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language Models
by: Bui, Minh Duc, et al.
Published: (2024)

ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templates
by: Yang, Ling, et al.
Published: (2025)

Interdisciplinary Research in Conversation: A Case Study in Computational Morphology for Language Documentation
by: Rice, Enora, et al.
Published: (2025)

Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates
by: Lyu, Kaifeng, et al.
Published: (2024)

Clustering Internet Memes Through Template Matching and Multi-Dimensional Similarity
by: Bloem, Tygo, et al.
Published: (2025)

The Trade-off between Performance, Efficiency, and Fairness in Adapter Modules for Text Classification
by: Bui, Minh Duc, et al.
Published: (2024)

ARC-TGI: Human-Validated Task Generators with Reasoning Chain Templates for ARC-AGI
by: Lehmann, Jens, et al.
Published: (2026)

GAPMAP: Mapping Scientific Knowledge Gaps in Biomedical Literature Using Large Language Models
by: Salem, Nourah M, et al.
Published: (2025)

TPLogAD: Unsupervised Log Anomaly Detection Based on Event Templates and Key Parameters
by: Lu, Jiawei, et al.
Published: (2024)

Bias in LLMs as Annotators: The Effect of Party Cues on Labelling Decision by Large Language Models
by: Vera, Sebastian Vallejo, et al.
Published: (2024)

Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts
by: Ahrac, Sagi, et al.
Published: (2026)

Meenz bleibt Meenz, but Large Language Models Do Not Speak Its Dialect
by: Bui, Minh Duc, et al.
Published: (2026)

BioCoref: Benchmarking Biomedical Coreference Resolution with LLMs
by: Salem, Nourah M, et al.
Published: (2025)

Untangling the Influence of Typology, Data and Model Architecture on Ranking Transfer Languages for Cross-Lingual POS Tagging
by: Rice, Enora, et al.
Published: (2025)

Large Language Models Discriminate Against Speakers of German Dialects
by: Bui, Minh Duc, et al.
Published: (2025)

Automated Unity Game Template Generation from GDDs via NLP and Multi-Modal LLMs
by: Hassan, Amna
Published: (2025)

Temporally Consistent Factuality Probing for Large Language Models
by: Bajpai, Ashutosh, et al.
Published: (2024)