Cover Image

Faster, Cheaper, More Accurate: Specialised Knowledge Tracing Models Outperform LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bhattacharyya, Prarthana, Mitton, Joshua, Abboud, Ralph, Woodhead, Simon
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Knowing When to Defer: Selective Prediction for Responsible Knowledge Tracing
by: Mitton, Joshua, et al.
Published: (2025)

Misconception Diagnosis From Student-Tutor Dialogue: Generate, Retrieve, Rerank
by: Mitton, Joshua, et al.
Published: (2026)

FASTTRACK: Fast and Accurate Fact Tracing for LLMs
by: Chen, Si, et al.
Published: (2024)

The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More
by: Chen, Lingjiao, et al.
Published: (2026)

SEKE: Specialised Experts for Keyword Extraction
by: Martinc, Matej, et al.
Published: (2024)

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
by: Autenried, Christian, et al.
Published: (2026)

Blending Is All You Need: Cheaper, Better Alternative to Trillion-Parameters LLM
by: Lu, Xiaoding, et al.
Published: (2024)

Leveraging LLMs for Bangla Grammar Error Correction:Error Categorization, Synthetic Data, and Model Evaluation
by: Bhattacharyya, Pramit, et al.
Published: (2024)

Specialised or Generic? Tokenization Choices for Radiology Language Models
by: Warr, Hermione, et al.
Published: (2025)

Small Language Models can Outperform Humans in Short Creative Writing: A Study Comparing SLMs with Humans and LLMs
by: Marco, Guillermo, et al.
Published: (2024)

Why We Need World Models for AGI: Where LLMs Fail and How World Models May Outperform
by: Alaswad, Feisal, et al.
Published: (2026)

Dynamic Depth Decoding: Faster Speculative Decoding for LLMs
by: Brown, Oscar, et al.
Published: (2024)

Asynchronous RLHF: Faster and More Efficient Off-Policy RL for Language Models
by: Noukhovitch, Michael, et al.
Published: (2024)

Enhancing Large Language Model Performance To Answer Questions and Extract Information More Accurately
by: Zhang, Liang, et al.
Published: (2024)

SSA-COMET: Do LLMs Outperform Learned Metrics in Evaluating MT for Under-Resourced African Languages?
by: Li, Senyu, et al.
Published: (2025)

Debating with More Persuasive LLMs Leads to More Truthful Answers
by: Khan, Akbir, et al.
Published: (2024)

HyKGE: A Hypothesis Knowledge Graph Enhanced Framework for Accurate and Reliable Medical LLMs Responses
by: Jiang, Xinke, et al.
Published: (2023)

Accurate and Energy Efficient: Local Retrieval-Augmented Generation Models Outperform Commercial Large Language Models in Medical Tasks
by: Vrettos, Konstantinos, et al.
Published: (2025)

Informed Routing in LLMs: Smarter Token-Level Computation for Faster Inference
by: Han, Chao, et al.
Published: (2025)

SSL-Interactions: Pretext Tasks for Interactive Trajectory Prediction
by: Bhattacharyya, Prarthana, et al.
Published: (2024)

Knowledge Updating? No More Model Editing! Just Selective Contextual Reasoning
by: He, Guoxiu, et al.
Published: (2025)

Less Is More: Fast and Accurate Reasoning with Cross-Head Unified Sparse Attention
by: Yang, Lijie, et al.
Published: (2025)

Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via Adapters
by: Gurgurov, Daniil, et al.
Published: (2024)

KnowTrace: Bootstrapping Iterative Retrieval-Augmented Generation with Structured Knowledge Tracing
by: Li, Rui, et al.
Published: (2025)

Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation
by: Bhambri, Siddhant, et al.
Published: (2025)

Scaling Embeddings Outperforms Scaling Experts in Language Models
by: Liu, Hong, et al.
Published: (2026)

Tracing the Roots of Facts in Multilingual Language Models: Independent, Shared, and Transferred Knowledge
by: Zhao, Xin, et al.
Published: (2024)

Knowledge Graph Fusion with Large Language Models for Accurate, Explainable Manufacturing Process Planning
by: Hoang, Danny, et al.
Published: (2025)

Stack Trace Deduplication: Faster, More Accurately, and in More Realistic Scenarios
by: Shibaev, Egor, et al.
Published: (2024)

Less is More: Selective Reflection for Compatible and Efficient Knowledge Distillation in Large Language Models
by: Liu, Lingyuan, et al.
Published: (2025)

Behavior-Aware Item Modeling via Dynamic Procedural Solution Representations for Knowledge Tracing
by: Seo, Jun, et al.
Published: (2026)

Explainable Few-shot Knowledge Tracing
by: Li, Haoxuan, et al.
Published: (2024)

StruEdit: Structured Outputs Enable the Fast and Accurate Knowledge Editing for Large Language Models
by: Bi, Baolong, et al.
Published: (2024)

MERIT: Memory-Enhanced Retrieval for Interpretable Knowledge Tracing
by: Li, Runze, et al.
Published: (2026)

Intrinsic Test of Unlearning Using Parametric Knowledge Traces
by: Hong, Yihuai, et al.
Published: (2024)

Answer Matching Outperforms Multiple Choice for Language Model Evaluation
by: Chandak, Nikhil, et al.
Published: (2025)

Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classification
by: Bucher, Martin Juan José, et al.
Published: (2024)

LLMs Struggle with Abstract Meaning Comprehension More Than Expected
by: Alhazmi, Hamoud, et al.
Published: (2026)

Contrastive Cross-Course Knowledge Tracing via Concept Graph Guided Knowledge Transfer
by: Han, Wenkang, et al.
Published: (2025)

Sparse Autoencoder Decomposition of Clinical Sequence Model Representations: Feature Complexity, Task Specialisation, and Mortality Prediction
by: Sainsbury, Chris, et al.
Published: (2026)