Cover Image

Classifier Language Models: Unifying Sparse Finetuning and Adaptive Tokenization for Specialized Classification Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Krishnan, Adit, Wang, Chu, Kong, Chris
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Self-Aligned Reward: Towards Effective and Efficient Reasoners
by: Han, Peixuan, et al.
Published: (2025)

CEV-LM: Controlled Edit Vector Language Model for Shaping Natural Language Generations
by: Moorjani, Samraj, et al.
Published: (2024)

Learning to Reason with Mixture of Tokens
by: Jain, Adit, et al.
Published: (2025)

Ensembling Finetuned Language Models for Text Classification
by: Arango, Sebastian Pineda, et al.
Published: (2024)

Improving Sparse Memory Finetuning
by: Goyal, Satyam, et al.
Published: (2026)

Sparse Linear Bandits with Blocking Constraints
by: Jain, Adit, et al.
Published: (2024)

Interacting Large Language Model Agents. Interpretable Models and Social Learning
by: Jain, Adit, et al.
Published: (2024)

Understanding Interpretability by generalized distillation in Supervised Classification
by: Agarwal, Adit, et al.
Published: (2020)

Sparse Upcycling: Inference Inefficient Finetuning
by: Doubov, Sasha, et al.
Published: (2024)

Sparse Memory Finetuning as a Low-Forgetting Alternative to LoRA and Full Finetuning
by: Gupta, Prakhar, et al.
Published: (2026)

High-Dimensional Analysis of Single-Layer Attention for Sparse-Token Classification
by: Barnfield, Nicholas, et al.
Published: (2025)

Small or Large? Zero-Shot or Finetuned? Guiding Language Model Choice for Specialized Applications in Healthcare
by: Gondara, Lovedeep, et al.
Published: (2025)

Flexi-LoRA with Input-Adaptive Ranks: Efficient Finetuning for Speech and Reasoning Tasks
by: Li, Zongqian, et al.
Published: (2026)

Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning
by: Ye, Jiasheng, et al.
Published: (2023)

Large Language Model Enhanced Machine Learning Estimators for Classification
by: Wu, Yuhang, et al.
Published: (2024)

RL-Guided Data Selection for Language Model Finetuning
by: Jha, Animesh, et al.
Published: (2025)

Adaptive Tokenization: On the Hop-Overpriority Problem in Tokenized Graph Learning Models
by: Wang, Zhibiao, et al.
Published: (2025)

Transfer Learning for Finetuning Large Language Models
by: Strangmann, Tobias, et al.
Published: (2024)

Reinforcement Learning Finetunes Small Subnetworks in Large Language Models
by: Mukherjee, Sagnik, et al.
Published: (2025)

Thinking Forward: Memory-Efficient Federated Finetuning of Language Models
by: Panchal, Kunjal, et al.
Published: (2024)

ReFT: Representation Finetuning for Language Models
by: Wu, Zhengxuan, et al.
Published: (2024)

ConMeZO: Adaptive Descent-Direction Sampling for Gradient-Free Finetuning of Large Language Models
by: Behric, Lejs Deen, et al.
Published: (2025)

Structured Reinforcement Learning for Incentivized Stochastic Covert Optimization
by: Jain, Adit, et al.
Published: (2024)

AgilePruner: An Empirical Study of Attention and Diversity for Adaptive Visual Token Pruning in Large Vision-Language Models
by: Baek, Changwoo, et al.
Published: (2026)

Large Language Models to Diffusion Finetuning
by: Cetin, Edoardo, et al.
Published: (2025)

Strategic Classification with Randomised Classifiers
by: Geary, Jack, et al.
Published: (2025)

Sparse Tokens Suffice: Jailbreaking Audio Language Models via Token-Aware Gradient Optimization
by: Fang, Zheng, et al.
Published: (2026)

Leveraging Vision Language Models for Specialized Agricultural Tasks
by: Arshad, Muhammad Arbab, et al.
Published: (2024)

Multi-task Modeling for Engineering Applications with Sparse Data
by: Comlek, Yigitcan, et al.
Published: (2026)

On the Emergence of Cross-Task Linearity in the Pretraining-Finetuning Paradigm
by: Zhou, Zhanpeng, et al.
Published: (2024)

On Finetuning Tabular Foundation Models
by: Rubachev, Ivan, et al.
Published: (2025)

Beyond Parameter Finetuning: Test-Time Representation Refinement for Node Classification
by: Zhang, Jiaxin, et al.
Published: (2026)

Uncertainty-Guided Checkpoint Selection for Reinforcement Finetuning of Large Language Models
by: Nguyen, Manh, et al.
Published: (2025)

Navigating the Safety Landscape: Measuring Risks in Finetuning Large Language Models
by: Peng, ShengYun, et al.
Published: (2024)

Finetuning Language Models to Emit Linguistic Expressions of Uncertainty
by: Chaudhry, Arslan, et al.
Published: (2024)

Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models
by: Jo, Dongwon, et al.
Published: (2024)

UniMoT: Unified Molecule-Text Language Model with Discrete Token Representation
by: Guo, Shuhan, et al.
Published: (2024)

UniDEC : Unified Dual Encoder and Classifier Training for Extreme Multi-Label Classification
by: Kharbanda, Siddhant, et al.
Published: (2024)

Adaptively Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

UniPredict: Large Language Models are Universal Tabular Classifiers
by: Wang, Ruiyu, et al.
Published: (2023)