Cover Image

Adapting Pretrained Language Models for Citation Classification via Self-Supervised Contrastive Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Tong, Wang, Jiachuan, Zhang, Yongqi, Li, Shuangyin, Chen, Lei
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Activation-aware Probe-Query: Effective Key-Value Retrieval for Long-Context LLMs Inference
by: Xiao, Qingfa, et al.
Published: (2025)

R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation
by: Ye, Fuda, et al.
Published: (2024)

Optimizing Language Model's Reasoning Abilities with Weak Supervision
by: Tong, Yongqi, et al.
Published: (2024)

ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddings
by: Brannon, William, et al.
Published: (2023)

GTA: Supervised-Guided Reinforcement Learning for Text Classification with Large Language Models
by: Zeng, Min, et al.
Published: (2025)

Dynamic Adaptive Attention and Supervised Contrastive Learning: A Novel Hybrid Framework for Text Sentiment Classification
by: Li, Qingyang
Published: (2026)

Learning Concepts, Not Tokens: Self-Supervised Semantic Alignment for Language Models
by: Zhang, Christine, et al.
Published: (2026)

Rethinking Multilingual Continual Pretraining: Data Mixing for Adapting LLMs Across Languages and Resources
by: Li, Zihao, et al.
Published: (2025)

End-to-end Contrastive Language-Speech Pretraining Model For Long-form Spoken Question Answering
by: Hu, Jiliang, et al.
Published: (2025)

One Adapts to Any: Meta Reward Modeling for Personalized LLM Alignment
by: Cai, Hongru, et al.
Published: (2026)

LMFusion: Adapting Pretrained Language Models for Multimodal Generation
by: Shi, Weijia, et al.
Published: (2024)

Fine-Tuning Language Models on Multiple Datasets for Citation Intention Classification
by: Shui, Zeren, et al.
Published: (2024)

On Leveraging Large Language Models for Enhancing Entity Resolution: A Cost-efficient Approach
by: Li, Huahang, et al.
Published: (2024)

Citekit: A Modular Toolkit for Large Language Model Citation Generation
by: Shen, Jiajun, et al.
Published: (2024)

Self-Pluralising Culture Alignment for Large Language Models
by: Xu, Shaoyang, et al.
Published: (2024)

TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models
by: Liu, Yihong, et al.
Published: (2024)

PretrainRL: Alleviating Factuality Hallucination of Large Language Models at the Beginning
by: Liu, Langming, et al.
Published: (2026)

The Flip Side of RLHF: On-Policy Feedback for Reward Model Self-Supervised Improvement
by: Wang, Xiaobo, et al.
Published: (2026)

NoteContrast: Contrastive Language-Diagnostic Pretraining for Medical Text
by: Kailas, Prajwal, et al.
Published: (2024)

Learning to Reason via Self-Iterative Process Feedback for Small Language Models
by: Chen, Kaiyuan, et al.
Published: (2024)

ForeCite: Adapting Pre-Trained Language Models to Predict Future Citation Rates of Academic Papers
by: Hull, Gavin, et al.
Published: (2025)

RulePrompt: Weakly Supervised Text Classification with Prompting PLMs and Self-Iterative Logical Rules
by: Li, Miaomiao, et al.
Published: (2024)

Tool Calling: Enhancing Medication Consultation via Retrieval-Augmented Large Language Models
by: Huang, Zhongzhen, et al.
Published: (2024)

Training Language Models to Generate Text with Citations via Fine-grained Rewards
by: Huang, Chengyu, et al.
Published: (2024)

LoRM: Learning the Language of Rotating Machinery for Self-Supervised Condition Monitoring
by: Qin, Xiao, et al.
Published: (2026)

Investigating the 'Autoencoder Behavior' in Speech Self-Supervised Models: a focus on HuBERT's Pretraining
by: Vielzeuf, Valentin
Published: (2024)

BPO: Towards Balanced Preference Optimization between Knowledge Breadth and Depth in Alignment
by: Wang, Sizhe, et al.
Published: (2024)

Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents with Citation-Aware Rubric Rewards
by: Zhang, Jiajie, et al.
Published: (2026)

Progressive Residual Warmup for Language Model Pretraining
by: Chen, Tianhao, et al.
Published: (2026)

Modeling Caption Diversity in Contrastive Vision-Language Pretraining
by: Lavoie, Samuel, et al.
Published: (2024)

Learning Fine-Grained Grounded Citations for Attributed Large Language Models
by: Huang, Lei, et al.
Published: (2024)

A Systematic Survey of Semantic Role Labeling in the Era of Pretrained Language Models
by: Chen, Huiyao, et al.
Published: (2025)

SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
by: Xia, Heming, et al.
Published: (2024)

Learning to Adapt SFT Data for Better Reasoning Generalization
by: Sun, Lisong, et al.
Published: (2026)

Can LLMs Learn from Previous Mistakes? Investigating LLMs' Errors to Boost for Reasoning
by: Tong, Yongqi, et al.
Published: (2024)

Learning to Generate Answers with Citations via Factual Consistency Models
by: Aly, Rami, et al.
Published: (2024)

T-CLAP: Temporal-Enhanced Contrastive Language-Audio Pretraining
by: Yuan, Yi, et al.
Published: (2024)

SCIRGC: Multi-Granularity Citation Recommendation and Citation Sentence Preference Alignment
by: Li, Xiangyu, et al.
Published: (2025)

Learning to Adapt to Low-Resource Paraphrase Generation
by: Li, Zhigen, et al.
Published: (2024)

Finding Challenging Metaphors that Confuse Pretrained Language Models
by: Li, Yucheng, et al.
Published: (2024)