Copertina

RepCali: High Efficient Fine-tuning Via Representation Calibration in Latent Space for Pre-trained Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Fujun, Fan, Xiaoying, Su, XiangDong, Gao, Guanglai
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

TransERR: Translation-based Knowledge Graph Embedding via Efficient Relation Rotation
di: Li, Jiang, et al.
Pubblicazione: (2023)

Structure-aware Fine-tuning for Code Pre-trained Models
di: Wu, Jiayi, et al.
Pubblicazione: (2024)

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization
di: Zhang, Haode, et al.
Pubblicazione: (2022)

Fine-tuning Pre-trained Named Entity Recognition Models For Indian Languages
di: Bahad, Sankalp, et al.
Pubblicazione: (2024)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
di: Song, Weixi, et al.
Pubblicazione: (2023)

MEDVOC: Vocabulary Adaptation for Fine-tuning Pre-trained Language Models on Medical Text Summarization
di: Balde, Gunjan, et al.
Pubblicazione: (2024)

SPAFIT: Stratified Progressive Adaptation Fine-tuning for Pre-trained Large Language Models
di: Arora, Samir, et al.
Pubblicazione: (2024)

RepEval: Effective Text Evaluation with LLM Representation
di: Sheng, Shuqian, et al.
Pubblicazione: (2024)

Can Pre-training Indicators Reliably Predict Fine-tuning Outcomes of LLMs?
di: Zeng, Hansi, et al.
Pubblicazione: (2025)

Mitigating Heterogeneity among Factor Tensors via Lie Group Manifolds for Tensor Decomposition Based Temporal Knowledge Graph Embedding
di: Li, Jiang, et al.
Pubblicazione: (2024)

RepMatch: Quantifying Cross-Instance Similarities in Representation Space
di: Modarres, Mohammad Reza, et al.
Pubblicazione: (2024)

RepV: Safety-Separable Latent Spaces for Scalable Neurosymbolic Plan Verification
di: Yang, Yunhao, et al.
Pubblicazione: (2025)

RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning
di: Wang, Haoyu, et al.
Pubblicazione: (2024)

Adapters Mixup: Mixing Parameter-Efficient Adapters to Enhance the Adversarial Robustness of Fine-tuned Pre-trained Text Classifiers
di: Nguyen, Tuc, et al.
Pubblicazione: (2024)

Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformer
di: Zhu, Yongxin, et al.
Pubblicazione: (2024)

Preserving Pre-trained Representation Space: On Effectiveness of Prefix-tuning for Large Multi-modal Models
di: Kim, Donghoon, et al.
Pubblicazione: (2024)

RadarPLM: Adapting Pre-trained Language Models for Marine Radar Target Detection by Selective Fine-tuning
di: Hu, Qiying, et al.
Pubblicazione: (2025)

Investigating the Representation of Backchannels and Fillers in Fine-tuned Language Models
di: Wang, Yu, et al.
Pubblicazione: (2025)

Unifying Dual-Space Embedding for Entity Alignment via Contrastive Learning
di: Wang, Cunda, et al.
Pubblicazione: (2024)

Pre-training, Fine-tuning and Re-ranking: A Three-Stage Framework for Legal Question Answering
di: Ni, Shiwen, et al.
Pubblicazione: (2024)

Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training
di: Zhang, Haode, et al.
Pubblicazione: (2023)

PARA: Parameter-Efficient Fine-tuning with Prompt Aware Representation Adjustment
di: Liu, Zequan, et al.
Pubblicazione: (2025)

From Robustness to Improved Generalization and Calibration in Pre-trained Language Models
di: Jukić, Josip, et al.
Pubblicazione: (2024)

Pre-training vs. Fine-tuning: A Reproducibility Study on Dense Retrieval Knowledge Acquisition
di: Yao, Zheng, et al.
Pubblicazione: (2025)

Metadata Conditioning Accelerates Language Model Pre-training
di: Gao, Tianyu, et al.
Pubblicazione: (2025)

Efficient Data Learning for Open Information Extraction with Pre-trained Language Models
di: Fan, Zhiyuan, et al.
Pubblicazione: (2023)

PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdification
di: Xie, Tianfang, et al.
Pubblicazione: (2024)

LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning
di: Zhang, Longteng, et al.
Pubblicazione: (2023)

Superpixel Semantics Representation and Pre-training for Vision-Language Task
di: Zhang, Siyu, et al.
Pubblicazione: (2023)

Towards Objective Fine-tuning: How LLMs' Prior Knowledge Causes Potential Poor Calibration?
di: Wang, Ziming, et al.
Pubblicazione: (2025)

Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Data
di: Xie, Juncheng, et al.
Pubblicazione: (2024)

BrainWavLM: Fine-tuning Speech Representations with Brain Responses to Language
di: Vattikonda, Nishitha, et al.
Pubblicazione: (2025)

Compositional Subspace Representation Fine-tuning for Adaptive Large Language Models
di: Zhou, Andy
Pubblicazione: (2025)

McBE: A Multi-task Chinese Bias Evaluation Benchmark for Large Language Models
di: Lan, Tian, et al.
Pubblicazione: (2025)

Enhancing Chain-of-Thought Reasoning with Critical Representation Fine-tuning
di: Huang, Chenxi, et al.
Pubblicazione: (2025)

Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration
di: Fu, Wenjie, et al.
Pubblicazione: (2023)

Domain Pre-training Impact on Representations
di: Gonzalez-Gutierrez, Cesar, et al.
Pubblicazione: (2025)

Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets
di: Li, Dongyue, et al.
Pubblicazione: (2025)

LoFiT: Localized Fine-tuning on LLM Representations
di: Yin, Fangcong, et al.
Pubblicazione: (2024)

CaliDrop: KV Cache Compression with Calibration
di: Su, Yi, et al.
Pubblicazione: (2025)