Imagen de Portada

Few Dimensions are Enough: Fine-tuning BERT with Selected Dimensions Revealed Its Redundant Nature

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Fukuhata, Shion, Kano, Yoshinobu
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Memorization of Named Entities in Fine-tuned BERT Models
por: Diera, Andor, et al.
Publicado: (2022)

ACL: Aligned Contrastive Learning Improves BERT and Multi-exit BERT Fine-tuning
por: Li, Liz, et al.
Publicado: (2026)

Lightweight Safety Guardrails Using Fine-tuned BERT Embeddings
por: Zheng, Aaron, et al.
Publicado: (2024)

Fine-tuning the SwissBERT Encoder Model for Embedding Sentences and Documents
por: Grosjean, Juri, et al.
Publicado: (2024)

Detecting Bias in Large Language Models: Fine-tuned KcBERT
por: Lee, J. K., et al.
Publicado: (2024)

Fine-tuning BERT with Bidirectional LSTM for Fine-grained Movie Reviews Sentiment Analysis
por: Nkhata, Gibson, et al.
Publicado: (2025)

Improving Sampling Methods for Fine-tuning SentenceBERT in Text Streams
por: Garcia, Cristiano Mesquita, et al.
Publicado: (2024)

Harnessing Large Language Models: Fine-tuned BERT for Detecting Charismatic Leadership Tactics in Natural Language
por: Saeid, Yasser, et al.
Publicado: (2024)

Question-Answering System for Bangla: Fine-tuning BERT-Bangla for a Closed Domain
por: Roy, Subal Chandra, et al.
Publicado: (2024)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
por: Song, Weixi, et al.
Publicado: (2023)

SPARSEFIT: Few-shot Prompting with Sparse Fine-tuning for Jointly Generating Predictions and Natural Language Explanations
por: Solano, Jesus, et al.
Publicado: (2023)

Dental Severity Assessment through Few-shot Learning and SBERT Fine-tuning
por: Dehghani, Mohammad
Publicado: (2024)

Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
por: Hościłowicz, Jakub, et al.
Publicado: (2023)

Biomedical Entity Linking for Dutch: Fine-tuning a Self-alignment BERT Model on an Automatically Generated Wikipedia Corpus
por: Hartendorp, Fons, et al.
Publicado: (2024)

Word Embedding Dimension Reduction via Weakly-Supervised Feature Selection
por: Xue, Jintang, et al.
Publicado: (2024)

RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Models
por: Najafi, Saeed, et al.
Publicado: (2024)

Correlation Dimension of Natural Language in a Statistical Manifold
por: Du, Xin, et al.
Publicado: (2024)

Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training
por: Zhang, Haode, et al.
Publicado: (2023)

Detecting Redundant Health Survey Questions Using Language-agnostic BERT Sentence Embedding (LaBSE)
por: Kang, Sunghoon, et al.
Publicado: (2024)

Mixture of Hidden-Dimensions Transformer
por: Chen, Yilong, et al.
Publicado: (2024)

Do BERT Embeddings Encode Narrative Dimensions? A Token-Level Probing Analysis of Time, Space, Causality, and Character in Fiction
por: Bei, Beicheng, et al.
Publicado: (2026)

When Seeing Is not Enough: Revealing the Limits of Active Reasoning in MLLMs
por: Liu, Hongcheng, et al.
Publicado: (2025)

KuBERT: Central Kurdish BERT Model and Its Application for Sentiment Analysis
por: Awlla, Kozhin muhealddin, et al.
Publicado: (2025)

Mask-guided BERT for Few Shot Text Classification
por: Liao, Wenxiong, et al.
Publicado: (2023)

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization
por: Zhang, Haode, et al.
Publicado: (2022)

PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning
por: Wang, Qibin, et al.
Publicado: (2024)

Topic mining based on fine-tuning Sentence-BERT and LDA
por: Li, Jianheng, et al.
Publicado: (2025)

Ranking Entities along Conceptual Space Dimensions with LLMs: An Analysis of Fine-Tuning Strategies
por: Kumar, Nitesh, et al.
Publicado: (2024)

Targeted Efficient Fine-tuning: Optimizing Parameter Updates with Data-Driven Sample Selection
por: Dong, Ming, et al.
Publicado: (2024)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
por: Zhou, Huichi, et al.
Publicado: (2025)

Few Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuning
por: Wang, Guoli, et al.
Publicado: (2026)

Energy and Carbon Considerations of Fine-Tuning BERT
por: Wang, Xiaorong, et al.
Publicado: (2023)

Massive Supervised Fine-tuning Experiments Reveal How Data, Layer, and Training Factors Shape LLM Alignment Quality
por: Harada, Yuto, et al.
Publicado: (2025)

Token-level Data Selection for Safe LLM Fine-tuning
por: Li, Yanping, et al.
Publicado: (2026)

CreditAudit: 2$^\text{nd}$ Dimension for LLM Evaluation and Selection
por: Song, Yiliang, et al.
Publicado: (2026)

Be Careful When Fine-tuning On Open-Source LLMs: Your Fine-tuning Data Could Be Secretly Stolen!
por: Zhang, Zhexin, et al.
Publicado: (2025)

GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning
por: Solatorio, Aivin V.
Publicado: (2024)

SparseGrad: A Selective Method for Efficient Fine-tuning of MLP Layers
por: Chekalina, Viktoriia, et al.
Publicado: (2024)

HalleluBERT: Let Every Token That Has Meaning Bear Its Weight
por: Schmitt, Raphael
Publicado: (2025)

Memorization in Language Models through the Lens of Intrinsic Dimension
por: Arnold, Stefan
Publicado: (2025)