Copertina

Pre-training technique to localize medical BERT and enhance biomedical BERT

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wada, Shoya, Takeda, Toshihiro, Manabe, Shiro, Konishi, Shozo, Kamohara, Jun, Matsumura, Yasushi
Natura:	Preprint
Pubblicazione:	2020
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

FaBERT: Pre-training BERT on Persian Blogs
di: Masumi, Mostafa, et al.
Pubblicazione: (2024)

ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
di: Chaffin, Antoine, et al.
Pubblicazione: (2026)

MedicalBERT: enhancing biomedical natural language processing using pretrained BERT-based model
di: Reddy, K. Sahit, et al.
Pubblicazione: (2025)

Bag of Lies: Robustness in Continuous Pre-training BERT
di: Gevers, Ine, et al.
Pubblicazione: (2024)

ModernBERT + ColBERT: Enhancing biomedical RAG through an advanced re-ranking retriever
di: Rivera, Eduardo Martínez, et al.
Pubblicazione: (2025)

MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Models
di: Zhang, Ying, et al.
Pubblicazione: (2024)

Clinical ModernBERT: An efficient and long context encoder for biomedical text
di: Lee, Simon A., et al.
Pubblicazione: (2025)

DomURLs_BERT: Pre-trained BERT-based Model for Malicious Domains and URLs Detection and Classification
di: Mahdaouy, Abdelkader El, et al.
Pubblicazione: (2024)

MaiBERT: A Pre-training Corpus and Language Model for Low-Resourced Maithili Language
di: Yadav, Sumit, et al.
Pubblicazione: (2025)

NusaBERT: Teaching IndoBERT to be Multilingual and Multicultural
di: Wongso, Wilson, et al.
Pubblicazione: (2024)

NeoBERT: A Next-Generation BERT
di: Breton, Lola Le, et al.
Pubblicazione: (2025)

NeoDictaBERT: Pushing the Frontier of BERT models for Hebrew
di: Shmidman, Shaltiel, et al.
Pubblicazione: (2025)

Applying Pre-trained Multilingual BERT in Embeddings for Improved Malicious Prompt Injection Attacks Detection
di: Rahman, Md Abdur, et al.
Pubblicazione: (2024)

QiBERT -- Classifying Online Conversations Messages with BERT as a Feature
di: Ferreira-Saraiva, Bruno D., et al.
Pubblicazione: (2024)

HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition
di: Yoon, Ji Won, et al.
Pubblicazione: (2022)

DE$^3$-BERT: Distance-Enhanced Early Exiting for BERT based on Prototypical Networks
di: He, Jianing, et al.
Pubblicazione: (2024)

An investigation of structures responsible for gender bias in BERT and DistilBERT
di: Leteno, Thibaud, et al.
Pubblicazione: (2024)

CamemBERT-bio: Leveraging Continual Pre-training for Cost-Effective Models on French Biomedical Data
di: Touchent, Rian, et al.
Pubblicazione: (2023)

TempCharBERT: Keystroke Dynamics for Continuous Access Control Based on Pre-trained Language Models
di: Simão, Matheus, et al.
Pubblicazione: (2024)

SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation
di: Lv, Changze, et al.
Pubblicazione: (2023)

DocPolarBERT: A Pre-trained Model for Document Understanding with Relative Polar Coordinate Encoding of Layout Structures
di: Uthayasooriyar, Benno, et al.
Pubblicazione: (2025)

Noise-BERT: A Unified Perturbation-Robust Framework with Noise Alignment Pre-training for Noisy Slot Filling Task
di: Zhao, Jinxu, et al.
Pubblicazione: (2024)

MS-HuBERT: Mitigating Pre-training and Inference Mismatch in Masked Language Modelling methods for learning Speech Representations
di: Yadav, Hemant, et al.
Pubblicazione: (2024)

LipidBERT: A Lipid Language Model Pre-trained on METiS de novo Lipid Library
di: Yu, Tianhao, et al.
Pubblicazione: (2024)

ACL: Aligned Contrastive Learning Improves BERT and Multi-exit BERT Fine-tuning
di: Li, Liz, et al.
Pubblicazione: (2026)

InvBERT: Reconstructing Text from Contextualized Word Embeddings by inverting the BERT pipeline
di: Kugler, Kai, et al.
Pubblicazione: (2021)

Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews
di: Christian, William, et al.
Pubblicazione: (2025)

IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method
di: Kim, Mihyeon, et al.
Pubblicazione: (2025)

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
di: Autenried, Christian, et al.
Pubblicazione: (2026)

Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for Chinese Mental Health Text Analysis
di: Zhai, Wei, et al.
Pubblicazione: (2024)

SD-HuBERT: Sentence-Level Self-Distillation Induces Syllabic Organization in HuBERT
di: Cho, Cheol Jun, et al.
Pubblicazione: (2023)

GPT or BERT: why not both?
di: Charpentier, Lucas Georges Gabriel, et al.
Pubblicazione: (2024)

Semantic similarity estimation for domain specific data using BERT and other techniques
di: Prashanth, R.
Pubblicazione: (2025)

BERT-LID: Leveraging BERT to Improve Spoken Language Identification
di: Nie, Yuting, et al.
Pubblicazione: (2022)

KuBERT: Central Kurdish BERT Model and Its Application for Sentiment Analysis
di: Awlla, Kozhin muhealddin, et al.
Pubblicazione: (2025)

FinBERT-QA: Financial Question Answering with pre-trained BERT Language Models
di: Yuan, Bithiah
Pubblicazione: (2025)

TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
di: Türker, Melikşah, et al.
Pubblicazione: (2025)

Multilingual BERT language model for medical tasks: Evaluation on domain-specific adaptation and cross-linguality
di: Luo, Yinghao, et al.
Pubblicazione: (2025)

MaxPoolBERT: Enhancing BERT Classification via Layer- and Token-Wise Aggregation
di: Behrendt, Maike, et al.
Pubblicazione: (2025)

DunbaaBERT: From Sacrifice to Semantics
di: Maab, Iffat, et al.
Pubblicazione: (2026)