Cover Image

GPT or BERT: why not both?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Charpentier, Lucas Georges Gabriel, Samuel, David
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dual-objective Language Models: Training Efficiency Without Overfitting
by: Samuel, David, et al.
Published: (2025)

More Room for Language: Investigating the Effect of Retrieval on Language Models
by: Samuel, David, et al.
Published: (2024)

Stronger Re-identification Attacks through Reasoning and Aggregation
by: Charpentier, Lucas Georges Gabriel, et al.
Published: (2025)

Re-identification of De-identified Documents with Autoregressive Infilling
by: Charpentier, Lucas Georges Gabriel, et al.
Published: (2025)

Systematic Generalization in Language Models Scales with Information Entropy
by: Wold, Sondre, et al.
Published: (2025)

Small Languages, Big Models: A Study of Continual Training on Languages of Norway
by: Samuel, David, et al.
Published: (2024)

NusaBERT: Teaching IndoBERT to be Multilingual and Multicultural
by: Wongso, Wilson, et al.
Published: (2024)

Compositional Generalization with Grounded Language Models
by: Wold, Sondre, et al.
Published: (2024)

BERT vs GPT for financial engineering
by: Sharkey, Edward, et al.
Published: (2024)

(Chat)GPT v BERT: Dawn of Justice for Semantic Change Detection
by: Periti, Francesco, et al.
Published: (2024)

Applying BERT and ChatGPT for Sentiment Analysis of Lyme Disease in Scientific Literature
by: Susnjak, Teo
Published: (2023)

Single layer tiny Co$^4$ outpaces GPT-2 and GPT-BERT
by: Zain, Noor Ul, et al.
Published: (2025)

Selecting Between BERT and GPT for Text Classification in Political Science Research
by: Wang, Yu, et al.
Published: (2024)

Enhancing TinyBERT for Financial Sentiment Analysis Using GPT-Augmented FinBERT Distillation
by: Thomas, Graison Jos
Published: (2024)

A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the ChatGPT Era and Beyond
by: Kashyap, Abhinav Ramesh, et al.
Published: (2023)

FaBERT: Pre-training BERT on Persian Blogs
by: Masumi, Mostafa, et al.
Published: (2024)

Analyzing Narrative Processing in Large Language Models (LLMs): Using GPT4 to test BERT
by: Krauss, Patrick, et al.
Published: (2024)

NeoDictaBERT: Pushing the Frontier of BERT models for Hebrew
by: Shmidman, Shaltiel, et al.
Published: (2025)

Enhancing Next-Generation Language Models with Knowledge Graphs: Extending Claude, Mistral IA, and GPT-4 via KG-BERT
by: Chaabene, Nour El Houda Ben, et al.
Published: (2025)

QiBERT -- Classifying Online Conversations Messages with BERT as a Feature
by: Ferreira-Saraiva, Bruno D., et al.
Published: (2024)

Pre-training technique to localize medical BERT and enhance biomedical BERT
by: Wada, Shoya, et al.
Published: (2020)

NeoBERT: A Next-Generation BERT
by: Breton, Lola Le, et al.
Published: (2025)

SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation
by: Lv, Changze, et al.
Published: (2023)

ACL: Aligned Contrastive Learning Improves BERT and Multi-exit BERT Fine-tuning
by: Li, Liz, et al.
Published: (2026)

InvBERT: Reconstructing Text from Contextualized Word Embeddings by inverting the BERT pipeline
by: Kugler, Kai, et al.
Published: (2021)

Leveraging IndoBERT and DistilBERT for Indonesian Emotion Classification in E-Commerce Reviews
by: Christian, William, et al.
Published: (2025)

An investigation of structures responsible for gender bias in BERT and DistilBERT
by: Leteno, Thibaud, et al.
Published: (2024)

Exploring the Reversal Curse and Other Deductive Logical Reasoning in BERT and GPT-Based Large Language Models
by: Wu, Da, et al.
Published: (2023)

The why, what, and how of AI-based coding in scientific research
by: Zhuang, Tonghe, et al.
Published: (2024)

TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
by: Türker, Melikşah, et al.
Published: (2025)

IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method
by: Kim, Mihyeon, et al.
Published: (2025)

KliniskVestBERT: BERT Model Specialised to Norwegian Clinical Texts
by: Autenried, Christian, et al.
Published: (2026)

DunbaaBERT: From Sacrifice to Semantics
by: Maab, Iffat, et al.
Published: (2026)

Morphosyntactic probing of multilingual BERT models
by: Acs, Judit, et al.
Published: (2023)

Probing BERT for German Compound Semantics
by: Miletić, Filip, et al.
Published: (2025)

ModernBERT is More Efficient than Conventional BERT for Chest CT Findings Classification in Japanese Radiology Reports
by: Yamagishi, Yosuke, et al.
Published: (2025)

ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
by: Chaffin, Antoine, et al.
Published: (2026)

KuBERT: Central Kurdish BERT Model and Its Application for Sentiment Analysis
by: Awlla, Kozhin muhealddin, et al.
Published: (2025)

Dependency Annotation of Ottoman Turkish with Multilingual BERT
by: Özateş, Şaziye Betül, et al.
Published: (2024)

BERT's Conceptual Cartography: Mapping the Landscapes of Meaning
by: Haket, Nina, et al.
Published: (2024)