Copertina

A path to natural language through tokenisation and transformers

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Berman, David S., Stapleton, Alexander G.
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Infusing clinical knowledge into tokenisers for language models
di: Hasan, Abul, et al.
Pubblicazione: (2024)

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
di: Raposo, David, et al.
Pubblicazione: (2024)

InsurTech innovation using natural language processing
di: Dong, Panyi, et al.
Pubblicazione: (2025)

Zipf Distributions from Two-Stage Symbolic Processes: Stability Under Stochastic Lexical Filtering
di: Berman, Vladimir
Pubblicazione: (2025)

Applications of natural language processing in aviation safety: A review and qualitative analysis
di: Nanyonga, Aziida, et al.
Pubblicazione: (2025)

On the evolution of research in hypersonics: application of natural language processing and machine learning
di: Ebadi, Ashkan, et al.
Pubblicazione: (2022)

Random Text, Zipf's Law, Critical Length,and Implications for Large Language Models
di: Berman, Vladimir
Pubblicazione: (2025)

Comparison of different Unique hard attention transformer models by the formal languages they can recognize
di: Ryvkin, Leonid
Pubblicazione: (2025)

MedicalBERT: enhancing biomedical natural language processing using pretrained BERT-based model
di: Reddy, K. Sahit, et al.
Pubblicazione: (2025)

Enhancing ASD detection accuracy: a combined approach of machine learning and deep learning models with natural language processing
di: Rubio-Martín, Sergio, et al.
Pubblicazione: (2024)

EEG-CLIP : Learning EEG representations from natural language descriptions
di: Ndir, Tidiane Camaret, et al.
Pubblicazione: (2025)

Detecting out-of-distribution text using topological features of transformer-based language models
di: Pollano, Andres, et al.
Pubblicazione: (2023)

A comparison of pipelines for the translation of a low resource language based on transformers
di: Bonfanti, Chiara, et al.
Pubblicazione: (2025)

Benchmarking large language models for biomedical natural language processing applications and recommendations
di: Chen, Qingyu, et al.
Pubblicazione: (2023)

SSCAE -- Semantic, Syntactic, and Context-aware natural language Adversarial Examples generator
di: Asl, Javad Rafiei, et al.
Pubblicazione: (2024)

Physical models realizing the transformer architecture of large language models
di: Chen, Zeqian
Pubblicazione: (2025)

Block removal for large language models through constrained binary optimization
di: Jansen, David, et al.
Pubblicazione: (2026)

Zero-shot data citation function classification using transformer-based large language models (LLMs)
di: Byers, Neil, et al.
Pubblicazione: (2025)

Innovative tokenisation of structured data for LLM training
di: Karim, Kayvan, et al.
Pubblicazione: (2025)

Predicting potentially abusive clauses in Chilean terms of services with natural language processing
di: Loeffler, Christoffer, et al.
Pubblicazione: (2025)

A mean teacher algorithm for unlearning of language models
di: Klochkov, Yegor
Pubblicazione: (2025)

Transformers need glasses! Information over-squashing in language tasks
di: Barbero, Federico, et al.
Pubblicazione: (2024)

Aligning language models with human preferences
di: Korbak, Tomasz
Pubblicazione: (2024)

Evaluating language models as risk scores
di: Cruz, André F., et al.
Pubblicazione: (2024)

DevBench: A multimodal developmental benchmark for language learning
di: Tan, Alvin Wei Ming, et al.
Pubblicazione: (2024)

Amortizing intractable inference in large language models
di: Hu, Edward J., et al.
Pubblicazione: (2023)

Attribution analysis of legal language as used by LLM
di: Belew, Richard K.
Pubblicazione: (2025)

Learning from flowsheets: A generative transformer model for autocompletion of flowsheets
di: Vogel, Gabriel, et al.
Pubblicazione: (2022)

Dynamic layer selection in decoder-only transformers
di: Glavas, Theodore, et al.
Pubblicazione: (2024)

The SMeL Test: A simple benchmark for media literacy in language models
di: Ahdritz, Gustaf, et al.
Pubblicazione: (2025)

BRAIn: Bayesian Reward-conditioned Amortized Inference for natural language generation from feedback
di: Pandey, Gaurav, et al.
Pubblicazione: (2024)

Optimization Strategies for Enhancing Resource Efficiency in Transformers & Large Language Models
di: Wallace, Tom, et al.
Pubblicazione: (2025)

Perturbed examples reveal invariances shared by language models
di: Rawal, Ruchit, et al.
Pubblicazione: (2023)

Do language models plan ahead for future tokens?
di: Wu, Wilson, et al.
Pubblicazione: (2024)

Visualizing token importance for black-box language models
di: Rauba, Paulius, et al.
Pubblicazione: (2025)

DataComp-LM: In search of the next generation of training sets for language models
di: Li, Jeffrey, et al.
Pubblicazione: (2024)

Prompt reinforcing for long-term planning of large language models
di: Lin, Hsien-Chin, et al.
Pubblicazione: (2025)

Machine-generated text detection prevents language model collapse
di: Drayson, George, et al.
Pubblicazione: (2025)

Boosting classification reliability of NLP transformer models in the long run
di: Kmetty, Zoltán, et al.
Pubblicazione: (2023)

Only relative ranks matter in weight-clustered large language models
di: Aizpurua, Borja, et al.
Pubblicazione: (2026)