Language Detection by Means of the Minkowski Norm: Identification Through Character Bigrams and Frequency Analysis
Fuente:
arXiv
Saved in:
| Main Authors: | Pogăcean, Paul-Andrei, Avram, Sanda-Maria |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Oldies but Goldies: The Potential of Character N-grams for Romanian Texts
by: Lupsa, Dana, et al.
Published: (2025)
by: Lupsa, Dana, et al.
Published: (2025)
ELAICHI: Enhancing Low-resource TTS by Addressing Infrequent and Low-frequency Character Bigrams
by: Anand, Srija, et al.
Published: (2024)
by: Anand, Srija, et al.
Published: (2024)
Bigram Subnetworks: Mapping to Next Tokens in Transformer Language Models
by: Chang, Tyler A., et al.
Published: (2025)
by: Chang, Tyler A., et al.
Published: (2025)
Learning and Transferring Sparse Contextual Bigrams with Linear Transformers
by: Ren, Yunwei, et al.
Published: (2024)
by: Ren, Yunwei, et al.
Published: (2024)
Improbable Bigrams Expose Vulnerabilities of Incomplete Tokens in Byte-Level Tokenizers
by: Jang, Eugene, et al.
Published: (2024)
by: Jang, Eugene, et al.
Published: (2024)
BLooP: Zero-Shot Abstractive Summarization using Large Language Models with Bigram Lookahead Promotion
by: Iyer, Varun, et al.
Published: (2026)
by: Iyer, Varun, et al.
Published: (2026)
MoRoVoc: A Large Dataset for Geographical Variation Identification of the Spoken Romanian Language
by: Avram, Andrei-Marius, et al.
Published: (2025)
by: Avram, Andrei-Marius, et al.
Published: (2025)
RoQLlama: A Lightweight Romanian Adapted Language Model
by: Dima, George-Andrei, et al.
Published: (2024)
by: Dima, George-Andrei, et al.
Published: (2024)
RELATE: A Modern Processing Platform for Romanian Language
by: Păiş, Vasile, et al.
Published: (2024)
by: Păiş, Vasile, et al.
Published: (2024)
RoIt-XMASA: Multi-Domain Multilingual Sentiment Analysis Dataset for Romanian and Italian
by: Avram, Andrei-Marius, et al.
Published: (2026)
by: Avram, Andrei-Marius, et al.
Published: (2026)
UniBERT: Adversarial Training for Language-Universal Representations
by: Avram, Andrei-Marius, et al.
Published: (2025)
by: Avram, Andrei-Marius, et al.
Published: (2025)
Norm of Mean Contextualized Embeddings Determines their Variance
by: Yamagiwa, Hiroaki, et al.
Published: (2024)
by: Yamagiwa, Hiroaki, et al.
Published: (2024)
Geometric Structures and Patterns of Meaning: A PHATE Manifold Analysis of Chinese Character Embeddings
by: Gong, Wen G.
Published: (2025)
by: Gong, Wen G.
Published: (2025)
Detection of LLM-Generated Java Code Using Discretized Nested Bigrams
by: Paek, Timothy, et al.
Published: (2025)
by: Paek, Timothy, et al.
Published: (2025)
CharacterBench: Benchmarking Character Customization of Large Language Models
by: Zhou, Jinfeng, et al.
Published: (2024)
by: Zhou, Jinfeng, et al.
Published: (2024)
Detecting Structured Language Alternations in Historical Documents by Combining Language Identification with Fourier Analysis
by: Sirin, Hale, et al.
Published: (2024)
by: Sirin, Hale, et al.
Published: (2024)
HistNERo: Historical Named Entity Recognition for the Romanian Language
by: Avram, Andrei-Marius, et al.
Published: (2024)
by: Avram, Andrei-Marius, et al.
Published: (2024)
Evaluating Language Model Character Traits
by: Ward, Francis Rhys, et al.
Published: (2024)
by: Ward, Francis Rhys, et al.
Published: (2024)
FineFreq: A Multilingual Character Frequency Dataset from Web-Scale Text
by: Xu, Binbin
Published: (2025)
by: Xu, Binbin
Published: (2025)
Sequence-to-Sequence Language Models for Character and Emotion Detection in Dream Narratives
by: Cortal, Gustave
Published: (2024)
by: Cortal, Gustave
Published: (2024)
Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works
by: Yuan, Xinfeng, et al.
Published: (2024)
by: Yuan, Xinfeng, et al.
Published: (2024)
An Analysis of Language Frequency and Error Correction for Esperanto
by: Liang, Junhong
Published: (2024)
by: Liang, Junhong
Published: (2024)
Computational Analysis of Character Development in Holocaust Testimonies
by: Shizgal, Esther, et al.
Published: (2024)
by: Shizgal, Esther, et al.
Published: (2024)
Improving Language and Modality Transfer in Translation by Character-level Modeling
by: Tsiamas, Ioannis, et al.
Published: (2025)
by: Tsiamas, Ioannis, et al.
Published: (2025)
How Do Language Models Acquire Character-Level Information?
by: Sato, Soma, et al.
Published: (2026)
by: Sato, Soma, et al.
Published: (2026)
Large Language Models Lack Understanding of Character Composition of Words
by: Shin, Andrew, et al.
Published: (2024)
by: Shin, Andrew, et al.
Published: (2024)
Large Language Model Evaluation via Matrix Nuclear-Norm
by: Li, Yahan, et al.
Published: (2024)
by: Li, Yahan, et al.
Published: (2024)
Evaluating Computational Representations of Character: An Austen Character Similarity Benchmark
by: Yang, Funing, et al.
Published: (2024)
by: Yang, Funing, et al.
Published: (2024)
Querying Structured Data Through Natural Language Using Language Models
by: Valentin-Micu, Hontan, et al.
Published: (2026)
by: Valentin-Micu, Hontan, et al.
Published: (2026)
GeoNorm: Unify Pre-Norm and Post-Norm with Geodesic Optimization
by: Zheng, Chuanyang, et al.
Published: (2026)
by: Zheng, Chuanyang, et al.
Published: (2026)
C-LLM: Learn to Check Chinese Spelling Errors Character by Character
by: Li, Kunting, et al.
Published: (2024)
by: Li, Kunting, et al.
Published: (2024)
The Strawberry Problem: Emergence of Character-level Understanding in Tokenized Language Models
by: Cosma, Adrian, et al.
Published: (2025)
by: Cosma, Adrian, et al.
Published: (2025)
Combining Entropy and Matrix Nuclear Norm for Enhanced Evaluation of Language Models
by: Vo, James
Published: (2024)
by: Vo, James
Published: (2024)
Beyond Perplexity: Character Distribution Signatures and the MDTA Benchmark for AI Text Detection
by: Narayanasamy, Priyadarshan, et al.
Published: (2026)
by: Narayanasamy, Priyadarshan, et al.
Published: (2026)
Rethinking Genomic Modeling Through Optical Character Recognition
by: Xiang, Hongxin, et al.
Published: (2026)
by: Xiang, Hongxin, et al.
Published: (2026)
Through the Lens of Character: Resolving Modality-Role Interference in Multimodal Role-Playing Agent
by: Tang, Yihong, et al.
Published: (2026)
by: Tang, Yihong, et al.
Published: (2026)
Toyteller: AI-powered Visual Storytelling Through Toy-Playing with Character Symbols
by: Chung, John Joon Young, et al.
Published: (2025)
by: Chung, John Joon Young, et al.
Published: (2025)
From Language Models over Tokens to Language Models over Characters
by: Vieira, Tim, et al.
Published: (2024)
by: Vieira, Tim, et al.
Published: (2024)
Impact of Non-Standard Unicode Characters on Security and Comprehension in Large Language Models
by: Daniel, Johan S, et al.
Published: (2024)
by: Daniel, Johan S, et al.
Published: (2024)
Decoding Continuous Character-based Language from Non-invasive Brain Recordings
by: Zhang, Cenyuan, et al.
Published: (2024)
by: Zhang, Cenyuan, et al.
Published: (2024)
Similar Items
-
Oldies but Goldies: The Potential of Character N-grams for Romanian Texts
by: Lupsa, Dana, et al.
Published: (2025) -
ELAICHI: Enhancing Low-resource TTS by Addressing Infrequent and Low-frequency Character Bigrams
by: Anand, Srija, et al.
Published: (2024) -
Bigram Subnetworks: Mapping to Next Tokens in Transformer Language Models
by: Chang, Tyler A., et al.
Published: (2025) -
Learning and Transferring Sparse Contextual Bigrams with Linear Transformers
by: Ren, Yunwei, et al.
Published: (2024) -
Improbable Bigrams Expose Vulnerabilities of Incomplete Tokens in Byte-Level Tokenizers
by: Jang, Eugene, et al.
Published: (2024)