Copertina

Tokenizations for Austronesian Language Models: study on languages in Indonesia Archipelago

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lumbantobing, Andhika Bernard, Situngkir, Hokky
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computers and Society 68T50 I.2.7; E.4; F.2.2
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Adaptive Engram Memory System for Indonesian Language Model: Generative AI Based on TOBA LM for Batak and Minang Language
di: Situngkir, Hokky, et al.
Pubblicazione: (2026)

Syllabic Agglutinative Tokenizations for Indonesian LLM: A Study from Gasing Literacy Learning System
di: Situngkir, H., et al.
Pubblicazione: (2026)

Large Language Models for Propaganda Span Annotation
di: Hasanain, Maram, et al.
Pubblicazione: (2023)

Multilingual and Multimodal LLMs in the Wild: Building for Low-Resource Languages
di: Alam, Firoj, et al.
Pubblicazione: (2026)

LLM-Based Multi-Task Bangla Hate Speech Detection: Type, Severity, and Target
di: Hasan, Md Arid, et al.
Pubblicazione: (2025)

PropXplain: Can LLMs Enable Explainable Propaganda Detection?
di: Hasanain, Maram, et al.
Pubblicazione: (2025)

Sinhala Transliteration: A Comparative Analysis Between Rule-based and Seq2Seq Approaches
di: De Mel, Yomal, et al.
Pubblicazione: (2024)

LAraBench: Benchmarking Arabic AI with Large Language Models
di: Abdelali, Ahmed, et al.
Pubblicazione: (2023)

SAGED: A Holistic Bias-Benchmarking Pipeline for Language Models with Customisable Fairness Calibration
di: Guan, Xin, et al.
Pubblicazione: (2024)

Separate Before You Compress: The WWHO Tokenization Architecture
di: Darshana, Kusal
Pubblicazione: (2026)

A Multiple-Fill-in-the-Blank Exam Approach for Enhancing Zero-Resource Hallucination Detection in Large Language Models
di: Munakata, Satoshi, et al.
Pubblicazione: (2024)

Native vs Non-Native Language Prompting: A Comparative Analysis
di: Kmainasi, Mohamed Bayan, et al.
Pubblicazione: (2024)

DEM: Distribution Edited Model for Training with Mixed Data Distributions
di: Ram, Dhananjay, et al.
Pubblicazione: (2024)

Mobile Phone Sensor-based Nigerian Driving Dataset to Detect Alcohol-influenced Behaviours
di: Thompson, Iniakpokeikiye Peter, et al.
Pubblicazione: (2025)

TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarking
di: Nahin, Shahriar Kabir, et al.
Pubblicazione: (2025)

LLMeBench: A Flexible Framework for Accelerating LLMs Benchmarking
di: Dalvi, Fahim, et al.
Pubblicazione: (2023)

AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMs
di: Mousi, Basel, et al.
Pubblicazione: (2024)

NativQA Framework: Enabling LLMs and VLMs with Native, Local, and Everyday Knowledge
di: Alam, Firoj, et al.
Pubblicazione: (2025)

OASIS: A Multilingual and Multimodal Dataset for Culturally Grounded Spoken Visual QA
di: Alam, Firoj, et al.
Pubblicazione: (2025)

Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMs
di: Alam, Firoj, et al.
Pubblicazione: (2024)

LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content
di: Kmainasi, Mohamed Bayan, et al.
Pubblicazione: (2024)

CultranAI at PalmX 2025: Data Augmentation for Cultural Knowledge Representation
di: Bhatti, Hunzalah Hassan, et al.
Pubblicazione: (2025)

NativQA: Multilingual Culturally-Aligned Natural Query for LLMs
di: Hasan, Md. Arid, et al.
Pubblicazione: (2024)

Beyond MCQ: An Open-Ended Arabic Cultural QA Benchmark with Dialect Variants
di: Bhatti, Hunzalah Hassan, et al.
Pubblicazione: (2025)

GenAI Content Detection Task 2: AI vs. Human -- Academic Essay Authenticity Challenge
di: Chowdhury, Shammur Absar, et al.
Pubblicazione: (2024)

ThatiAR: Subjectivity Detection in Arabic News Sentences
di: Suwaileh, Reem, et al.
Pubblicazione: (2024)

DRO-InstructZero: Distributionally Robust Prompt Optimization for Large Language Models
di: Li, Yangyang
Pubblicazione: (2025)

The Ethics Engine: A Modular Pipeline for Accessible Psychometric Assessment of Large Language Models
di: Van Clief, Jake, et al.
Pubblicazione: (2025)

Approaching I/O-optimality for Approximate Attention
di: Papp, Pál András, et al.
Pubblicazione: (2026)

Understanding and Improving Information Preservation in Prompt Compression for LLMs
di: Łajewska, Weronika, et al.
Pubblicazione: (2025)

AVEC: Bootstrapping Privacy for Local LLMs
di: Gaikwad, Madhava
Pubblicazione: (2025)

From Pixels to Privacy: Temporally Consistent Video Anonymization via Token Pruning for Privacy Preserving Action Recognition
di: Aslam, Nazia, et al.
Pubblicazione: (2026)

Enhancing Trust in LLMs: Algorithms for Comparing and Interpreting LLMs
di: Brown, Nik Bear
Pubblicazione: (2024)

Uncovering Uncertainty in Transformer Inference
di: Brothers, Greyson, et al.
Pubblicazione: (2024)

CAPE: Corrective Actions from Precondition Errors using Large Language Models
di: Raman, Shreyas Sundara, et al.
Pubblicazione: (2022)

Thinking Longer, Not Always Smarter: Evaluating LLM Capabilities in Hierarchical Legal Reasoning
di: Zhang, Li, et al.
Pubblicazione: (2025)

Retrieval-Based Multi-Label Legal Annotation: Extensible, Data-Efficient and Hallucination-Free
di: Zhang, Li, et al.
Pubblicazione: (2026)

Beyond Accuracy: Decomposing the Reasoning Efficiency of LLMs
di: Kaiser, Daniel, et al.
Pubblicazione: (2026)

D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Tree
di: Lei, Xiang, et al.
Pubblicazione: (2025)

Quantifying Algorithmic Friction in Automated Resume Screening Systems
di: Fofanah, Ibrahim Denis
Pubblicazione: (2026)