Optimizing LLMs for Italian: Reducing Token Fertility and Enhancing Efficiency Through Vocabulary Adaptation
Fuente:
arXiv
Saved in:
| Main Authors: | Moroni, Luca, Puccetti, Giovanni, Cabot, Pere-Lluis Huguet, Bejgu, Andrei Stefan, Barba, Edoardo, Miaschi, Alessio, Dell'Orletta, Felice, Esuli, Andrea, Navigli, Roberto |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It)
by: Miaschi, Alessio, et al.
Published: (2024)
by: Miaschi, Alessio, et al.
Published: (2024)
AI "News" Content Farms Are Easy to Make and Hard to Detect: A Case Study in Italian
by: Puccetti, Giovanni, et al.
Published: (2024)
by: Puccetti, Giovanni, et al.
Published: (2024)
Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectors
by: Pedrotti, Andrea, et al.
Published: (2025)
by: Pedrotti, Andrea, et al.
Published: (2025)
Linguistic Profiling of a Neural Language Model
by: Miaschi, Alessio, et al.
Published: (2020)
by: Miaschi, Alessio, et al.
Published: (2020)
Linguistically-driven Selection of Correct Arcs for Dependency Parsing
by: Felice Dell’Orletta
Published: (2013)
by: Felice Dell’Orletta
Published: (2013)
Contextualized Counterspeech: Strategies for Adaptation, Personalization, and Evaluation
by: Cima, Lorenzo, et al.
Published: (2024)
by: Cima, Lorenzo, et al.
Published: (2024)
T-FREX: A Transformer-based Feature Extraction Method from Mobile App Reviews
by: Motger, Quim, et al.
Published: (2024)
by: Motger, Quim, et al.
Published: (2024)
Leveraging Encoder-only Large Language Models for Mobile App Review Feature Extraction
by: Motger, Quim, et al.
Published: (2024)
by: Motger, Quim, et al.
Published: (2024)
ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget
by: Orlando, Riccardo, et al.
Published: (2024)
by: Orlando, Riccardo, et al.
Published: (2024)
Outliers Dimensions that Disrupt Transformers Are Driven by Frequency
by: Puccetti, Giovanni, et al.
Published: (2022)
by: Puccetti, Giovanni, et al.
Published: (2022)
Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics
by: Perrella, Stefano, et al.
Published: (2024)
by: Perrella, Stefano, et al.
Published: (2024)
BOOKCOREF: Coreference Resolution at Book Scale
by: Martinelli, Giuliano, et al.
Published: (2025)
by: Martinelli, Giuliano, et al.
Published: (2025)
Word Sense Linking: Disambiguating Outside the Sandbox
by: Bejgu, Andrei Stefan, et al.
Published: (2024)
by: Bejgu, Andrei Stefan, et al.
Published: (2024)
The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italian
by: Puccetti, Giovanni, et al.
Published: (2024)
by: Puccetti, Giovanni, et al.
Published: (2024)
Fine-tuning with HED-IT: The impact of human post-editing for dialogical language models
by: Occhipinti, Daniela, et al.
Published: (2024)
by: Occhipinti, Daniela, et al.
Published: (2024)
Maverick: Efficient and Accurate Coreference Resolution Defying Recent Trends
by: Martinelli, Giuliano, et al.
Published: (2024)
by: Martinelli, Giuliano, et al.
Published: (2024)
Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis
by: Scirè, Alessandro, et al.
Published: (2024)
by: Scirè, Alessandro, et al.
Published: (2024)
Protein Secondary Structure Patterns in Short‐Range Cross‐Link Atlas
by: Alice Vetrano, et al.
Published: (2025)
by: Alice Vetrano, et al.
Published: (2025)
Protein Secondary Structure Patterns in Short‐Range Cross‐Link Atlas
by: Alice Vetrano, et al.
Published: (2025)
by: Alice Vetrano, et al.
Published: (2025)
Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!
by: Perrella, Stefano, et al.
Published: (2024)
by: Perrella, Stefano, et al.
Published: (2024)
A logging and reporting tool for NVIDIA GPUs
by: Andrea Esuli
Published: (2025)
by: Andrea Esuli
Published: (2025)
EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge
by: Zaporojets, Klim, et al.
Published: (2025)
by: Zaporojets, Klim, et al.
Published: (2025)
REACHING OUT: EXTENDING COLLABORATION & TRAINING TO PARAEDUCATORS
by: Orletta Nguyen
Published: (2015)
by: Orletta Nguyen
Published: (2015)
ReTraceQA: Evaluating Reasoning Traces of Small Language Models in Commonsense Question Answering
by: Molfese, Francesco Maria, et al.
Published: (2025)
by: Molfese, Francesco Maria, et al.
Published: (2025)
TokAlign: Efficient Vocabulary Adaptation via Token Alignment
by: Li, Chong, et al.
Published: (2025)
by: Li, Chong, et al.
Published: (2025)
Enhanced Efficiency Nitrogen Fertilizers Reduced Ammonia Emissions in Rainfed Cotton
by: Kulpreet Singh, et al.
Published: (2025)
by: Kulpreet Singh, et al.
Published: (2025)
TokAlign++: Advancing Vocabulary Adaptation via Better Token Alignment
by: Li, Chong, et al.
Published: (2026)
by: Li, Chong, et al.
Published: (2026)
Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering
by: Molfese, Francesco Maria, et al.
Published: (2025)
by: Molfese, Francesco Maria, et al.
Published: (2025)
Adaptive BPE Tokenization for Enhanced Vocabulary Adaptation in Finetuning Pretrained Language Models
by: Balde, Gunjan, et al.
Published: (2024)
by: Balde, Gunjan, et al.
Published: (2024)
Process Reward Models Meet Planning: Generating Precise and Scalable Datasets for Step-Level Rewards
by: Pisano, Raffaele, et al.
Published: (2026)
by: Pisano, Raffaele, et al.
Published: (2026)
Learning Faster with Better Tokens: Parameter-Efficient Vocabulary Adaptation for Specialized Text Summarization
by: Balde, Gunjan, et al.
Published: (2026)
by: Balde, Gunjan, et al.
Published: (2026)
Multidimensional Balanced Efficiency Decision Model
by: Fabio De Felice
Published: (2015)
by: Fabio De Felice
Published: (2015)
Leveraging Knowledge of Traditional Italian Maize Landrace Diversity to Identify Signals of Local Adaptation
by: Alessandra Lezzi, et al.
Published: (2026)
by: Alessandra Lezzi, et al.
Published: (2026)
Self-Learning Longitudinal Control for On-Road Vehicles
by: Puccetti, Luca
Published: (2023)
by: Puccetti, Luca
Published: (2023)
Articulando: arte, ensino e produção para uma educação especial
by: Roberta Puccetti
Published: (2005)
by: Roberta Puccetti
Published: (2005)
SkillReducer: Optimizing LLM Agent Skills for Token Efficiency
by: Gao, Yudong, et al.
Published: (2026)
by: Gao, Yudong, et al.
Published: (2026)
Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP
by: Remy, François, et al.
Published: (2024)
by: Remy, François, et al.
Published: (2024)
ScribeTokens: Fixed-Vocabulary Tokenization of Digital Ink
by: Wang, Douglass
Published: (2026)
by: Wang, Douglass
Published: (2026)
AdaptiVocab: Enhancing LLM Efficiency in Focused Domains through Lightweight Vocabulary Adaptation
by: Nakash, Itay, et al.
Published: (2025)
by: Nakash, Itay, et al.
Published: (2025)
Learning to Quantify
by: Esuli, Andrea, et al.
Published: (2023)
by: Esuli, Andrea, et al.
Published: (2023)
Similar Items
-
Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It)
by: Miaschi, Alessio, et al.
Published: (2024) -
AI "News" Content Farms Are Easy to Make and Hard to Detect: A Case Study in Italian
by: Puccetti, Giovanni, et al.
Published: (2024) -
Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectors
by: Pedrotti, Andrea, et al.
Published: (2025) -
Linguistic Profiling of a Neural Language Model
by: Miaschi, Alessio, et al.
Published: (2020) -
Linguistically-driven Selection of Correct Arcs for Dependency Parsing
by: Felice Dell’Orletta
Published: (2013)