Cover Image

Long-Tail Crisis in Nearest Neighbor Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nishida, Yuto, Morishita, Makoto, Deguchi, Hiroyuki, Kamigaito, Hidetaka, Watanabe, Taro
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generating Diverse Translation with Perturbed kNN-MT
by: Nishida, Yuto, et al.
Published: (2024)

Efficient Nearest Neighbor based Uncertainty Estimation for Natural Language Processing Tasks
by: Hashimoto, Wataru, et al.
Published: (2024)

Revisiting Non-Verbatim Memorization in Large Language Models: The Role of Entity Surface Forms
by: Nishida, Yuto, et al.
Published: (2026)

mbrs: A Library for Minimum Bayes Risk Decoding
by: Deguchi, Hiroyuki, et al.
Published: (2024)

Diversity Explains Inference Scaling Laws: Through a Case Study of Minimum Bayes Risk Decoding
by: Kamigaito, Hidetaka, et al.
Published: (2024)

Agreement-Constrained Probabilistic Minimum Bayes Risk Decoding
by: Natsumi, Koki, et al.
Published: (2025)

Introducing Syllable Tokenization for Low-resource Languages: A Case Study with Swahili
by: Atuhurra, Jesse, et al.
Published: (2024)

Centroid-Based Efficient Minimum Bayes Risk Decoding
by: Deguchi, Hiroyuki, et al.
Published: (2024)

Decoding Uncertainty: The Impact of Decoding Strategies for Uncertainty Estimation in Large Language Models
by: Hashimoto, Wataru, et al.
Published: (2025)

Revisiting Compositional Generalization Capability of Large Language Models Considering Instruction Following Ability
by: Sakai, Yusuke, et al.
Published: (2025)

mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans
by: Sakai, Yusuke, et al.
Published: (2024)

Distilling Named Entity Recognition Models for Endangered Species from Large Language Models
by: Atuhurra, Jesse, et al.
Published: (2024)

Do LLMs Implicitly Determine the Suitable Text Difficulty for Users?
by: Gobara, Seiji, et al.
Published: (2024)

Tonguescape: Exploring Language Models Understanding of Vowel Articulation
by: Sakajo, Haruki, et al.
Published: (2025)

How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgments
by: Ide, Yusuke, et al.
Published: (2024)

Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters
by: Guo, Zhiyu, et al.
Published: (2024)

Exploring Intrinsic Language-specific Subspaces in Fine-tuning Multilingual Neural Machine Translation
by: Cao, Zhe, et al.
Published: (2024)

Multilinguality of Large Language Models From a Structural Perspective
by: Sakajo, Haruki, et al.
Published: (2026)

Context-Aware Machine Translation with Source Coreference Explanation
by: Vu, Huy Hien, et al.
Published: (2024)

Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?
by: Sakai, Yusuke, et al.
Published: (2023)

NERsocial: Efficient Named Entity Recognition Dataset Construction for Human-Robot Interaction Utilizing RapidNER
by: Atuhurra, Jesse, et al.
Published: (2024)

Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation?
by: Hashimoto, Wataru, et al.
Published: (2024)

HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL Conferences
by: Sakai, Yusuke, et al.
Published: (2026)

HalluCiteChecker: A Lightweight Toolkit for Hallucinated Citation Detection and Verification in the Era of AI Scientists
by: Sakai, Yusuke, et al.
Published: (2026)

Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair
by: Sakai, Yusuke, et al.
Published: (2024)

Dependency-Aware Semi-Structured Sparsity of GLU Variants in Large Language Models
by: Guo, Zhiyu, et al.
Published: (2024)

IterKey: Iterative Keyword Generation with LLMs for Enhanced Retrieval Augmented Generation
by: Hayashi, Kazuki, et al.
Published: (2025)

Domain Adaptation in Intent Classification Systems: A Review
by: Atuhurra, Jesse, et al.
Published: (2024)

Diagnosing Vision Language Models' Perception by Leveraging Human Methods for Color Vision Deficiencies
by: Hayashi, Kazuki, et al.
Published: (2025)

StructLens: A Structural Lens for Language Models via Maximum Spanning Trees
by: Sakajo, Haruki, et al.
Published: (2026)

Model-based Subsampling for Knowledge Graph Completion
by: Feng, Xincan, et al.
Published: (2023)

BQA: Body Language Question Answering Dataset for Video Large Language Models
by: Ozaki, Shintaro, et al.
Published: (2024)

Unified Interpretation of Smoothing Methods for Negative Sampling Loss Functions in Knowledge Graph Embedding
by: Feng, Xincan, et al.
Published: (2024)

Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates
by: Sakai, Yusuke, et al.
Published: (2024)

Towards Cross-Lingual Explanation of Artwork in Large-scale Vision Language Models
by: Ozaki, Shintaro, et al.
Published: (2024)

From Formal Language Theory to Statistical Learning: Finite Observability of Subregular Languages
by: Hayashi, Katsuhiko, et al.
Published: (2025)

Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models
by: Atuhurra, Jesse, et al.
Published: (2024)

Identifying Influential N-grams in Confidence Calibration via Regression Analysis
by: Ozaki, Shintaro, et al.
Published: (2026)

Toward Automatic Safe Driving Instruction: A Large-Scale Vision Language Model Approach
by: Sakajo, Haruki, et al.
Published: (2025)

Multi-Frame Vision-Language Model for Long-form Reasoning in Driver Behavior Analysis
by: Takato, Hiroshi, et al.
Published: (2024)