Cover Image

Beyond N-gram: Data-Aware X-GRAM Extraction for Efficient Embedding Parameter Scaling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Yilong, Xie, Yanxi, Gao, Zitian, Xin, He, Xiao, Yihao, Liu, Jason Klein, Luo, Haoming, Luo, Yifan, Ye, Zhengmao, Liu, Tingwen, Zhao, Xin, Tao, Ran, Dai, Bryan
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

What Makes Diffusion Language Models Super Data Learners?
by: Gao, Zitian, et al.
Published: (2025)

Universal Reasoning Model
by: Gao, Zitian, et al.
Published: (2025)

One-shot Entropy Minimization
by: Gao, Zitian, et al.
Published: (2025)

Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking
by: Chen, Yilong, et al.
Published: (2025)

Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learning
by: Xie, Tian, et al.
Published: (2025)

Enhancing Startup Success Predictions in Venture Capital: A GraphRAG Augmented Multivariate Time Series Method
by: Gao, Zitian, et al.
Published: (2024)

Gallic Acid Inhibits the Proliferation and Migration of Ovarian Cancer Cells via Inhibition of the PI3K‐AKT Pathway and Promoting M1‐Like Macrophage Polarization
by: Ran Meng, et al.
Published: (2025)

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
by: Liu, Jiacheng, et al.
Published: (2024)

Infini-gram mini: Exact n-gram Search at the Internet Scale with FM-Index
by: Xu, Hao, et al.
Published: (2025)

Enhancing Multimodal Entity and Relation Extraction with Variational Information Bottleneck
by: Cui, Shiyao, et al.
Published: (2023)

Beyond N-grams: A Hierarchical Reward Learning Framework for Clinically-Aware Medical Report Generation
by: Wang, Yuan, et al.
Published: (2025)

Modelling Intertextuality with N-gram Embeddings
by: Xing, Yi
Published: (2025)

FoleyGRAM: Video-to-Audio Generation with GRAM-Aligned Multimodal Encoders
by: Gramaccioni, Riccardo Fosco, et al.
Published: (2025)

Beyond Money: Incentive Effects of Tokenized Ownership on User Contribution in DAOs
by: Kun Chen, et al.
Published: (2025)

Factorized Tail Volatility Model: Augmenting Excess-over-Threshold Method for High-Dimensional Hevay-Tailed Data
by: Hu, Yifan, et al.
Published: (2025)

Bootstrap-based Inference for Bivariate Heteroscedastic Extremes with a Changing Tail Copula
by: Hu, Yifan, et al.
Published: (2024)

Differentiable Topology Estimating from Curvatures for 3D Shapes
by: Luo, Yihao
Published: (2024)

Revisiting Data Scaling in Medical Image Segmentation via Topology-Aware Augmentation
by: Chu, Yuetan, et al.
Published: (2025)

Controlled LLM Training on Spectral Sphere
by: Xie, Tian, et al.
Published: (2026)

Data-Driven Fire Modeling: Learning First Arrival Times and Model Parameters with Neural Networks
by: Tong, Xin, et al.
Published: (2024)

Comparison of two peripheral regional analgesic techniques for primary elective total hip arthroplasty
by: Longsheng Zhang, et al.
Published: (2025)

Scale-Invariant Adversarial Attack against Arbitrary-scale Super-resolution
by: Huang, Yihao, et al.
Published: (2025)

ACT-MNMT Auto-Constriction Turning for Multilingual Neural Machine Translation
by: Dai, Shaojie, et al.
Published: (2024)

When do weakly first-countable spaces and the Scott topology of open set lattice become sober?
by: He, Zhengmao
Published: (2025)

On the boundary layer arising from fast internal waves dynamics
by: Klein, Rupert, et al.
Published: (2023)

Beyond Surface Alignment: Rebuilding LLMs Safety Mechanism via Probabilistically Ablating Refusal Direction
by: Xie, Yuanbo, et al.
Published: (2025)

FFT: Towards Harmlessness Evaluation and Analysis for LLMs with Factuality, Fairness, Toxicity
by: Cui, Shiyao, et al.
Published: (2023)

Constrained PSO Six-Parameter Fuzzy PID Tuning Method for Balanced Optimization of Depth Tracking Performance in Underwater Vehicles
by: Ding, Yanxi, et al.
Published: (2026)

STIndex: A Context-Aware Multi-Dimensional Spatiotemporal Information Extraction System
by: Zhang, Wenxiao, et al.
Published: (2026)

A Disease-Aware Dual-Stage Framework for Chest X-ray Report Generation
by: Wu, Puzhen, et al.
Published: (2025)

Confidence-Aware Self-Distillation for Multimodal Sentiment Analysis with Incomplete Modalities
by: Luo, Yanxi, et al.
Published: (2025)

GRAM: A Generative Foundation Reward Model for Reward Generalization
by: Wang, Chenglong, et al.
Published: (2025)

Document-Level Event Extraction with Definition-Driven ICL
by: Liu, Zhuoyuan, et al.
Published: (2024)

Multimodal Insights into Credit Risk Modelling: Integrating Climate and Text Data for Default Prediction
by: Wu, Zongxiao, et al.
Published: (2026)

GRAM: Global Reasoning for Multi-Page VQA
by: Blau, Tsachi, et al.
Published: (2024)

MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learning
by: Hu, Tianmeng, et al.
Published: (2026)

FR-NAS: Forward-and-Reverse Graph Predictor for Efficient Neural Architecture Search
by: Zhang, Haoming, et al.
Published: (2024)

Learning Where to Embed: Noise-Aware Positional Embedding for Query Retrieval in Small-Object Detection
by: Zeng, Yangchen, et al.
Published: (2026)

Multi-Dimensional Visual Data Recovery: Scale-Aware Tensor Modeling and Accelerated Randomized Computation
by: Qin, Wenjin, et al.
Published: (2026)

ANÁLISE DO POTENCIAL DE AÇÃO BACTERIOLÍTICO DE ROSMARINUS OFFICINALIS FRENTE AS CEPAS GRAM POSITIVAS E GRAM NEGATIVAS
by: Gildemar José Bezerra Crispim
Published: (2013)