Copertina

ssToken: Self-modulated and Semantic-aware Token Selection for LLM Fine-tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qin, Xiaohan, Wang, Xiaoxing, Liao, Ning, Zhang, Cancheng, Zhang, Xiangdong, Feng, Mingquan, Wang, Jingzhi, Yan, Junchi
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

JTok: On Token Embedding as another Axis of Scaling Law via Joint Token Self-modulation
di: Yang, Yebin, et al.
Pubblicazione: (2026)

FineRMoE: Dimension Expansion for Finer-Grained Expert with Its Upcycling Approach
di: Liao, Ning, et al.
Pubblicazione: (2026)

Boosting Order-Preserving and Transferability for Neural Architecture Search: a Joint Architecture Refined Search and Fine-tuning Approach
di: Zhang, Beichen, et al.
Pubblicazione: (2024)

NITP: Next Implicit Token Prediction for LLM Pre-training
di: Zhang, Xiangdong, et al.
Pubblicazione: (2026)

NTKMTL: Mitigating Task Imbalance in Multi-Task Learning from Neural Tangent Kernel Perspective
di: Qin, Xiaohan, et al.
Pubblicazione: (2025)

EvoTok: A Unified Image Tokenizer via Residual Latent Evolution for Visual Understanding and Generation
di: Li, Yan, et al.
Pubblicazione: (2026)

Token-level Data Selection for Safe LLM Fine-tuning
di: Li, Yanping, et al.
Pubblicazione: (2026)

Disentangling Reasoning Tokens and Boilerplate Tokens For Language Model Fine-tuning
di: Ye, Ziang, et al.
Pubblicazione: (2024)

Token Encoding for Semantic Recovery
di: Hu, Jingzhi, et al.
Pubblicazione: (2026)

Semantic-aware Token Selection and Resource Optimization for Communication-efficient Split Federated Fine-tuning in Edge Intelligence
di: Qiang, Xianke, et al.
Pubblicazione: (2026)

Explainable Token-level Noise Filtering for LLM Fine-tuning Datasets
di: Yang, Yuchen, et al.
Pubblicazione: (2026)

Semantic-aware Adversarial Fine-tuning for CLIP
di: Zhang, Jiacheng, et al.
Pubblicazione: (2026)

Towards More Diverse and Challenging Pre-training for Point Cloud Learning: Self-Supervised Cross Reconstruction with Decoupled Views
di: Zhang, Xiangdong, et al.
Pubblicazione: (2025)

Few Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuning
di: Wang, Guoli, et al.
Pubblicazione: (2026)

Preference-grounded Token-level Guidance for Language Model Fine-tuning
di: Yang, Shentao, et al.
Pubblicazione: (2023)

BudgetThinker: Empowering Budget-aware LLM Reasoning with Control Tokens
di: Wen, Hao, et al.
Pubblicazione: (2025)

LeMo: Enabling LEss Token Involvement for MOre Context Fine-tuning
di: Wang, Tuowei, et al.
Pubblicazione: (2025)

Towards Semantic Equivalence of Tokenization in Multimodal LLM
di: Wu, Shengqiong, et al.
Pubblicazione: (2024)

PCP-MAE: Learning to Predict Centers for Point Masked Autoencoders
di: Zhang, Xiangdong, et al.
Pubblicazione: (2024)

Joint Semantic-Channel Coding and Modulation for Token Communications
di: Ying, Jingkai, et al.
Pubblicazione: (2025)

Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning
di: Pang, Jinlong, et al.
Pubblicazione: (2025)

KO: Kinetics-inspired Neural Optimizer with PDE Simulation Approaches
di: Feng, Mingquan, et al.
Pubblicazione: (2025)

Robust Reasoning via Dynamic Token Selection for Distribution-Aligned Self-Distillation
di: Zhang, Ruiqi, et al.
Pubblicazione: (2026)

CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation
di: Ye, Ziqi, et al.
Pubblicazione: (2026)

Beyong Tokens: Item-aware Attention for LLM-based Recommendation
di: Zhang, Xiaokun, et al.
Pubblicazione: (2026)

Unified Batch Normalization: Identifying and Alleviating the Feature Condensation in Batch Normalization and a Unified Framework
di: Wang, Shaobo, et al.
Pubblicazione: (2023)

Efficient Reinforcement Learning with Semantic and Token Entropy for LLM Reasoning
di: Cao, Hongye, et al.
Pubblicazione: (2025)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
di: Zhou, Huichi, et al.
Pubblicazione: (2025)

HELP: HyperNode Expansion and Logical Path-Guided Evidence Localization for Accurate and Efficient GraphRAG
di: Huang, Yuqi, et al.
Pubblicazione: (2026)

Entropy-KL Divergence-based Token Masking: A Novel Approach for Selective Fine-tuning of Large Language Models
di: Liu, Qi, et al.
Pubblicazione: (2026)

Learning Adaptive and Temporally Causal Video Tokenization in a 1D Latent Space
di: Li, Yan, et al.
Pubblicazione: (2025)

Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identification
di: Zhang, Pingping, et al.
Pubblicazione: (2024)

TokenSeek: Memory Efficient Fine Tuning via Instance-Aware Token Ditching
di: Zeng, Runjia, et al.
Pubblicazione: (2026)

MSL: Not All Tokens Are What You Need for Tuning LLM as a Recommender
di: Wang, Bohao, et al.
Pubblicazione: (2025)

Extending Token Computation for LLM Reasoning
di: Liao, Bingli, et al.
Pubblicazione: (2024)

MergeDNA: Context-aware Genome Modeling with Dynamic Tokenization through Token Merging
di: Li, Siyuan, et al.
Pubblicazione: (2025)

PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning
di: Wang, Qibin, et al.
Pubblicazione: (2024)

From Values to Tokens: An LLM-Driven Framework for Context-aware Time Series Forecasting via Symbolic Discretization
di: Tao, Xiaoyu, et al.
Pubblicazione: (2025)

AMP: Autoregressive Motion Prediction Revisited with Next Token Prediction for Autonomous Driving
di: Jia, Xiaosong, et al.
Pubblicazione: (2024)

Representation Learning with Semantic-aware Instance and Sparse Token Alignments
di: Bui, Phuoc-Nguyen, et al.
Pubblicazione: (2026)