Cover Image

TTPA: Token-level Tool-use Preference Alignment Training Framework with Fine-grained Evaluation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huang, Chengrui, Gao, Shen, Shi, Zhengliang, Wang, Dongsheng, Shang, Shuo
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

What Affects the Stability of Tool Learning? An Empirical Study on the Robustness of Tool Learning Frameworks
by: Huang, Chengrui, et al.
Published: (2024)

CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesis
by: Feng, Ruixiang, et al.
Published: (2025)

Evolution without Large Models: Training Language Model with Task Principles
by: Zhu, Minghang, et al.
Published: (2025)

Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization
by: Cui, Chaoqun, et al.
Published: (2025)

Divide-Then-Aggregate: An Efficient Tool Learning Method via Parallel Tool Invocation
by: Zhu, Dongsheng, et al.
Published: (2025)

TOOL4POI: A Tool-Augmented LLM Framework for Next POI Recommendation
by: Wang, Dongsheng, et al.
Published: (2025)

DPEPO: Diverse Parallel Exploration Policy Optimization for LLM-based Agents
by: Zhang, Junshuo, et al.
Published: (2026)

360$^\circ$REA: Towards A Reusable Experience Accumulation with 360° Assessment for Multi-Agent System
by: Gao, Shen, et al.
Published: (2024)

UltraGen: Extremely Fine-grained Controllable Generation via Attribute Reconstruction and Global Preference Optimization
by: Yun, Longfei, et al.
Published: (2025)

Preference-grounded Token-level Guidance for Language Model Fine-tuning
by: Yang, Shentao, et al.
Published: (2023)

Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agents
by: Shi, Zhengliang, et al.
Published: (2024)

Few Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuning
by: Wang, Guoli, et al.
Published: (2026)

ALiiCE: Evaluating Positional Fine-grained Citation Generation
by: Xu, Yilong, et al.
Published: (2024)

Learning to Use Tools via Cooperative and Interactive Agents
by: Shi, Zhengliang, et al.
Published: (2024)

HTAA: Enhancing LLM Planning via Hybrid Toolset Agentization & Adaptation
by: Huang, Chengrui, et al.
Published: (2026)

Training Language Models to Generate Text with Citations via Fine-grained Rewards
by: Huang, Chengyu, et al.
Published: (2024)

FTP: A Fine-grained Token-wise Pruner for Large Language Models via Token Routing
by: Li, Zekai, et al.
Published: (2024)

HAF-RM: A Hybrid Alignment Framework for Reward Model Training
by: Liu, Shujun, et al.
Published: (2024)

Token-level Direct Preference Optimization
by: Zeng, Yongcheng, et al.
Published: (2024)

FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
by: Ye, Seonghyeon, et al.
Published: (2023)

FineSurE: Fine-grained Summarization Evaluation using LLMs
by: Song, Hwanjun, et al.
Published: (2024)

CATNIP: LLM Unlearning via Calibrated and Tokenized Negative Preference Alignment
by: Yang, Zhengbang, et al.
Published: (2026)

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
by: Zhou, Sifan, et al.
Published: (2025)

Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs
by: Gu, Yuzhe, et al.
Published: (2025)

Beyond Imitation: Leveraging Fine-grained Quality Signals for Alignment
by: Guo, Geyang, et al.
Published: (2023)

StoicLLM: Preference Optimization for Philosophical Alignment in Small Language Models
by: Khan, Ishmam, et al.
Published: (2026)

Fine-grained Spatiotemporal Grounding on Egocentric Videos
by: Liang, Shuo, et al.
Published: (2025)

Token Prepending: A Training-Free Approach for Eliciting Better Sentence Embeddings from LLMs
by: Fu, Yuchen, et al.
Published: (2024)

$λ$-GRPO: Unifying the GRPO Frameworks with Learnable Token Preferences
by: Wang, Yining, et al.
Published: (2025)

Fine-grained Analysis of Brain-LLM Alignment through Input Attribution
by: Proietti, Michela, et al.
Published: (2025)

On-Policy Self-Alignment with Fine-grained Knowledge Feedback for Hallucination Mitigation
by: Wen, Xueru, et al.
Published: (2024)

Evaluating Morphological Alignment of Tokenizers in 70 Languages
by: Arnett, Catherine, et al.
Published: (2025)

FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
by: Jiang, Yuxin, et al.
Published: (2023)

Capability Salience Vector: Fine-grained Alignment of Loss and Capabilities for Downstream Task Scaling Law
by: Ge, Qiming, et al.
Published: (2025)

Precise Localization of Memories: A Fine-grained Neuron-level Knowledge Editing Technique for LLMs
by: Pan, Haowen, et al.
Published: (2025)

AraHalluEval: A Fine-grained Hallucination Evaluation Framework for Arabic LLMs
by: Alansari, Aisha, et al.
Published: (2025)

Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models
by: Shi, Zhengliang, et al.
Published: (2025)

Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levels
by: Ye, Junjie, et al.
Published: (2025)

Weakly Supervised Fine-grained Span-Level Framework for Chinese Radiology Report Quality Assurance
by: Wang, Kaiyu, et al.
Published: (2025)

Self-Constructed Context Decompilation with Fined-grained Alignment Enhancement
by: Feng, Yunlong, et al.
Published: (2024)