Cover Image

Qwen-Scope: Turning Sparse Features into Development Tools for Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Deng, Boyi, Wang, Xu, Wang, Yaoning, Wan, Yu, Ma, Yubo, Yang, Baosong, Wei, Haoran, Tang, Jialong, Lin, Huan, Gao, Ruize, Li, Tianhao, Cao, Qian, Ren, Xuancheng, Deng, Xiaodong, Yang, An, Huang, Fei, Liu, Dayiheng, Zhou, Jingren
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Unveiling Language-Specific Features in Large Language Models via Sparse Autoencoders
by: Deng, Boyi, et al.
Published: (2025)

SASFT: Sparse Autoencoder-guided Supervised Finetuning to Mitigate Unexpected Code-Switching in LLMs
by: Deng, Boyi, et al.
Published: (2025)

Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
by: Zhang, Yanzhao, et al.
Published: (2025)

Qwen3 Technical Report
by: Yang, An, et al.
Published: (2025)

Qwen2 Technical Report
by: Yang, An, et al.
Published: (2024)

P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs
by: Zhang, Yidan, et al.
Published: (2024)

Qwen2.5 Technical Report
by: Qwen, et al.
Published: (2024)

Qwen2.5-Coder Technical Report
by: Hui, Binyuan, et al.
Published: (2024)

Towards Cross-lingual Values Judgment: A Consensus-Pluralism Perspective
by: Chen, Yukun, et al.
Published: (2026)

Qwen3Guard Technical Report
by: Zhao, Haiquan, et al.
Published: (2025)

Qwen3-ASR Technical Report
by: Shi, Xian, et al.
Published: (2026)

DLM-Scope: Mechanistic Interpretability of Diffusion Language Models via Sparse Autoencoders
by: Wang, Xu, et al.
Published: (2026)

Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Ranking
by: Li, Mingxin, et al.
Published: (2026)

Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
by: Wang, Peng, et al.
Published: (2024)

Controllable LLM Reasoning via Sparse Autoencoder-Based Steering
by: Fang, Yi, et al.
Published: (2026)

Enhancing LLM Language Adaption through Cross-lingual In-Context Pre-training
by: Wu, Linjuan, et al.
Published: (2025)

Qwen3-TTS Technical Report
by: Hu, Hangrui, et al.
Published: (2026)

Qwen3-Omni Technical Report
by: Xu, Jin, et al.
Published: (2025)

Qwen3-VL Technical Report
by: Bai, Shuai, et al.
Published: (2025)

QwenLong-L1.5: Post-Training Recipe for Long-Context Reasoning and Memory Management
by: Shen, Weizhou, et al.
Published: (2025)

Qwen2.5-1M Technical Report
by: Yang, An, et al.
Published: (2025)

QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement Learning
by: Wan, Fanqi, et al.
Published: (2025)

CultureSynth: A Hierarchical Taxonomy-Guided and Retrieval-Augmented Framework for Cultural Question-Answer Synthesis
by: Zhang, Xinyu, et al.
Published: (2025)

Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement
by: Yang, An, et al.
Published: (2024)

Direct Simultaneous Translation Activation for Large Audio-Language Models
by: Zhang, Pei, et al.
Published: (2025)

Qwen-Image Technical Report
by: Wu, Chenfei, et al.
Published: (2025)

An Encoder-Decoder Network for Beamforming over Sparse Large-Scale MIMO Channels
by: Zhang, Yubo, et al.
Published: (2025)

QwenLong-CPRS: Towards $\infty$-LLMs with Dynamic Context Optimization
by: Shen, Weizhou, et al.
Published: (2025)

Qwen2-Audio Technical Report
by: Chu, Yunfei, et al.
Published: (2024)

Cohn--Vossen-Type Inequalities for Three-Manifolds and Locally Conformally Flat Manifolds
by: Deng, Jialong
Published: (2026)

Scalar Curvature in Dimension 4
by: Deng, Jialong
Published: (2025)

Language as a Latent Variable for Reasoning Optimization
by: Wu, Linjuan, et al.
Published: (2026)

EffiEval: Efficient and Generalizable Model Evaluation via Capability Coverage Maximization
by: Wang, Yaoning, et al.
Published: (2025)

Taming Polysemanticity in LLMs: Provable Feature Recovery via Sparse Autoencoders
by: Chen, Siyu, et al.
Published: (2025)

PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts
by: Wang, Yiming, et al.
Published: (2025)

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training
by: Tang, Shengkun, et al.
Published: (2026)

MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation
by: Li, Xiaoyuan, et al.
Published: (2025)

MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting
by: Li, Tianhao, et al.
Published: (2024)

SparseDFF: Sparse-View Feature Distillation for One-Shot Dexterous Manipulation
by: Wang, Qianxu, et al.
Published: (2023)

ToolScope: An Agentic Framework for Vision-Guided and Long-Horizon Tool Use
by: Deng, Mengjie, et al.
Published: (2025)