Copertina

Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian Distribution

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhao, Haiyan, Zhao, Heng, Shen, Bo, Payani, Ali, Yang, Fan, Du, Mengnan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Rep2Text: Decoding Full Text from a Single LLM Token Representation
di: Zhao, Haiyan, et al.
Pubblicazione: (2025)

Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering
di: Zhao, Haiyan, et al.
Pubblicazione: (2025)

SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models
di: He, Zirui, et al.
Pubblicazione: (2025)

Exploring Concept Depth: How Large Language Models Acquire Knowledge and Concept at Different Layers?
di: Jin, Mingyu, et al.
Pubblicazione: (2024)

Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders
di: Shu, Dong, et al.
Pubblicazione: (2025)

Exploring Multilingual Probing in Large Language Models: A Cross-Language Analysis
di: Li, Daoyang, et al.
Pubblicazione: (2024)

Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languages
di: Li, Zihao, et al.
Pubblicazione: (2024)

Universal Activation Verbalizer: A Unified Framework for Cross-Model Activation Explanation
di: Zhao, Haiyan, et al.
Pubblicazione: (2026)

A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Models
di: Shu, Dong, et al.
Pubblicazione: (2025)

NEAT: Concept driven Neuron Attribution in LLMs
di: Kavuri, Vivek Hruday, et al.
Pubblicazione: (2025)

Program Semantic Inequivalence Game with Large Language Models
di: Miceli-Barone, Antonio Valerio, et al.
Pubblicazione: (2025)

Large Language Models Are Bad Dice Players: LLMs Struggle to Generate Random Numbers from Statistical Distributions
di: Zhao, Minda, et al.
Pubblicazione: (2026)

Comparative Analysis of Demonstration Selection Algorithms for LLM In-Context Learning
di: Shu, Dong, et al.
Pubblicazione: (2024)

Fine-Grained Interpretation of Political Opinions in Large Language Models
di: Hu, Jingyu, et al.
Pubblicazione: (2025)

A Survey on Large Language Models from Concept to Implementation
di: Wang, Chen, et al.
Pubblicazione: (2024)

Beyond Individual Facts: Investigating Categorical Knowledge Locality of Taxonomy and Meronomy Concepts in GPT Models
di: Burger, Christopher, et al.
Pubblicazione: (2024)

AdvAnchor: Enhancing Diffusion Model Unlearning with Adversarial Anchors
di: Zhao, Mengnan, et al.
Pubblicazione: (2024)

Steering Out-of-Distribution Generalization with Concept Ablation Fine-Tuning
di: Casademunt, Helena, et al.
Pubblicazione: (2025)

Fair In-Context Learning via Latent Concept Variables
di: Bhaila, Karuna, et al.
Pubblicazione: (2024)

Concept Tokens: Learning Behavioral Embeddings Through Concept Definitions
di: Sastre, Ignacio, et al.
Pubblicazione: (2026)

One Example Shown, Many Concepts Known! Counterexample-Driven Conceptual Reasoning in Mathematical LLMs
di: Li, Yinghui, et al.
Pubblicazione: (2025)

Dictionary-Aligned Concept Control for Safeguarding Multimodal LLMs
di: Luo, Jinqi, et al.
Pubblicazione: (2026)

Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods
di: Cao, Yuji, et al.
Pubblicazione: (2024)

All You Need is One: Capsule Prompt Tuning with a Single Vector
di: Liu, Yiyang, et al.
Pubblicazione: (2025)

From Concepts to Components: Concept-Agnostic Attention Module Discovery in Transformers
di: Su, Jingtong, et al.
Pubblicazione: (2025)

Latent Concept Disentanglement in Transformer-based Language Models
di: Hong, Guan Zhe, et al.
Pubblicazione: (2025)

The Geometry of Categorical and Hierarchical Concepts in Large Language Models
di: Park, Kiho, et al.
Pubblicazione: (2024)

Variational Language Concepts for Interpreting Foundation Language Models
di: Wang, Hengyi, et al.
Pubblicazione: (2024)

ConceptFlow: Hierarchical and Fine-grained Concept-Based Explanation for Convolutional Neural Networks
di: Mu, Xinyu, et al.
Pubblicazione: (2025)

Joint Detection of Fraud and Concept Drift inOnline Conversations with LLM-Assisted Judgment
di: Senol, Ali, et al.
Pubblicazione: (2025)

Cross-Layer Discrete Concept Discovery for Interpreting Language Models
di: Garg, Ankur, et al.
Pubblicazione: (2025)

Interpreting Language Models Through Concept Descriptions: A Survey
di: Feldhus, Nils, et al.
Pubblicazione: (2025)

Recursive Concept Evolution for Compositional Reasoning in Large Language Models
di: Chaudhry, Sarim
Pubblicazione: (2026)

Improving Large Language Models with Concept-Aware Fine-Tuning
di: Chen, Michael K., et al.
Pubblicazione: (2025)

Unveiling the Mystery of Weight in Large Foundation Models: Gaussian Distribution Never Fades
di: Si, Chongjie, et al.
Pubblicazione: (2025)

The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independence
di: Wollschläger, Tom, et al.
Pubblicazione: (2025)

Mathematical Reasoning via Intervention-Based Time-Series Causal Discovery Using LLMs as Concept Mastery Simulators
di: Okita, Tsuyoshi
Pubblicazione: (2026)

Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
di: Li, Jiaang, et al.
Pubblicazione: (2023)

Estimation of Concept Explanations Should be Uncertainty Aware
di: Piratla, Vihari, et al.
Pubblicazione: (2023)

Addressing LLM Diversity by Infusing Random Concepts
di: Agrawal, Pulin, et al.
Pubblicazione: (2026)