LLM-Augmented Semantic Steering of Text Embedding Projection Spaces

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liu, Wei, Krokos, Eric, Whitley, Kirsten, Faust, Rebecca, North, Chris
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909011515801600
author Liu, Wei
Krokos, Eric
Whitley, Kirsten
Faust, Rebecca
North, Chris
author_facet Liu, Wei
Krokos, Eric
Whitley, Kirsten
Faust, Rebecca
North, Chris
contents Low-dimensional projections of text embeddings support visual analysis of document collections, but their spatial organization may not reflect the relationships an analyst intends to examine. Existing semantic interaction approaches encode semantic intent indirectly through geometric constraints or model updates, limiting interpretability and flexibility. We introduce LLM-augmented semantic steering, which enables analysts to express semantic intent by grouping a small set of example documents within the projection. A large language model externalizes this intent as natural-language representations and selectively extends it to related documents; the resulting semantic information is then incorporated into document representations via text augmentation or embedding-level blending, without retraining the underlying models. A case study illustrates how the same corpus can be reorganized from different semantic perspectives, while simulation-based evaluation shows that semantic steering improves global and local alignment with target semantic structures using only minimal interaction. Embedding-level blending further enables continuous and controllable steering of projection layouts. These results position projection spaces as intent-dependent semantic workspaces that can be reshaped through explicit, interpretable, language-mediated interaction.
format Preprint
id arxiv_https___arxiv_org_abs_2605_01957
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LLM-Augmented Semantic Steering of Text Embedding Projection Spaces
Liu, Wei
Krokos, Eric
Whitley, Kirsten
Faust, Rebecca
North, Chris
Human-Computer Interaction
Computation and Language
Low-dimensional projections of text embeddings support visual analysis of document collections, but their spatial organization may not reflect the relationships an analyst intends to examine. Existing semantic interaction approaches encode semantic intent indirectly through geometric constraints or model updates, limiting interpretability and flexibility. We introduce LLM-augmented semantic steering, which enables analysts to express semantic intent by grouping a small set of example documents within the projection. A large language model externalizes this intent as natural-language representations and selectively extends it to related documents; the resulting semantic information is then incorporated into document representations via text augmentation or embedding-level blending, without retraining the underlying models. A case study illustrates how the same corpus can be reorganized from different semantic perspectives, while simulation-based evaluation shows that semantic steering improves global and local alignment with target semantic structures using only minimal interaction. Embedding-level blending further enables continuous and controllable steering of projection layouts. These results position projection spaces as intent-dependent semantic workspaces that can be reshaped through explicit, interpretable, language-mediated interaction.
title LLM-Augmented Semantic Steering of Text Embedding Projection Spaces
topic Human-Computer Interaction
Computation and Language
url https://arxiv.org/abs/2605.01957