Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hamara, Andrew, Hamerly, Greg, Rivas, Pablo, Freeman, Andrew C.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2511.09477
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914153626599424
author Hamara, Andrew
Hamerly, Greg
Rivas, Pablo
Freeman, Andrew C.
author_facet Hamara, Andrew
Hamerly, Greg
Rivas, Pablo
Freeman, Andrew C.
contents Planning in high-dimensional decision spaces is increasingly being studied through the lens of learned representations. Rather than training policies or value heads, we investigate whether planning can be carried out directly in an evaluation-aligned embedding space. We introduce SOLIS, which learns such a space using supervised contrastive learning. In this representation, outcome similarity is captured by proximity, and a single global advantage vector orients the space from losing to winning regions. Candidate actions are then ranked according to their alignment with this direction, reducing planning to vector operations in latent space. We demonstrate this approach in chess, where SOLIS uses only a shallow search guided by the learned embedding to reach competitive strength under constrained conditions. More broadly, our results suggest that evaluation-aligned latent planning offers a lightweight alternative to traditional dynamics models or policy learning.
format Preprint
id arxiv_https___arxiv_org_abs_2511_09477
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Latent Planning via Embedding Arithmetic: A Contrastive Approach to Strategic Reasoning
Hamara, Andrew
Hamerly, Greg
Rivas, Pablo
Freeman, Andrew C.
Machine Learning
Planning in high-dimensional decision spaces is increasingly being studied through the lens of learned representations. Rather than training policies or value heads, we investigate whether planning can be carried out directly in an evaluation-aligned embedding space. We introduce SOLIS, which learns such a space using supervised contrastive learning. In this representation, outcome similarity is captured by proximity, and a single global advantage vector orients the space from losing to winning regions. Candidate actions are then ranked according to their alignment with this direction, reducing planning to vector operations in latent space. We demonstrate this approach in chess, where SOLIS uses only a shallow search guided by the learned embedding to reach competitive strength under constrained conditions. More broadly, our results suggest that evaluation-aligned latent planning offers a lightweight alternative to traditional dynamics models or policy learning.
title Latent Planning via Embedding Arithmetic: A Contrastive Approach to Strategic Reasoning
topic Machine Learning
url https://arxiv.org/abs/2511.09477