Imagen de Portada

mini-vec2vec: Scaling Universal Geometry Alignment with Linear Transformations

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Dar, Guy
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

player2vec: A Language Modeling Approach to Understand Player Behavior in Games
por: Wang, Tianze, et al.
Publicado: (2024)

Ethics2vec: aligning automatic agents and human preferences
por: Bontempi, Gianluca
Publicado: (2025)

When Can Transformers Count to n?
por: Yehudai, Gilad, et al.
Publicado: (2024)

From melodic note sequences to pitches using word2vec
por: Defays, Daniel
Publicado: (2024)

Task2vec Readiness: Diagnostics for Federated Learning from Pre-Training Embeddings
por: Mafuz, Cristiano, et al.
Publicado: (2026)

Normalization through Fine-tuning: Understanding Wav2vec 2.0 Embeddings for Phonetic Analysis
por: Wang, Yiming, et al.
Publicado: (2025)

The Linear Representation Hypothesis and the Geometry of Large Language Models
por: Park, Kiho, et al.
Publicado: (2023)

miniCTX: Neural Theorem Proving with (Long-)Contexts
por: Hu, Jiewen, et al.
Publicado: (2024)

Mixture of Universal Experts: Scaling Virtual Width via Depth-Width Transformation
por: Chen, Yilong, et al.
Publicado: (2026)

You shall know a piece by the company it keeps. Chess plays as a data for word2vec models
por: Orekhov, Boris
Publicado: (2024)

Your Transformer is Secretly Linear
por: Razzhigaev, Anton, et al.
Publicado: (2024)

Integrating Locality-Aware Attention with Transformers for General Geometry PDEs
por: Koh, Minsu, et al.
Publicado: (2025)

gpuRDF2vec -- Scalable GPU-based RDF2vec
por: Böckling, Martin, et al.
Publicado: (2025)

Asymptotic Universal Alignment: A New Alignment Framework via Test-Time Scaling
por: Cai, Yang, et al.
Publicado: (2026)

Inverse Reinforcement Learning with Dynamic Reward Scaling for LLM Alignment
por: Cheng, Ruoxi, et al.
Publicado: (2025)

SPINAL -- Scaling-law and Preference Integration in Neural Alignment Layers
por: Das, Arion, et al.
Publicado: (2026)

Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms
por: Rafailov, Rafael, et al.
Publicado: (2024)

An Evolved Universal Transformer Memory
por: Cetin, Edoardo, et al.
Publicado: (2024)

ffstruc2vec: Flat, Flexible and Scalable Learning of Node Representations from Structural Identities
por: Heidrich, Mario, et al.
Publicado: (2025)

On the Robustness of Transformers against Context Hijacking for Linear Classification
por: Li, Tianle, et al.
Publicado: (2025)

The Markovian Thinker: Architecture-Agnostic Linear Scaling of Reasoning
por: Aghajohari, Milad, et al.
Publicado: (2025)

Where Pretraining writes and Alignment reads: the asymmetry of Transformer weight space
por: Ruscio, Valeria, et al.
Publicado: (2026)

Universal Conceptual Structure in Neural Translation: Probing NLLB-200's Multilingual Geometry
por: Mathewson, Kyle Elliott
Publicado: (2026)

Cross-Architecture Transfer Learning for Linear-Cost Inference Transformers
por: Choi, Sehyun
Publicado: (2024)

How Alignment Routes: Localizing, Scaling, and Controlling Policy Circuits in Language Models
por: Frank, Gregory N.
Publicado: (2026)

Lying Is Just a Phase: The Hidden Alignment Transition in Language Model Scaling
por: Amin, Adil
Publicado: (2026)

Mixture of Chapters: Scaling Learnt Memory in Transformers
por: Tibrewal, Tasmay Pankaj, et al.
Publicado: (2026)

Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Time
por: Liang, Yingyu, et al.
Publicado: (2024)

Unifying Learning Dynamics and Generalization in Transformers Scaling Law
por: Yang, Chiwun
Publicado: (2025)

Scaling Transformer to 1M tokens and beyond with RMT
por: Bulatov, Aydar, et al.
Publicado: (2023)

ReplaceMe: Network Simplification via Depth Pruning and Transformer Block Linearization
por: Shopkhoev, Dmitriy, et al.
Publicado: (2025)

Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression
por: Fu, Deqing, et al.
Publicado: (2023)

AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations
por: Lian, Jiachen, et al.
Publicado: (2023)

Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws
por: Kamigaito, Hidetaka, et al.
Publicado: (2025)

Linear Chain Transformation: Expanding Optimization Dynamics for Fine-Tuning Large Language Models
por: Wang, Yulong, et al.
Publicado: (2024)

mRNA2vec: mRNA Embedding with Language Model in the 5'UTR-CDS for mRNA Design
por: Zhang, Honggen, et al.
Publicado: (2024)

Fundamental Limits of Prompt Tuning Transformers: Universality, Capacity and Efficiency
por: Hu, Jerry Yao-Chieh, et al.
Publicado: (2024)

MENTIS: What Belief Changes Under Alignment? Measuring Multi-Scale Latent Torsion in Language Models
por: Saha, Partha Pratim, et al.
Publicado: (2026)

POET-X: Memory-efficient LLM Training by Scaling Orthogonal Transformation
por: Qiu, Zeju, et al.
Publicado: (2026)

Bridging the Creativity Understanding Gap: Small-Scale Human Alignment Enables Expert-Level Humor Ranking in LLMs
por: Zhou, Kuan Lok, et al.
Publicado: (2025)