Cover Image

Norm of Mean Contextualized Embeddings Determines their Variance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yamagiwa, Hiroaki, Shimodaira, Hidetoshi
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Axis Tour: Word Tour Determines the Order of Axes in ICA-transformed Embeddings
by: Yamagiwa, Hiroaki, et al.
Published: (2024)

Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings
by: Yamagiwa, Hiroaki, et al.
Published: (2024)

Understanding Higher-Order Correlations Among Semantic Components in Embeddings
by: Oyama, Momose, et al.
Published: (2024)

Likelihood Variance as Text Importance for Resampling Texts to Map Language Models
by: Oyama, Momose, et al.
Published: (2025)

Shimo Lab at "Discharge Me!": Discharge Summarization by Prompt-Driven Concatenation of Electronic Health Record Sections
by: He, Yunzhen, et al.
Published: (2024)

Measuring Affinity between Attention-Head Weight Subspaces via the Projection Kernel
by: Yamagiwa, Hiroaki, et al.
Published: (2026)

Mapping 1,000+ Language Models via the Log-Likelihood Vector
by: Oyama, Momose, et al.
Published: (2025)

Quantifying Lexical Semantic Shift via Unbalanced Optimal Transport
by: Kishino, Ryo, et al.
Published: (2024)

Establishing a Scale for Kullback-Leibler Divergence in Language Models Across Various Settings
by: Kishino, Ryo, et al.
Published: (2025)

Domain Mixture Design via Log-Likelihood Differences for Aligning Language Models with a Target Model
by: Kishino, Ryo, et al.
Published: (2026)

3D Rotation and Translation for Hyperbolic Knowledge Graph Embedding
by: Zhu, Yihua, et al.
Published: (2023)

Block-Diagonal Orthogonal Relation and Matrix Entity for Knowledge Graph Embedding
by: Zhu, Yihua, et al.
Published: (2024)

Knowledge Sanitization of Large Language Models
by: Ishibashi, Yoichi, et al.
Published: (2023)

Predicting drug-gene relations via analogy tasks with word embeddings
by: Yamagiwa, Hiroaki, et al.
Published: (2024)

Language Model Maps for Prompt-Response Distributions via Log-Likelihood Vectors
by: Takase, Yusuke, et al.
Published: (2026)

Zipfian Whitening
by: Yokoi, Sho, et al.
Published: (2024)

DeLTa: A Decoding Strategy based on Logit Trajectory Prediction Improves Factuality and Reasoning Ability
by: He, Yunzhen, et al.
Published: (2025)

Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question Answering
by: Zhu, Yihua, et al.
Published: (2025)

Memorization, Emergence, and Explaining Reversal Failures: A Controlled Study of Relational Semantics in LLMs
by: Zhu, Yihua, et al.
Published: (2026)

Reasoning Depth and Environment Complexity: A Controlled Study of RLVR Data Allocation across Logical Reasoning Tasks
by: Zhu, Yihua, et al.
Published: (2026)

Contextual Document Embeddings
by: Morris, John X., et al.
Published: (2024)

Bounds of Chain-of-Thought Robustness: Reasoning Steps, Embed Norms, and Beyond
by: Wang, Dingzirui, et al.
Published: (2025)

Language Detection by Means of the Minkowski Norm: Identification Through Character Bigrams and Frequency Analysis
by: Pogăcean, Paul-Andrei, et al.
Published: (2025)

Span-Aggregatable, Contextualized Word Embeddings for Effective Phrase Mining
by: Orbach, Eyal, et al.
Published: (2024)

Profiling Bias in LLMs: Stereotype Dimensions in Contextual Word Embeddings
by: Schuster, Carolin M., et al.
Published: (2024)

Structural Embedding Projection for Contextual Large Language Model Inference
by: Enoasmo, Vincent, et al.
Published: (2025)

Finding Meaning in Embeddings: Concept Separation Curves
by: Keuren, Paul, et al.
Published: (2026)

Mitigating Gender Bias in Contextual Word Embeddings
by: Yarrabelly, Navya, et al.
Published: (2024)

Do LLMs Know What Is Private Internally? Probing and Steering Contextual Privacy Norms in Large Language Model Representations
by: Wang, Haoran, et al.
Published: (2026)

A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Change
by: Periti, Francesco, et al.
Published: (2024)

TNCSE: Tensor's Norm Constraints for Unsupervised Contrastive Learning of Sentence Embeddings
by: Zong, Tianyu, et al.
Published: (2025)

CTG-KrEW: Generating Synthetic Structured Contextually Correlated Content by Conditional Tabular GAN with K-Means Clustering and Efficient Word Embedding
by: Samanta, Riya, et al.
Published: (2024)

Diffusion-Pretrained Dense and Contextual Embeddings
by: Eslami, Sedigheh, et al.
Published: (2026)

CEMTM: Contextual Embedding-based Multimodal Topic Modeling
by: Abaskohi, Amirhossein, et al.
Published: (2025)

Beyond Logit Lens: Contextual Embeddings for Robust Hallucination Detection & Grounding in VLMs
by: Phukan, Anirudh, et al.
Published: (2024)

Investigating the Contextualised Word Embedding Dimensions Specified for Contextual and Temporal Semantic Changes
by: Aida, Taichi, et al.
Published: (2024)

Comparative Analysis of Static and Contextual Embeddings for Analyzing Semantic Changes in Medieval Latin Charters
by: Liu, Yifan, et al.
Published: (2024)

InvBERT: Reconstructing Text from Contextualized Word Embeddings by inverting the BERT pipeline
by: Kugler, Kai, et al.
Published: (2021)

RAG System for Supporting Japanese Litigation Procedures: Faithful Response Generation Complying with Legal Norms
by: Ishihara, Yuya, et al.
Published: (2025)

GeoNorm: Unify Pre-Norm and Post-Norm with Geodesic Optimization
by: Zheng, Chuanyang, et al.
Published: (2026)