Copertina

Struc-EMB: The Potential of Structure-Aware Encoding in Language Embeddings

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Shikun, Wang, Haoyu, Li, Mufei, Li, Pan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Understanding Token Probability Encoding in Output Embeddings
di: Cho, Hakaze, et al.
Pubblicazione: (2024)

Adaptive Pruning for Large Language Models with Structural Importance Awareness
di: Zheng, Haotian, et al.
Pubblicazione: (2024)

Structured Query Construction via Knowledge Graph Embedding
di: Wang, Ruijie, et al.
Pubblicazione: (2019)

Scaling Embeddings Outperforms Scaling Experts in Language Models
di: Liu, Hong, et al.
Pubblicazione: (2026)

SWEA: Updating Factual Knowledge in Large Language Models via Subject Word Embedding Altering
di: Li, Xiaopeng, et al.
Pubblicazione: (2024)

ELF: Embedded Language Flows
di: Hu, Keya, et al.
Pubblicazione: (2026)

HoPE: A Novel Positional Encoding Without Long-Term Decay for Enhanced Context Awareness and Extrapolation
di: Chen, Yuhan, et al.
Pubblicazione: (2024)

Correcting Mean Bias in Text Embeddings: A Refined Renormalization with Training-Free Improvements on MMTEB
di: Ren, Xingyu, et al.
Pubblicazione: (2025)

Large Language Model Unlearning via Embedding-Corrupted Prompts
di: Liu, Chris Yuhao, et al.
Pubblicazione: (2024)

PAT: Pruning-Aware Tuning for Large Language Models
di: Liu, Yijiang, et al.
Pubblicazione: (2024)

Word Embeddings Are Steers for Language Models
di: Han, Chi, et al.
Pubblicazione: (2023)

Trustworthy Summarization via Uncertainty Quantification and Risk Awareness in Large Language Models
di: Pan, Shuaidong, et al.
Pubblicazione: (2025)

Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization
di: Foroutan, Negar, et al.
Pubblicazione: (2025)

Encoding Agent Trajectories as Representations with Sequence Transformers
di: Tsiligkaridis, Athanasios, et al.
Pubblicazione: (2024)

AnglE-optimized Text Embeddings
di: Li, Xianming, et al.
Pubblicazione: (2023)

EmbedLLM: Learning Compact Representations of Large Language Models
di: Zhuang, Richard, et al.
Pubblicazione: (2024)

Exposing LLM Safety Gaps Through Mathematical Encoding:New Attacks and Systematic Analysis
di: Zhang, Haoyu, et al.
Pubblicazione: (2026)

Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training
di: Pan, Rui, et al.
Pubblicazione: (2025)

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
di: Yu, Zhuohao, et al.
Pubblicazione: (2024)

LycheeCluster: Efficient Long-Context Inference with Structure-Aware Chunking and Hierarchical KV Indexing
di: Li, Dongfang, et al.
Pubblicazione: (2026)

GLProtein: Global-and-Local Structure Aware Protein Representation Learning
di: Liu, Yunqing, et al.
Pubblicazione: (2025)

Dual-Modality Multi-Stage Adversarial Safety Training: Robustifying Multimodal Web Agents Against Cross-Modal Attacks
di: Liu, Haoyu, et al.
Pubblicazione: (2026)

Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation
di: Li, Mufei, et al.
Pubblicazione: (2024)

Sink-Aware Pruning for Diffusion Language Models
di: Myrzakhan, Aidar, et al.
Pubblicazione: (2026)

Physics of Language Models: Part 1, Learning Hierarchical Language Structures
di: Allen-Zhu, Zeyuan, et al.
Pubblicazione: (2023)

StrucText-Eval: Evaluating Large Language Model's Reasoning Ability in Structure-Rich Text
di: Gu, Zhouhong, et al.
Pubblicazione: (2024)

The Role of Diversity in In-Context Learning for Large Language Models
di: Xiao, Wenyang, et al.
Pubblicazione: (2025)

Dependency-Aware Semi-Structured Sparsity of GLU Variants in Large Language Models
di: Guo, Zhiyu, et al.
Pubblicazione: (2024)

Group Representational Position Encoding
di: Zhang, Yifan, et al.
Pubblicazione: (2025)

Structured Agent Distillation for Large Language Model
di: Liu, Jun, et al.
Pubblicazione: (2025)

ctELM: Decoding and Manipulating Embeddings of Clinical Trials with Embedding Language Models
di: Ondov, Brian, et al.
Pubblicazione: (2026)

MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttraining
di: Xiaomi, LLM-Core, et al.
Pubblicazione: (2025)

Ovis: Structural Embedding Alignment for Multimodal Large Language Model
di: Lu, Shiyin, et al.
Pubblicazione: (2024)

MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling
di: Limisiewicz, Tomasz, et al.
Pubblicazione: (2024)

Asynchronous and Segmented Bidirectional Encoding for NMT
di: Yang, Jingpu, et al.
Pubblicazione: (2024)

Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings
di: Jiang, Yichen, et al.
Pubblicazione: (2024)

What Do Large Language Models Know? Tacit Knowledge as a Potential Causal-Explanatory Structure
di: Budding, Céline
Pubblicazione: (2025)

LLaSA: Large Language and Structured Data Assistant
di: Xu, Yao, et al.
Pubblicazione: (2024)

PoPE: Legendre Orthogonal Polynomials Based Position Encoding for Large Language Models
di: Aggarwal, Arpit
Pubblicazione: (2024)

Think Before You Prune: Self-Reflective Structured Pruning for Reasoning Language Models
di: Wang, Ziyan, et al.
Pubblicazione: (2025)