Copertina

Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	He, Zhenyu, Feng, Guhao, Luo, Shengjie, Yang, Kai, Wang, Liwei, Xu, Jingjing, Zhang, Zhi, Yang, Hongxia, He, Di
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding
di: Zhao, Liang, et al.
Pubblicazione: (2023)

How Numerical Precision Affects Arithmetical Reasoning Capabilities of LLMs
di: Feng, Guhao, et al.
Pubblicazione: (2024)

Do Efficient Transformers Really Save Computation?
di: Yang, Kai, et al.
Pubblicazione: (2024)

Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs
di: Ma, Xin, et al.
Pubblicazione: (2024)

Let the Code LLM Edit Itself When You Edit the Code
di: He, Zhenyu, et al.
Pubblicazione: (2024)

In-Place Test-Time Training
di: Feng, Guhao, et al.
Pubblicazione: (2026)

DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
di: Zheng, Chuanyang, et al.
Pubblicazione: (2024)

Hitting Two Birds With One Stone: Dual Modulation of Brain Carbonic Anhydrases and Histone Deacetylases Boosts Memory Consolidation
di: Alessia Costa, et al.
Pubblicazione: (2025)

Theoretical Benefit and Limitation of Diffusion Language Model
di: Feng, Guhao, et al.
Pubblicazione: (2025)

Two Birds With One Stone: Digitisation of Tax Administration and the Digital Transformation of Firms
di: Huiqiang Ni, et al.
Pubblicazione: (2025)

MEP: Multiple Kernel Learning Enhancing Relative Positional Encoding Length Extrapolation
di: Gao, Weiguo
Pubblicazione: (2024)

Rethinking the Expressive Power of GNNs via Graph Biconnectivity
di: Zhang, Bohang, et al.
Pubblicazione: (2023)

One Stone, Two Birds: Using Vapor Kinetic Energy to Detect and Understand Atmospheric Rivers
di: Ong, Hing, et al.
Pubblicazione: (2024)

Bayesian Attention Mechanism: A Probabilistic Framework for Positional Encoding and Context Length Extrapolation
di: Bianchessi, Arthur S., et al.
Pubblicazione: (2025)

Diagnosing and Improving Diffusion Models by Estimating the Optimal Loss Value
di: Xu, Yixian, et al.
Pubblicazione: (2025)

One Stone, Two Birds: Enhancing Adversarial Defense Through the Lens of Distributional Discrepancy
di: Zhang, Jiacheng, et al.
Pubblicazione: (2025)

One‐Stone‐Two‐Birds Carrier‐Free Nano‐Cocktail Enables Synergistic Eradication of Cancer Cells/Stem Cells in Breast Cancer Treatment
di: Tongyao Zhao, et al.
Pubblicazione: (2025)

ParallelComp: Parallel Long-Context Compressor for Length Extrapolation
di: Xiong, Jing, et al.
Pubblicazione: (2025)

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
di: Choromanski, Krzysztof Marcin, et al.
Pubblicazione: (2023)

A Strategy of Killing Two Birds With One Stone for Blocking Drug Resistance Spread With Engineered Bdellovibrio bacteriovorus
di: Yu Rao, et al.
Pubblicazione: (2024)

HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position
di: Zhang, Kechi, et al.
Pubblicazione: (2024)

Rethinking Model-based, Policy-based, and Value-based Reinforcement Learning via the Lens of Representation Complexity
di: Feng, Guhao, et al.
Pubblicazione: (2023)

Two Birds With One Stone: Beamforming Design for Target Sensing and Proactive Eavesdropping
di: Dan, Qian, et al.
Pubblicazione: (2024)

Two Birds with One Stone: Improving Rumor Detection by Addressing the Unfairness Issue
di: Chen, Junyi, et al.
Pubblicazione: (2024)

Two Birds with One Stone: Differential Privacy by Low-power SRAM Memory
di: Liu, Jianqing, et al.
Pubblicazione: (2024)

Two Birds with One Stone: Multi-Task Semantic Communications Systems over Relay Channel
di: Cao, Yujie, et al.
Pubblicazione: (2024)

Kill Two Birds with One Stone! Trajectory enabled Unified Online Detection of Adversarial Examples and Backdoor Attacks
di: Fu, Anmin, et al.
Pubblicazione: (2025)

Enzyme‐Empowered “Two Birds with One Stone” Strategy for Amplifying Tumor Apoptosis and Metabolic Clearance
di: Hanyue Li, et al.
Pubblicazione: (2024)

One Stone with Two Birds: A Null-Text-Null Frequency-Aware Diffusion Models for Text-Guided Image Inpainting
di: Liu, Haipeng, et al.
Pubblicazione: (2025)

Two Birds With One Stone: Enhancing Communication and Sensing via Multi-Functional RIS
di: Ni, Wanli, et al.
Pubblicazione: (2024)

Two Birds with One Stone: Multi-Task Detection and Attribution of LLM-Generated Text
di: Rao, Zixin, et al.
Pubblicazione: (2025)

Kill Two Birds With One Stone? China's Mixed Ownership Reform and Investment Efficiency
di: Liying Ren, et al.
Pubblicazione: (2025)

Effective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation
di: Lu, Yi, et al.
Pubblicazione: (2025)

Two Birds with One Stone: Eco‐Friendly Nano‐Formulation Endows a Commercial Fungicide with Excellent Insecticidal Activity
di: Dongdong Huang, et al.
Pubblicazione: (2025)

Two Birds with One Stone: Guanidyl Carbon Dots with Enhanced Antioxidative and Lipolytic Functions in Metabolic Associated Fatty Liver
di: Hao Cai, et al.
Pubblicazione: (2024)

Bridging Geometric States via Geometric Diffusion Bridge
di: Luo, Shengjie, et al.
Pubblicazione: (2024)

DPO Meets PPO: Reinforced Token Optimization for RLHF
di: Zhong, Han, et al.
Pubblicazione: (2024)

Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppression
di: Huang, Jiameng, et al.
Pubblicazione: (2025)

Two Birds with One Stone: Enhancing Uncertainty Quantification and Interpretability with Graph Functional Neural Process
di: Kong, Lingkai, et al.
Pubblicazione: (2025)

A “One‐Stone‐Two‐Birds” Strategy Constructed Hybrid Wearable Device Based on Chameleon‐Inspired Integrated Pressure Sensing and Visualization
di: Tao Sun, et al.
Pubblicazione: (2025)