Cover Image

Seamlessly Integrating Tree-Based Positional Embeddings into Transformer Models for Source Code Representation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bartkowiak, Patryk, Graliński, Filip
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

EdgeWisePersona: A Dataset for On-Device User Profiling from Natural Language Interactions
by: Bartkowiak, Patryk, et al.
Published: (2025)

Tackling prediction tasks in relational databases with LLMs
by: Wydmuch, Marek, et al.
Published: (2024)

Modeling Programming Skills with Source Code Embeddings for Context-aware Exercise Recommendation
by: Silva, Carlos Eduardo P., et al.
Published: (2026)

Seamless Integration: Sampling Strategies in Federated Learning Systems
by: Legler, Tatjana, et al.
Published: (2024)

TreeFlow: Going beyond Tree-based Gaussian Probabilistic Regression
by: Wielopolski, Patryk, et al.
Published: (2022)

Sparse Concept Anchoring for Interpretable and Controllable Neural Representations
by: Fraser, Sandy, et al.
Published: (2025)

Platform for Representation and Integration of multimodal Molecular Embeddings
by: Zheng, Erika Yilin, et al.
Published: (2025)

Rotary Position Embedding for Vision Transformer
by: Heo, Byeongho, et al.
Published: (2024)

A Survey of Source Code Representations for Machine Learning-Based Cybersecurity Tasks
by: Casey, Beatrice, et al.
Published: (2024)

RoTHP: Rotary Position Embedding-based Transformer Hawkes Process
by: Gao, Anningzhe, et al.
Published: (2024)

ZEUS: Zero-shot Embeddings for Unsupervised Separation of Tabular Data
by: Marszałek, Patryk, et al.
Published: (2025)

Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients
by: Mora, Alessio, et al.
Published: (2025)

Smoothed Graph Contrastive Learning via Seamless Proximity Integration
by: Behmanesh, Maysam, et al.
Published: (2024)

KEEP: Integrating Medical Ontologies with Clinical Data for Robust Code Embeddings
by: Elhussein, Ahmed, et al.
Published: (2025)

SemRep: Generative Code Representation Learning with Code Transformations
by: Li, Weichen, et al.
Published: (2026)

Causality-Induced Positional Encoding for Transformer-Based Representation Learning of Non-Sequential Features
by: Xu, Kaichen, et al.
Published: (2025)

Positional Encoding in Transformer-Based Time Series Models: A Survey
by: Irani, Habib, et al.
Published: (2025)

Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
by: Zuo, Chunsheng, et al.
Published: (2024)

Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Models
by: Kubaty, Piotr, et al.
Published: (2026)

A Novel Spinor-Based Embedding Model for Transformers
by: White, Rick
Published: (2024)

Universal Properties of Activation Sparsity in Modern Large Language Models
by: Szatkowski, Filip, et al.
Published: (2025)

CodeSAM: Source Code Representation Learning by Infusing Self-Attention with Multi-Code-View Graphs
by: Mathai, Alex, et al.
Published: (2024)

Poisoned Source Code Detection in Code Models
by: Ghannoum, Ehab, et al.
Published: (2025)

Leveraging Manifold Embeddings for Enhanced Graph Transformer Representations and Learning
by: Jyothish, Ankit, et al.
Published: (2025)

Maximizing the Position Embedding for Vision Transformers with Global Average Pooling
by: Lee, Wonjun, et al.
Published: (2025)

A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer
by: Lu, Hanxiao, et al.
Published: (2024)

Pool Me Wisely: On the Effect of Pooling in Transformer-Based Models
by: Ennadir, Sofiane, et al.
Published: (2025)

Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers
by: Liu, Feilong
Published: (2026)

Beyond Code Contributions: How Network Position, Temporal Bursts, and Code Review Activities Shape Contributor Influence in Large-Scale Open Source Ecosystems
by: Karim, S M Rakib Ul, et al.
Published: (2026)

Seamless Monitoring of Stress Levels Leveraging a Universal Model for Time Sequences
by: Gabrielli, Davide, et al.
Published: (2024)

Tab-PET: Graph-Based Positional Encodings for Tabular Transformers
by: Leng, Yunze, et al.
Published: (2025)

Residual Cross-Attention Transformer-Based Multi-User CSI Feedback with Deep Joint Source-Channel Coding
by: Zhang, Hengwei, et al.
Published: (2025)

Refining Joint Text and Source Code Embeddings for Retrieval Task with Parameter-Efficient Fine-Tuning
by: Galliamov, Karim, et al.
Published: (2024)

In-Context Source and Channel Coding
by: Wang, Ziqiong, et al.
Published: (2026)

A General Representation-Based Approach to Multi-Source Domain Adaptation
by: Ng, Ignavier, et al.
Published: (2026)

Selective Rotary Position Embedding
by: Movahedi, Sajad, et al.
Published: (2025)

How to Protect Models against Adversarial Unlearning?
by: Jasiorski, Patryk, et al.
Published: (2025)

Increasing Interaction Fidelity: Training Routines for Biomechanical Models in HCI
by: Miazga, Michał Patryk, et al.
Published: (2025)

Beyond Isolated Clients: Integrating Graph-Based Embeddings into Event Sequence Models
by: Proshian, Harry, et al.
Published: (2026)

An Unbiased Transformer Source Code Learning with Semantic Vulnerability Graph
by: Islam, Nafis Tanveer, et al.
Published: (2023)