Seamlessly Integrating Tree-Based Positional Embeddings into Transformer Models for Source Code Representation
Fuente:
arXiv
Saved in:
| Main Authors: | Bartkowiak, Patryk, Graliński, Filip |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
EdgeWisePersona: A Dataset for On-Device User Profiling from Natural Language Interactions
by: Bartkowiak, Patryk, et al.
Published: (2025)
by: Bartkowiak, Patryk, et al.
Published: (2025)
Tackling prediction tasks in relational databases with LLMs
by: Wydmuch, Marek, et al.
Published: (2024)
by: Wydmuch, Marek, et al.
Published: (2024)
Modeling Programming Skills with Source Code Embeddings for Context-aware Exercise Recommendation
by: Silva, Carlos Eduardo P., et al.
Published: (2026)
by: Silva, Carlos Eduardo P., et al.
Published: (2026)
Seamless Integration: Sampling Strategies in Federated Learning Systems
by: Legler, Tatjana, et al.
Published: (2024)
by: Legler, Tatjana, et al.
Published: (2024)
TreeFlow: Going beyond Tree-based Gaussian Probabilistic Regression
by: Wielopolski, Patryk, et al.
Published: (2022)
by: Wielopolski, Patryk, et al.
Published: (2022)
Sparse Concept Anchoring for Interpretable and Controllable Neural Representations
by: Fraser, Sandy, et al.
Published: (2025)
by: Fraser, Sandy, et al.
Published: (2025)
Platform for Representation and Integration of multimodal Molecular Embeddings
by: Zheng, Erika Yilin, et al.
Published: (2025)
by: Zheng, Erika Yilin, et al.
Published: (2025)
Rotary Position Embedding for Vision Transformer
by: Heo, Byeongho, et al.
Published: (2024)
by: Heo, Byeongho, et al.
Published: (2024)
A Survey of Source Code Representations for Machine Learning-Based Cybersecurity Tasks
by: Casey, Beatrice, et al.
Published: (2024)
by: Casey, Beatrice, et al.
Published: (2024)
RoTHP: Rotary Position Embedding-based Transformer Hawkes Process
by: Gao, Anningzhe, et al.
Published: (2024)
by: Gao, Anningzhe, et al.
Published: (2024)
ZEUS: Zero-shot Embeddings for Unsupervised Separation of Tabular Data
by: Marszałek, Patryk, et al.
Published: (2025)
by: Marszałek, Patryk, et al.
Published: (2025)
Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients
by: Mora, Alessio, et al.
Published: (2025)
by: Mora, Alessio, et al.
Published: (2025)
Smoothed Graph Contrastive Learning via Seamless Proximity Integration
by: Behmanesh, Maysam, et al.
Published: (2024)
by: Behmanesh, Maysam, et al.
Published: (2024)
KEEP: Integrating Medical Ontologies with Clinical Data for Robust Code Embeddings
by: Elhussein, Ahmed, et al.
Published: (2025)
by: Elhussein, Ahmed, et al.
Published: (2025)
SemRep: Generative Code Representation Learning with Code Transformations
by: Li, Weichen, et al.
Published: (2026)
by: Li, Weichen, et al.
Published: (2026)
Causality-Induced Positional Encoding for Transformer-Based Representation Learning of Non-Sequential Features
by: Xu, Kaichen, et al.
Published: (2025)
by: Xu, Kaichen, et al.
Published: (2025)
Positional Encoding in Transformer-Based Time Series Models: A Survey
by: Irani, Habib, et al.
Published: (2025)
by: Irani, Habib, et al.
Published: (2025)
Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
by: Zuo, Chunsheng, et al.
Published: (2024)
by: Zuo, Chunsheng, et al.
Published: (2024)
Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Models
by: Kubaty, Piotr, et al.
Published: (2026)
by: Kubaty, Piotr, et al.
Published: (2026)
A Novel Spinor-Based Embedding Model for Transformers
by: White, Rick
Published: (2024)
by: White, Rick
Published: (2024)
Universal Properties of Activation Sparsity in Modern Large Language Models
by: Szatkowski, Filip, et al.
Published: (2025)
by: Szatkowski, Filip, et al.
Published: (2025)
CodeSAM: Source Code Representation Learning by Infusing Self-Attention with Multi-Code-View Graphs
by: Mathai, Alex, et al.
Published: (2024)
by: Mathai, Alex, et al.
Published: (2024)
Poisoned Source Code Detection in Code Models
by: Ghannoum, Ehab, et al.
Published: (2025)
by: Ghannoum, Ehab, et al.
Published: (2025)
Leveraging Manifold Embeddings for Enhanced Graph Transformer Representations and Learning
by: Jyothish, Ankit, et al.
Published: (2025)
by: Jyothish, Ankit, et al.
Published: (2025)
Maximizing the Position Embedding for Vision Transformers with Global Average Pooling
by: Lee, Wonjun, et al.
Published: (2025)
by: Lee, Wonjun, et al.
Published: (2025)
A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer
by: Lu, Hanxiao, et al.
Published: (2024)
by: Lu, Hanxiao, et al.
Published: (2024)
Pool Me Wisely: On the Effect of Pooling in Transformer-Based Models
by: Ennadir, Sofiane, et al.
Published: (2025)
by: Ennadir, Sofiane, et al.
Published: (2025)
Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers
by: Liu, Feilong
Published: (2026)
by: Liu, Feilong
Published: (2026)
Beyond Code Contributions: How Network Position, Temporal Bursts, and Code Review Activities Shape Contributor Influence in Large-Scale Open Source Ecosystems
by: Karim, S M Rakib Ul, et al.
Published: (2026)
by: Karim, S M Rakib Ul, et al.
Published: (2026)
Seamless Monitoring of Stress Levels Leveraging a Universal Model for Time Sequences
by: Gabrielli, Davide, et al.
Published: (2024)
by: Gabrielli, Davide, et al.
Published: (2024)
Tab-PET: Graph-Based Positional Encodings for Tabular Transformers
by: Leng, Yunze, et al.
Published: (2025)
by: Leng, Yunze, et al.
Published: (2025)
Residual Cross-Attention Transformer-Based Multi-User CSI Feedback with Deep Joint Source-Channel Coding
by: Zhang, Hengwei, et al.
Published: (2025)
by: Zhang, Hengwei, et al.
Published: (2025)
Refining Joint Text and Source Code Embeddings for Retrieval Task with Parameter-Efficient Fine-Tuning
by: Galliamov, Karim, et al.
Published: (2024)
by: Galliamov, Karim, et al.
Published: (2024)
In-Context Source and Channel Coding
by: Wang, Ziqiong, et al.
Published: (2026)
by: Wang, Ziqiong, et al.
Published: (2026)
A General Representation-Based Approach to Multi-Source Domain Adaptation
by: Ng, Ignavier, et al.
Published: (2026)
by: Ng, Ignavier, et al.
Published: (2026)
Selective Rotary Position Embedding
by: Movahedi, Sajad, et al.
Published: (2025)
by: Movahedi, Sajad, et al.
Published: (2025)
How to Protect Models against Adversarial Unlearning?
by: Jasiorski, Patryk, et al.
Published: (2025)
by: Jasiorski, Patryk, et al.
Published: (2025)
Increasing Interaction Fidelity: Training Routines for Biomechanical Models in HCI
by: Miazga, Michał Patryk, et al.
Published: (2025)
by: Miazga, Michał Patryk, et al.
Published: (2025)
Beyond Isolated Clients: Integrating Graph-Based Embeddings into Event Sequence Models
by: Proshian, Harry, et al.
Published: (2026)
by: Proshian, Harry, et al.
Published: (2026)
An Unbiased Transformer Source Code Learning with Semantic Vulnerability Graph
by: Islam, Nafis Tanveer, et al.
Published: (2023)
by: Islam, Nafis Tanveer, et al.
Published: (2023)
Similar Items
-
EdgeWisePersona: A Dataset for On-Device User Profiling from Natural Language Interactions
by: Bartkowiak, Patryk, et al.
Published: (2025) -
Tackling prediction tasks in relational databases with LLMs
by: Wydmuch, Marek, et al.
Published: (2024) -
Modeling Programming Skills with Source Code Embeddings for Context-aware Exercise Recommendation
by: Silva, Carlos Eduardo P., et al.
Published: (2026) -
Seamless Integration: Sampling Strategies in Federated Learning Systems
by: Legler, Tatjana, et al.
Published: (2024) -
TreeFlow: Going beyond Tree-based Gaussian Probabilistic Regression
by: Wielopolski, Patryk, et al.
Published: (2022)