Copertina

Seamlessly Integrating Tree-Based Positional Embeddings into Transformer Models for Source Code Representation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Bartkowiak, Patryk, Graliński, Filip
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

EdgeWisePersona: A Dataset for On-Device User Profiling from Natural Language Interactions
di: Bartkowiak, Patryk, et al.
Pubblicazione: (2025)

Tackling prediction tasks in relational databases with LLMs
di: Wydmuch, Marek, et al.
Pubblicazione: (2024)

Modeling Programming Skills with Source Code Embeddings for Context-aware Exercise Recommendation
di: Silva, Carlos Eduardo P., et al.
Pubblicazione: (2026)

Seamless Integration: Sampling Strategies in Federated Learning Systems
di: Legler, Tatjana, et al.
Pubblicazione: (2024)

TreeFlow: Going beyond Tree-based Gaussian Probabilistic Regression
di: Wielopolski, Patryk, et al.
Pubblicazione: (2022)

Sparse Concept Anchoring for Interpretable and Controllable Neural Representations
di: Fraser, Sandy, et al.
Pubblicazione: (2025)

Platform for Representation and Integration of multimodal Molecular Embeddings
di: Zheng, Erika Yilin, et al.
Pubblicazione: (2025)

Rotary Position Embedding for Vision Transformer
di: Heo, Byeongho, et al.
Pubblicazione: (2024)

A Survey of Source Code Representations for Machine Learning-Based Cybersecurity Tasks
di: Casey, Beatrice, et al.
Pubblicazione: (2024)

RoTHP: Rotary Position Embedding-based Transformer Hawkes Process
di: Gao, Anningzhe, et al.
Pubblicazione: (2024)

ZEUS: Zero-shot Embeddings for Unsupervised Separation of Tabular Data
di: Marszałek, Patryk, et al.
Pubblicazione: (2025)

Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients
di: Mora, Alessio, et al.
Pubblicazione: (2025)

Smoothed Graph Contrastive Learning via Seamless Proximity Integration
di: Behmanesh, Maysam, et al.
Pubblicazione: (2024)

KEEP: Integrating Medical Ontologies with Clinical Data for Robust Code Embeddings
di: Elhussein, Ahmed, et al.
Pubblicazione: (2025)

SemRep: Generative Code Representation Learning with Code Transformations
di: Li, Weichen, et al.
Pubblicazione: (2026)

Causality-Induced Positional Encoding for Transformer-Based Representation Learning of Non-Sequential Features
di: Xu, Kaichen, et al.
Pubblicazione: (2025)

Positional Encoding in Transformer-Based Time Series Models: A Survey
di: Irani, Habib, et al.
Pubblicazione: (2025)

Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
di: Zuo, Chunsheng, et al.
Pubblicazione: (2024)

Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Models
di: Kubaty, Piotr, et al.
Pubblicazione: (2026)

A Novel Spinor-Based Embedding Model for Transformers
di: White, Rick
Pubblicazione: (2024)

Universal Properties of Activation Sparsity in Modern Large Language Models
di: Szatkowski, Filip, et al.
Pubblicazione: (2025)

CodeSAM: Source Code Representation Learning by Infusing Self-Attention with Multi-Code-View Graphs
di: Mathai, Alex, et al.
Pubblicazione: (2024)

Poisoned Source Code Detection in Code Models
di: Ghannoum, Ehab, et al.
Pubblicazione: (2025)

Leveraging Manifold Embeddings for Enhanced Graph Transformer Representations and Learning
di: Jyothish, Ankit, et al.
Pubblicazione: (2025)

Maximizing the Position Embedding for Vision Transformers with Global Average Pooling
di: Lee, Wonjun, et al.
Pubblicazione: (2025)

A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer
di: Lu, Hanxiao, et al.
Pubblicazione: (2024)

Pool Me Wisely: On the Effect of Pooling in Transformer-Based Models
di: Ennadir, Sofiane, et al.
Pubblicazione: (2025)

Rotary Positional Embeddings as Phase Modulation: Theoretical Bounds on the RoPE Base for Long-Context Transformers
di: Liu, Feilong
Pubblicazione: (2026)

Beyond Code Contributions: How Network Position, Temporal Bursts, and Code Review Activities Shape Contributor Influence in Large-Scale Open Source Ecosystems
di: Karim, S M Rakib Ul, et al.
Pubblicazione: (2026)

Seamless Monitoring of Stress Levels Leveraging a Universal Model for Time Sequences
di: Gabrielli, Davide, et al.
Pubblicazione: (2024)

Tab-PET: Graph-Based Positional Encodings for Tabular Transformers
di: Leng, Yunze, et al.
Pubblicazione: (2025)

Residual Cross-Attention Transformer-Based Multi-User CSI Feedback with Deep Joint Source-Channel Coding
di: Zhang, Hengwei, et al.
Pubblicazione: (2025)

Refining Joint Text and Source Code Embeddings for Retrieval Task with Parameter-Efficient Fine-Tuning
di: Galliamov, Karim, et al.
Pubblicazione: (2024)

In-Context Source and Channel Coding
di: Wang, Ziqiong, et al.
Pubblicazione: (2026)

A General Representation-Based Approach to Multi-Source Domain Adaptation
di: Ng, Ignavier, et al.
Pubblicazione: (2026)

Selective Rotary Position Embedding
di: Movahedi, Sajad, et al.
Pubblicazione: (2025)

How to Protect Models against Adversarial Unlearning?
di: Jasiorski, Patryk, et al.
Pubblicazione: (2025)

Increasing Interaction Fidelity: Training Routines for Biomechanical Models in HCI
di: Miazga, Michał Patryk, et al.
Pubblicazione: (2025)

Beyond Isolated Clients: Integrating Graph-Based Embeddings into Event Sequence Models
di: Proshian, Harry, et al.
Pubblicazione: (2026)

An Unbiased Transformer Source Code Learning with Semantic Vulnerability Graph
di: Islam, Nafis Tanveer, et al.
Pubblicazione: (2023)