Cover Image

Small Language Models as Compiler Experts: Auto-Parallelization for Heterogeneous Systems

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Devadiga, Prathamesh
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Programming Languages
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels
by: Zhao, Yifan, et al.
Published: (2026)

Compiler generated feedback for Large Language Models
by: Grubisic, Dejan, et al.
Published: (2024)

An LLM-Tool Compiler for Fused Parallel Function Calling
by: Singh, Simranjit, et al.
Published: (2024)

Making Large Language Models Speak Tulu: Structured Prompting for an Extremely Low-Resource Language
by: Devadiga, Prathamesh, et al.
Published: (2026)

CompilerDream: Learning a Compiler World Model for General Code Optimization
by: Deng, Chaoyi, et al.
Published: (2024)

MorphNAS: Differentiable Architecture Search for Morphologically-Aware Multilingual NER
by: Devadiga, Prathamesh, et al.
Published: (2025)

RegimeNAS: Regime-Aware Differentiable Architecture Search With Theoretical Guarantees for Financial Trading
by: Devadiga, Prathamesh, et al.
Published: (2025)

Compiling to recurrent neurons
by: Velez-Ginorio, Joey, et al.
Published: (2025)

Compiling to linear neurons
by: Velez-Ginorio, Joey, et al.
Published: (2025)

AutoPyVerifier: Learning Compact Executable Verifiers for Large Language Model Outputs
by: Pezeshkpour, Pouya, et al.
Published: (2026)

Bootstrapping Fuzzers for Compilers of Low-Resource Language Dialects Using Language Models
by: Vaidya, Sairam, et al.
Published: (2025)

PassNet: Scaling Large Language Models for Graph Compiler Pass Generation
by: Liu, Yiqun, et al.
Published: (2026)

WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Models
by: Yang, Chenyuan, et al.
Published: (2023)

Pattern Matching in AI Compilers and its Formalization (Extended Version)
by: Cutler, Joseph W., et al.
Published: (2024)

Curriculum Learning for Small Code Language Models
by: Naïr, Marwa, et al.
Published: (2024)

PolyBlocks: A Compiler Infrastructure for AI Chips and Programming Frameworks
by: Bondhugula, Uday, et al.
Published: (2026)

Offline Imitation Learning from Multiple Baselines with Applications to Compiler Optimization
by: Marinov, Teodor V., et al.
Published: (2024)

The Next 700 ML-Enabled Compiler Optimizations
by: VenkataKeerthy, S., et al.
Published: (2023)

AIOS Compiler: LLM as Interpreter for Natural Language Programming and Flow Programming of AI Agents
by: Xu, Shuyuan, et al.
Published: (2024)

Kernel Contracts: A Specification Language for ML Kernel Correctness Across Heterogeneous Silicon
by: Veit, Cooper
Published: (2026)

LLM-Aided Compilation for Tensor Accelerators
by: Hong, Charles, et al.
Published: (2024)

OMPILOT: Harnessing Transformer Models for Auto Parallelization to Shared Memory Computing Paradigms
by: Bhattacharjee, Arijit, et al.
Published: (2025)

Code-Guided Reasoning for Small Language Models: Evaluating Executable MCQA Scaffolds
by: Biswas, Prateek, et al.
Published: (2026)

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs
by: Zhao, Yifan, et al.
Published: (2025)

Transformers are Efficient Compilers, Provably
by: Zhai, Xiyu, et al.
Published: (2024)

HMoE: Heterogeneous Mixture of Experts for Language Modeling
by: Wang, An, et al.
Published: (2024)

LOOPerSet: A Large-Scale Dataset for Data-Driven Polyhedral Compiler Optimization
by: Merouani, Massinissa, et al.
Published: (2025)

LiteCoOp: Lightweight Multi-LLM Shared-Tree Reasoning for Model-Serving Compiler Optimizations
by: Tang, Annabelle Sujun, et al.
Published: (2026)

Finding Missed Code Size Optimizations in Compilers using LLMs
by: Italiano, Davide, et al.
Published: (2024)

AutoElicit: Using Large Language Models for Expert Prior Elicitation in Predictive Modelling
by: Capstick, Alexander, et al.
Published: (2024)

Hexcute: A Compiler Framework for Automating Layout Synthesis in GPU Programs
by: Zhang, Xiao, et al.
Published: (2025)

Magellan: Autonomous Discovery of Novel Compiler Optimization Heuristics with AlphaEvolve
by: Chen, Hongzheng, et al.
Published: (2026)

A Multi-Expert Large Language Model Architecture for Verilog Code Generation
by: Nadimi, Bardia, et al.
Published: (2024)

Type-Constrained Code Generation with Language Models
by: Mündler, Niels, et al.
Published: (2025)

Compile to Compress: Boosting Formal Theorem Provers by Compiler Outputs
by: Li, Guchan, et al.
Published: (2026)

depyf: Open the Opaque Box of PyTorch Compiler for Machine Learning Researchers
by: You, Kaichao, et al.
Published: (2024)

Mixture of Heterogeneous Grouped Experts for Language Modeling
by: Ma, Zhicheng, et al.
Published: (2026)

ECCO: Evidence-Driven Causal Reasoning for Compiler Optimization
by: Pan, Haolin, et al.
Published: (2026)

AutoPDL: Automatic Prompt Optimization for LLM Agents
by: Spiess, Claudio, et al.
Published: (2025)

Automated Type Annotation in Python Using Large Language Models
by: Bharti, Varun, et al.
Published: (2025)