Spec Kit Agents: Context-Grounded Agentic Workflows

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Taghavi, Pardis, Bhavani, Santosh
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911571396001792
author Taghavi, Pardis
Bhavani, Santosh
author_facet Taghavi, Pardis
Bhavani, Santosh
contents Spec-driven development (SDD) with AI coding agents provides a structured workflow, but agents often remain "context blind" in large, evolving repositories, leading to hallucinated APIs and architectural violations. We present Spec Kit Agents, a multi-agent SDD pipeline (with PM and developer roles) that adds phase-level, context-grounding hooks. Read-only probing hooks ground each stage (Specify, Plan, Tasks, Implement) in repository evidence, while validation hooks check intermediate artifacts against the environment. We evaluate 128 runs covering 32 features across five repositories. Context-grounding hooks improve judged quality by +0.15 on a 1-5 composite LLM-as-judge score (+3.0 percent of the full score; Wilcoxon signed-rank, p < 0.05) while maintaining 99.7-100 percent repository-level test compatibility. We further evaluate the framework on SWE-bench Lite, where augmentation hooks improve baseline by 1.7 percent, achieving 58.2 percent Pass@1.
format Preprint
id arxiv_https___arxiv_org_abs_2604_05278
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Spec Kit Agents: Context-Grounded Agentic Workflows
Taghavi, Pardis
Bhavani, Santosh
Software Engineering
Artificial Intelligence
Multiagent Systems
Spec-driven development (SDD) with AI coding agents provides a structured workflow, but agents often remain "context blind" in large, evolving repositories, leading to hallucinated APIs and architectural violations. We present Spec Kit Agents, a multi-agent SDD pipeline (with PM and developer roles) that adds phase-level, context-grounding hooks. Read-only probing hooks ground each stage (Specify, Plan, Tasks, Implement) in repository evidence, while validation hooks check intermediate artifacts against the environment. We evaluate 128 runs covering 32 features across five repositories. Context-grounding hooks improve judged quality by +0.15 on a 1-5 composite LLM-as-judge score (+3.0 percent of the full score; Wilcoxon signed-rank, p < 0.05) while maintaining 99.7-100 percent repository-level test compatibility. We further evaluate the framework on SWE-bench Lite, where augmentation hooks improve baseline by 1.7 percent, achieving 58.2 percent Pass@1.
title Spec Kit Agents: Context-Grounded Agentic Workflows
topic Software Engineering
Artificial Intelligence
Multiagent Systems
url https://arxiv.org/abs/2604.05278