Saved in:
Bibliographic Details
Main Authors: Cotton, R. James, Leonard, Thomas
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.06975
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911428562124800
author Cotton, R. James
Leonard, Thomas
author_facet Cotton, R. James
Leonard, Thomas
contents Markerless motion capture is making quantitative movement analysis increasingly accessible, yet analyzing the resulting data remains a barrier for clinicians without programming expertise. We present BiomechAgent, a code-generating AI agent that enables biomechanical analysis through natural language and allows users to querying databases, generating visualizations, and even interpret data without requiring users to write code. To evaluate BiomechAgent's capabilities, we developed a systematic benchmark spanning data retrieval, visualization, activity classification, temporal segmentation, and clinical reasoning. BiomechAgent achieved robust accuracy on data retrieval and visualization tasks and demonstrated emerging clinical reasoning capabilities. We used our dataset to systematically evaluate several of our design decisions. Biomechanically-informed, domain-specific instructions significantly improved performance over generic prompts, and integrating validated specialized tools for gait event detection substantially boosted accuracy on challenging spatiotemporal analysis where the base agent struggled. We also tested BiomechAgent using a local open-weight model instead of a frontier cloud based LLM and found that perform was substantially diminished in most domains other than database retrieval. In short, BiomechAgent makes the data from accessible motion capture and much more useful and accessible to end users.
format Preprint
id arxiv_https___arxiv_org_abs_2602_06975
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle BiomechAgent: AI-Assisted Biomechanical Analysis Through Code-Generating Agents
Cotton, R. James
Leonard, Thomas
Computation and Language
Artificial Intelligence
Markerless motion capture is making quantitative movement analysis increasingly accessible, yet analyzing the resulting data remains a barrier for clinicians without programming expertise. We present BiomechAgent, a code-generating AI agent that enables biomechanical analysis through natural language and allows users to querying databases, generating visualizations, and even interpret data without requiring users to write code. To evaluate BiomechAgent's capabilities, we developed a systematic benchmark spanning data retrieval, visualization, activity classification, temporal segmentation, and clinical reasoning. BiomechAgent achieved robust accuracy on data retrieval and visualization tasks and demonstrated emerging clinical reasoning capabilities. We used our dataset to systematically evaluate several of our design decisions. Biomechanically-informed, domain-specific instructions significantly improved performance over generic prompts, and integrating validated specialized tools for gait event detection substantially boosted accuracy on challenging spatiotemporal analysis where the base agent struggled. We also tested BiomechAgent using a local open-weight model instead of a frontier cloud based LLM and found that perform was substantially diminished in most domains other than database retrieval. In short, BiomechAgent makes the data from accessible motion capture and much more useful and accessible to end users.
title BiomechAgent: AI-Assisted Biomechanical Analysis Through Code-Generating Agents
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2602.06975