Cover Image

TypeEvalPy: A Micro-benchmarking Framework for Python Type Inference Tools

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Venkatesh, Ashwin Prasad Shivarpatna, Sabu, Samkutty, Wang, Jiawei, Mir, Amir M., Li, Li, Bodden, Eric
Format:	Preprint
Published:	2023
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Empirical Study of Large Language Models for Type and Call Graph Analysis in Python and JavaScript
by: Venkatesh, Ashwin Prasad Shivarpatna, et al.
Published: (2024)

The Emergence of Large Language Models in Static Analysis: A First Look through Micro-Benchmarks
by: Venkatesh, Ashwin Prasad Shivarpatna, et al.
Published: (2024)

Static Analysis Driven Enhancements for Comprehension in Machine Learning Notebooks
by: Venkatesh, Ashwin Prasad Shivarpatna, et al.
Published: (2023)

PyTy: Repairing Static Type Errors in Python
by: Chow, Yiu Wai, et al.
Published: (2024)

TIGER: A Generating-Then-Ranking Framework for Practical Python Type Inference
by: Wang, Chong, et al.
Published: (2024)

Co-Evolution of Types and Dependencies: Towards Repository-Level Type Inference for Python Code
by: Sun, Shuo, et al.
Published: (2025)

FauxPy: A Fault Localization Tool for Python
by: Rezaalipour, Mohammad, et al.
Published: (2024)

Symbol-Specific Sparsification of Interprocedural Distributive Environment Problems
by: Karakaya, Kadiray, et al.
Published: (2024)

Combining Type Inference and Automated Unit Test Generation for Python
by: Krodinger, Lukas, et al.
Published: (2025)

Hidden Gems in the Rough: Computational Notebooks as an Uncharted Oasis for IDEs
by: Titov, Sergey, et al.
Published: (2024)

PyTrim: A Practical Tool for Reducing Python Dependency Bloat
by: Karakatsanis, Konstantinos, et al.
Published: (2025)

PyExamine A Comprehensive, UnOpinionated Smell Detection Tool for Python
by: Shivashankar, Karthik, et al.
Published: (2025)

PyGress: Tool for Analyzing the Progression of Code Proficiency in Python OSS Projects
by: Charatvaraphan, Rujiphart, et al.
Published: (2025)

Toward an Android Static Analysis Approach for Data Protection
by: Khedkar, Mugdha, et al.
Published: (2024)

Typify: A Lightweight Usage-driven Static Analyzer for Precise Python Type Inference
by: Aman, Ali, et al.
Published: (2026)

FP-Predictor - False Positive Prediction for Static Analysis Reports
by: Ohlmer, Tom, et al.
Published: (2026)

A Soundness and Precision Benchmark for Java Debloating Tools
by: Klauke, Jonas, et al.
Published: (2025)

Challenges in Android Data Disclosure: An Empirical Study
by: Khedkar, Mugdha, et al.
Published: (2026)

Less is More? An Empirical Study on Configuration Issues in Python PyPI Ecosystem
by: Peng, Yun, et al.
Published: (2023)

iJTyper: An Iterative Type Inference Framework for Java by Integrating Constraint- and Statistically-based Methods
by: Chen, Zhixiang, et al.
Published: (2024)

Type-aware LLM-based Regression Test Generation for Python Programs
by: Liu, Runlin, et al.
Published: (2025)

PyTracer: Automatically profiling numerical instabilities in Python
by: Chatelain, Yohan, et al.
Published: (2021)

DyPyBench: A Benchmark of Executable Python Software
by: Bouzenia, Islem, et al.
Published: (2024)

TypyBench: Evaluating LLM Type Inference for Untyped Python Repositories
by: Dong, Honghua, et al.
Published: (2025)

Getting Python Types Right with RightTyper
by: Pizzorno, Juan Altmayer, et al.
Published: (2025)

HaPy-Bug -- Human Annotated Python Bug Resolution Dataset
by: Przymus, Piotr, et al.
Published: (2025)

GlycoPy: A CasADi-based Python Framework for Hierarchical Modeling, Optimization, and Control of Bioprocesses
by: Ma, Yingjie, et al.
Published: (2026)

HQPEF-Py: Metrics, Python Patterns, and Guidance for Evaluating Hybrid Quantum Programs
by: Osei, Michael Adjei, et al.
Published: (2025)

Visualizing Privacy-Relevant Data Flows in Android Applications
by: Khedkar, Mugdha, et al.
Published: (2025)

PyPulse: A Python Library for Biosignal Imputation
by: Gao, Kevin, et al.
Published: (2024)

From Code Changes to Quality Gains: An Empirical Study in Python ML Systems with PyQu
by: Almukhtar, Mohamed, et al.
Published: (2025)

Supporting Error Chains in Static Analysis for Precise Evaluation Results and Enhanced Usability
by: Wickert, Anna-Katharina, et al.
Published: (2024)

SafePyScript: A Web-Based Solution for Machine Learning-Driven Vulnerability Detection in Python
by: Farasat, Talaya, et al.
Published: (2024)

BugsInPy: A Database of Existing Bugs in Python Programs to Enable Controlled Testing and Debugging Studies
by: Widyasari, Ratnadira, et al.
Published: (2024)

Unmasking the Genuine Type Inference Capabilities of LLMs for Java Code Snippets
by: Dong, Yiwen, et al.
Published: (2025)

How Do Developers Use Type Inference: An Exploratory Study in Kotlin
by: Flint, Samuel W., et al.
Published: (2024)

TypePro: Boosting LLM-Based Type Inference via Inter-Procedural Slicing
by: Lin, Teyu, et al.
Published: (2026)

ScratchEval : A Multimodal Evaluation Framework for LLMs in Block-Based Programming
by: Si, Yuan, et al.
Published: (2026)

From Detection to Prevention: Explaining Security-Critical Code to Avoid Vulnerabilities
by: Krishnamurthy, Ranjith, et al.
Published: (2026)

PyGen: A Collaborative Human-AI Approach to Python Package Creation
by: Barua, Saikat, et al.
Published: (2024)