A Generic and Efficient Python Runtime Verification System and its Large-scale Evaluation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912576133136384 |
|---|---|
| author | Shen, Zhuohang Yaseen, Mohammed Silva, Denini Guan, Kevin Lee, Junho d'Amorim, Marcelo Legunsen, Owolabi |
| author_facet | Shen, Zhuohang Yaseen, Mohammed Silva, Denini Guan, Kevin Lee, Junho d'Amorim, Marcelo Legunsen, Owolabi |
| contents | Runtime verification (RV) now scales for testing thousands of open-source Java projects, helping find hundreds of bugs. The popular Python ecosystem could use such benefits. But, today's Python RV systems are limited to a domain or specification logic, or slow. We propose PyMOP, a generic, extensible, and efficient RV system for Python. PyMOP supports five logics, implements five existing monitoring algorithms, ships with 73 API specs of Python and widely-used libraries, supports three instrumentation strategies, and users can easily add more of these. On 290,133 unit tests in 1,463 GitHub projects, we find mainly that (i) the default monitoring algorithm for Java is often not the fastest for Python; (ii) PyMOP is up to 1,168.3x faster than two recent dynamic analysis systems; and (iii) 44 of 121 bugs that PyMOP helped find so far were fixed by developers. PyMOP's generality and efficiency position it well as an excellent platform for the next advances on RV for Python. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_06324 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Generic and Efficient Python Runtime Verification System and its Large-scale Evaluation Shen, Zhuohang Yaseen, Mohammed Silva, Denini Guan, Kevin Lee, Junho d'Amorim, Marcelo Legunsen, Owolabi Software Engineering Runtime verification (RV) now scales for testing thousands of open-source Java projects, helping find hundreds of bugs. The popular Python ecosystem could use such benefits. But, today's Python RV systems are limited to a domain or specification logic, or slow. We propose PyMOP, a generic, extensible, and efficient RV system for Python. PyMOP supports five logics, implements five existing monitoring algorithms, ships with 73 API specs of Python and widely-used libraries, supports three instrumentation strategies, and users can easily add more of these. On 290,133 unit tests in 1,463 GitHub projects, we find mainly that (i) the default monitoring algorithm for Java is often not the fastest for Python; (ii) PyMOP is up to 1,168.3x faster than two recent dynamic analysis systems; and (iii) 44 of 121 bugs that PyMOP helped find so far were fixed by developers. PyMOP's generality and efficiency position it well as an excellent platform for the next advances on RV for Python. |
| title | A Generic and Efficient Python Runtime Verification System and its Large-scale Evaluation |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2509.06324 |