Model Callers for Transforming Predictive and Generative AI Applications
Fuente:
arXiv
Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913400918900736 |
|---|---|
| author | Dalal, Mukesh |
| author_facet | Dalal, Mukesh |
| contents | We introduce a novel software abstraction termed "model caller," acting as an intermediary for AI and ML model calling, advocating its transformative utility beyond existing model-serving frameworks. This abstraction offers multiple advantages: enhanced accuracy and reduced latency in model predictions, superior monitoring and observability of models, more streamlined AI system architectures, simplified AI development and management processes, and improved collaboration and accountability across AI/ML/Data Science, software, data, and operations teams. Model callers are valuable for both creators and users of models within both predictive and generative AI applications. Additionally, we have developed and released a prototype Python library for model callers, accessible for installation via pip or for download from GitHub. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_15377 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Model Callers for Transforming Predictive and Generative AI Applications Dalal, Mukesh Computers and Society Artificial Intelligence Machine Learning Neural and Evolutionary Computing Programming Languages Software Engineering 68T05 (Primary) 68T07, 68N19, 68T35 (Secondary) I.2.0; I.2.1; I.2.5; I.2.11; D.2.11; D.3.3; H.1.2; J.0 We introduce a novel software abstraction termed "model caller," acting as an intermediary for AI and ML model calling, advocating its transformative utility beyond existing model-serving frameworks. This abstraction offers multiple advantages: enhanced accuracy and reduced latency in model predictions, superior monitoring and observability of models, more streamlined AI system architectures, simplified AI development and management processes, and improved collaboration and accountability across AI/ML/Data Science, software, data, and operations teams. Model callers are valuable for both creators and users of models within both predictive and generative AI applications. Additionally, we have developed and released a prototype Python library for model callers, accessible for installation via pip or for download from GitHub. |
| title | Model Callers for Transforming Predictive and Generative AI Applications |
| topic | Computers and Society Artificial Intelligence Machine Learning Neural and Evolutionary Computing Programming Languages Software Engineering 68T05 (Primary) 68T07, 68N19, 68T35 (Secondary) I.2.0; I.2.1; I.2.5; I.2.11; D.2.11; D.3.3; H.1.2; J.0 |
| url | https://arxiv.org/abs/2406.15377 |