LoCoML: A Framework for Real-World ML Inference Pipelines

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Maddireddy, Kritin, Methukula, Santhosh Kotekal, Sridhar, Chandrasekar, Vaidhyanathan, Karthik
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917901492027392
author Maddireddy, Kritin
Methukula, Santhosh Kotekal
Sridhar, Chandrasekar
Vaidhyanathan, Karthik
author_facet Maddireddy, Kritin
Methukula, Santhosh Kotekal
Sridhar, Chandrasekar
Vaidhyanathan, Karthik
contents The widespread adoption of machine learning (ML) has brought forth diverse models with varying architectures, and data requirements, introducing new challenges in integrating these systems into real-world applications. Traditional solutions often struggle to manage the complexities of connecting heterogeneous models, especially when dealing with varied technical specifications. These limitations are amplified in large-scale, collaborative projects where stakeholders contribute models with different technical specifications. To address these challenges, we developed LoCoML, a low-code framework designed to simplify the integration of diverse ML models within the context of the \textit{Bhashini Project} - a large-scale initiative aimed at integrating AI-driven language technologies such as automatic speech recognition, machine translation, text-to-speech, and optical character recognition to support seamless communication across more than 20 languages. Initial evaluations show that LoCoML adds only a small amount of computational load, making it efficient and effective for large-scale ML integration. Our practical insights show that a low-code approach can be a practical solution for connecting multiple ML models in a collaborative environment.
format Preprint
id arxiv_https___arxiv_org_abs_2501_14165
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LoCoML: A Framework for Real-World ML Inference Pipelines
Maddireddy, Kritin
Methukula, Santhosh Kotekal
Sridhar, Chandrasekar
Vaidhyanathan, Karthik
Software Engineering
Artificial Intelligence
The widespread adoption of machine learning (ML) has brought forth diverse models with varying architectures, and data requirements, introducing new challenges in integrating these systems into real-world applications. Traditional solutions often struggle to manage the complexities of connecting heterogeneous models, especially when dealing with varied technical specifications. These limitations are amplified in large-scale, collaborative projects where stakeholders contribute models with different technical specifications. To address these challenges, we developed LoCoML, a low-code framework designed to simplify the integration of diverse ML models within the context of the \textit{Bhashini Project} - a large-scale initiative aimed at integrating AI-driven language technologies such as automatic speech recognition, machine translation, text-to-speech, and optical character recognition to support seamless communication across more than 20 languages. Initial evaluations show that LoCoML adds only a small amount of computational load, making it efficient and effective for large-scale ML integration. Our practical insights show that a low-code approach can be a practical solution for connecting multiple ML models in a collaborative environment.
title LoCoML: A Framework for Real-World ML Inference Pipelines
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2501.14165