From DevOps to MLOps: Scaling ML models to 2 Million+ requests per day

The challenge with Machine Learning (ML) models is productionizing. It requires data ingestion, data preparation, model training, model deployment, and monitoring. Adopting MLOps practices is similar to DevOps practices. In MLOps, the workload changes, but some core principles like automation, continuous integration/continuous deployment (CI/CD), and monitoring. Taking DevOps practices, I will discuss the similarities and differences in adopting MLOps practices. In this talk, Chinmay takes a production use case to scale ML models to 2 million+ daily requests. It leverages Google Cloud's (GCP) infrastructure to use its GPU and other services. This talk will help you draw similarities between DevOps and MLOps as a DevOps practitioner and help you learn how to run Machine Learning models at the production scale with best practices.

Related Talks

How to install LocalStack Snowflake Emulator

In this video, you'll learn how to set up and integrate LocalStack's Snowflake Emulator to develop and test your Snowflake data apps in your local environment or CI pipelines. Whether you're using Snowpark, various client libraries, or building interactive data apps with frameworks like Streamlit, this emulator simplifies your developer experience. We'll walk you through step-by-step instructions on installing the Snowflake emulator with the LocalStack CLI & Docker, configuring and integrating the emulator with popular SQL clients, such as DBeaver, and running SQL queries locally to replicate a full Snowflake environment without cloud dependencies. ⚡ Get early access! The Snowflake Emulator is currently in public preview—reach out to us for access and start building today!

Learn More
Learn More
How Cloud Developers Actually Work Without Breaking Everything

Real cloud developers aren’t pushing straight to AWS. They’re building and testing everything locally before a single deploy goes live. This episode breaks down the modern cloud dev workflow and how tools like LocalStack make it possible to move fast without burning money (or trust). Learn how local-first dev culture is changing the cloud game.

Learn More
Learn More
Handwritten digit recognition using MNIST model and Sagemaker on LocalStack

LocalStack Applications in Developer Hub provides sample templates to help LocalStack users adopt real-world scenarios to rapidly and conveniently create, configure, and deploy applications locally.

Getting started

In this demo, we will setup a Sagemaker on Localstack

Learn More
Learn More

Launch yourself in the world of local cloud development

Try for free
Try for free
Talk to Sales
Talk to Sales