From DevOps to MLOps: Scaling ML models to 2 Million+ requests per day

The challenge with Machine Learning (ML) models is productionizing. It requires data ingestion, data preparation, model training, model deployment, and monitoring.Adopting MLOps practices is similar to DevOps practices. In MLOps, the workload changes, but some core principles like automation, continuous integration/continuous deployment (CI/CD), and monitoring. Taking DevOps practices, I will discuss the similarities and differences in adopting MLOps practices.In this talk, Chinmay takes a production use case to scale ML models to 2 million+ daily requests. It leverages Google Cloud's (GCP) infrastructure to use its GPU and other services. This talk will help you draw similarities between DevOps and MLOps as a DevOps practitioner and help you learn how to run Machine Learning models at the production scale with best practices.

Related Talks

Test Your Cloud Like You Mean It: Integrating Testcontainers and LocalStack

You’ve been there: Your Unit tests pass both locally and in CI. You deploy with confidence. You thought.. Then staging in the real cloud reveals the truth—bugs that only show up with actual RDS parameter settings, real SQS and SNS throughput limits, or Lambda and API Gateway behaviour your local mocks never captured.

The solution is Testcontainers.

Testcontainers is a testing library that provides easy and lightweight APIs for bootstrapping integration tests with real services wrapped in Docker containers. Using Testcontainers, you can write tests talking to the same type of services you use in production without mocks or in-memory services. Spin them up, run migrations, execute your Node.js service against them, assert results, auto-cleanup.

Learn More
Learn More
Why local AWS environments are faster, easier, & more efficient

So many of the challenges that slow down software development stem from the fact that early-stage dev & test cycles are performed in cloud environments.

Local cloud development removes these challenges.

By simulating AWS application behavior in a local container, the local cloud enables developers and agents to validate the security, quality, and reliability of their applications faster and more effectively than they can on the cloud.

Learn More
Learn More
Introducing lstk: The New LocalStack CLI

Silvio and Carole introduce lstk, LocalStack's next-generation CLI built from scratch in Go. They explain why the team rebuilt the CLI, walk through its key features — zero-config startup, seamless browser-based authentication, and a rich interactive TUI that surfaces real-time progress and actionable errors — and demo how lstk gets you from install to a running emulator in seconds. They also dive into the architecture behind lstk and how it is designed to support multiple emulators, flexible runtimes, and deep integrations with CI pipelines and IDEs.

Learn More
Learn More

Launch yourself in the world of local cloud development

Try for free
Try for free
Talk to Sales
Talk to Sales