From DevOps to MLOps: Scaling ML models to 2 Million+ requests per day

The challenge with Machine Learning (ML) models is productionizing. It requires data ingestion, data preparation, model training, model deployment, and monitoring.Adopting MLOps practices is similar to DevOps practices. In MLOps, the workload changes, but some core principles like automation, continuous integration/continuous deployment (CI/CD), and monitoring. Taking DevOps practices, I will discuss the similarities and differences in adopting MLOps practices.In this talk, Chinmay takes a production use case to scale ML models to 2 million+ daily requests. It leverages Google Cloud's (GCP) infrastructure to use its GPU and other services. This talk will help you draw similarities between DevOps and MLOps as a DevOps practitioner and help you learn how to run Machine Learning models at the production scale with best practices.

Related Talks

Supercharging CI with Dagger

Want to modernize your CI/CD workflows? 🚀 In this session, Jason McCallister introduces Dagger, the open-source programmable CI/CD engine that’s redefining how we build, test, and ship software.You'll learn:- What makes Dagger different from traditional CI/CD tools- How to write pipelines as code and run them locally- How to compose reusable, testable pipeline components- Real-world examples of solving CI headaches with Dagger- Integration tips with Docker, Kubernetes, and beyondWhether you’re a DevOps pro, platform engineer, or just tired of brittle YAML, this talk will show you how Dagger helps you ship faster and smarter.

Watch recording

Saving & Sharing Your LocalStack State with CloudPods

Tired of rebuilding your stack from scratch every time you run tests or restart your dev environment? In this episode, we dive into Cloud Pods, LocalStack’s powerful state management feature.You’ll learn how to:- Snapshot your entire LocalStack environment (services, resources, data)- Restore that exact state across machines, teams, or CI runs- Speed up test cycles and workflows- Use Cloud Pods to make testing in CI/CD faster and more reliableCloud Pods let you freeze your infrastructure in time. Perfect for repeatable tests, isolated dev environments, or onboarding new teammates.🔗 Read the companion blog post: https://blog.localstack.cloud/save-and-share-localstack-state-with-cloudpods/

Watch recording

Break It Till You Make It: Introducing Chaos into Your Stack Locally

What happens when your cloud services fail? 💥In this final episode of our series, we dive into the LocalStack Chaos Dashboard to simulate real-world outages—like DynamoDB errors—and see how your app responds under pressure. Learn how to intentionally break your systems locally so you can ship more resilient applications in production.📘 Read the full blog post for step-by-step details: https://localstack-blog-preview-pr-121.surge.sh/break-it-till-you-make-it-chaos-engineering/

Watch recording

Launch yourself in the world of local cloud development

Try for free

Talk to Sales