From DevOps to MLOps: Scaling ML models to 2 Million+ requests per day

The challenge with Machine Learning (ML) models is productionizing. It requires data ingestion, data preparation, model training, model deployment, and monitoring.Adopting MLOps practices is similar to DevOps practices. In MLOps, the workload changes, but some core principles like automation, continuous integration/continuous deployment (CI/CD), and monitoring. Taking DevOps practices, I will discuss the similarities and differences in adopting MLOps practices.In this talk, Chinmay takes a production use case to scale ML models to 2 million+ daily requests. It leverages Google Cloud's (GCP) infrastructure to use its GPU and other services. This talk will help you draw similarities between DevOps and MLOps as a DevOps practitioner and help you learn how to run Machine Learning models at the production scale with best practices.

Related Talks

Run Your First AWS App Locally with LocalStack

Get started with LocalStack in minutes! In this episode, we’ll clone a ready-to-go AWS sample app, spin up LocalStack, and run everything locally without a cloud account. By the end, you’ll have a fully functional event-driven app running on your machine.📖 Want more?Check out the companion blog post for a deeper breakdown of the architecture, project structure, and all the commands you’ll need to run it yourself.🔗 https://blog.localstack.cloud/why-i-run-my-serverless-apps-locally/

Learn More
Learn More
New Bedrock Support in LocalStack

Bedrock is a fully managed service provided by Amazon Web Services (AWS) that makes foundation models from various LLM providers accessible via an API. LocalStack allows you to use the Bedrock APIs to test and develop AI-powered applications in your local environment.In this video, Silvio showcases how LocalStack 4.0, with our new Bedrock support, is keeping up with advancements in Generative AI (GenAI) and large language Model (LLM) ecosystems. You'll learn what Amazon Bedrock is, the benefits of Bedrock emulation, and a live demo of how it works.## Resources- Documentation: https://docs.localstack.cloud/user-guide/aws/bedrock/- Get access: https://www.localstack.cloud/contact

Learn More
Learn More
Replicating cloud resources locally with LocalStack's AWS Replicator extension

LocalStack's core cloud emulator lets you emulate various cloud services on your own computer. This means you can develop and test your cloud-based solutions without connecting to a remote cloud.However, there are times when you need to seamlessly switch between your local setup and actual cloud resources, especially in hybrid situations. For instance, you might want to share a database with your local Lambda function or access S3 files stored remotely while running a Glue ETL job locally.With LocalStack's AWS Replicator extension, your local environment can replicate AWS cloud resources at the API level, allowing direct interaction with cloud services. The Replicator extension enables you to forward specific requests from LocalStack to AWS without complex proxy setups, and create test scenarios that involve a mix of local and cloud resources.Check out our tutorial — https://docs.localstack.cloud/tutorials/replicate-aws-resources-localstack-extension/

Learn More
Learn More

Launch yourself in the world of local cloud development

Try for free
Try for free
Talk to Sales
Talk to Sales