Developing & Testing Data pipelines locally with LocalStack!

Creating data pipelines and applications for the cloud comes with challenges like a complicated developer experience, dealing with managed cloud dependencies, and enduring long build times. These issues often disrupt your development and testing cycles. LocalStack's cloud emulation allows you to construct, deploy, and test data pipelines on your local machine. It facilitates integration testing of cloud solutions both locally and in CI pipelines. This approach saves time and money, enhances developer velocity, and supports high-quality, agile, test-driven development. In this talk, Harsh delves into developing and testing cloud-based data pipelines on your local machine. The session will provide a firsthand look at the new Snowflake emulator and demonstrate how you can use LocalStack to create Snowflake warehouses, databases, schemas, and tables, and integrate frameworks like Snowpark.

Related Talks

Testing CloudWatch metric alarms with LocalStack

LocalStack is a cloud service emulator designed for local development and testing of cloud applications. With LocalStack, you can test AWS CloudWatch metric alarms, to get notified on infrastructure failures — all on your local machine! In this video, you will learn how you can use a CloudWatch metric alarm to get notified automatically when your Lambda function invocations fail. You will also set up an email notification using the Simple Email Service (SES) and our Mailhog extension.

Learn More
Learn More
Testing Cloud Apps Shouldn't Be This Hard

Testing in the cloud = slow builds, fragile staging, surprise bills. Let’s talk about how developers are flipping the script and using local cloud environments to test smarter, faster, and cheaper without breaking production. Bonus: You’ll learn how LocalStack lets you simulate AWS on your machine. Game changer.

Learn More
Learn More
Test Your Cloud Workflows Locally Like a Boss

Why wait for the cloud to test your app? In this episode, we’ll write and run an integration test to validate our LocalStack app. You’ll learn how to upload a file, trigger the Lambda-SQS-DynamoDB flow, and assert the results all locally.

Learn More
Learn More

Launch yourself in the world of local cloud development

Try for free
Try for free
Talk to Sales
Talk to Sales