Creating data pipelines and applications for the cloud comes with challenges like a complicated developer experience, dealing with managed cloud dependencies, and enduring long build times. These issues often disrupt your development and testing cycles.LocalStack's cloud emulation allows you to construct, deploy, and test data pipelines on your local machine. It facilitates integration testing of cloud solutions both locally and in CI pipelines. This approach saves time and money, enhances developer velocity, and supports high-quality, agile, test-driven development.In this talk, Harsh delves into developing and testing cloud-based data pipelines on your local machine. The session will provide a firsthand look at the new Snowflake emulator and demonstrate how you can use LocalStack to create Snowflake warehouses, databases, schemas, and tables, and integrate frameworks like Snowpark.

In this session, Maximillian Hoheiser discussed developing & testing AWS Data Streaming with LocalStack! In this talk, he focused on Kinesis Data Firehose, an AWS service that allows you to extract, transform, and load streaming data into various destinations like Amazon S3.He dived into how to set up testing for Kinesis Firehose and seamlessly integrated it with other services using Boto3 and CDK/CloudFormation. Maximillian led a live demonstration, showcasing how to set up a practical business case, implement it, and rigorously test it using LocalStack.

Local development and testing are significant for engineers who wish to ship confidently onto production environments. Test-driven development (TDD) has been adopted as an essential practice to enforce that and ensure that every code change is validated locally and on CI. This is where we arrive at the Testcontainers libraries that support your tests, providing lightweight, ephemeral instances of common databases, message brokers, web browsers, or anything else that can run in a Docker container. With Testcontainers, available in different popular languages: Java, Go, .NET, JavaScript/Typescript, and Python, you can replicate the production environment on your local machine and test everything (including AWS APIs powered by LocalStack)! Testcontainers ensure that the data access layer, user interface, and application are tested well at each step. In this session, we have looked at Testcontainers and how to adopt them to develop our applications locally and run our integration tests while using LocalStack to provision cloud resources inside a Docker container before pushing your application to production! In the end, we have also discussed how LocalStack and the Java version of Testcontainers play nicely with each other and wind up with updates about the all-new LocalStack release!