Integration Testing on AWS with CDK
Use Stacks, Constructs and AWS SSM Parameters to easily test your serverless infrastructure workloads
Martijn Sturm's blog
Hello, I'm a data and cloud engineer focusing on AWS. I blog about data engineering and software engineering practices
Latest articles
Efficiently Obtaining Large Amounts of Data from External APIs with Python
Optimizing Python API Interactions for High-Volume Data
Data Engineering on AWS: Best Practices Overview
This blog post contains a listing of best-practices for data engineering on AWS. I will try to update this post regularly with new insights and best practices. Please note that this is not an exhaustive list. Am I missing an important one? Please let...
Use your own Python packages in Glue jobs
Many data engineering use cases require you to repeat some ETL logic on different (database) tables or event streams. It is advised to separate the ETL workflows for those tables in separate Glue jobs for multiple reasons: Keeping your ETL runs per ...
Defining AWS glue jobs as Infrastructure-as-Code
How to develop ETL workflows as Python AWS Glue jobs with AWS CDK and enable local development
Typescript Monorepo for AWS Infra and Lambdas with CDK
Separating dependencies per Lambda and organizing your monorepo in a modular way