Martijn Sturm's blog

Martijn Sturm

Martijn Sturm

2 followers

Hello, I'm a data and cloud engineer focusing on AWS. I blog about data engineering and software engineering practices

Integration Testing on AWS with CDK

Dec 15, 20237 min read26 views

Use Stacks, Constructs and AWS SSM Parameters to easily test your serverless infrastructure workloads · TL;DR: Implement integration testing on AWS by...

Integration Testing on AWS with CDK

Efficiently Obtaining Large Amounts of Data from External APIs with Python

Dec 10, 20237 min read215 views

Optimizing Python API Interactions for High-Volume Data · For some analytics or machine learning use cases, you could be dependent on data from external...

Efficiently Obtaining Large Amounts of Data from External APIs with Python

Data Engineering on AWS: Best Practices Overview

Apr 23, 20234 min read173 views

This blog post contains a listing of best-practices for data engineering on AWS. I will try to update this post regularly with new insights and best...

Data Engineering on AWS: Best Practices Overview

Use your own Python packages in Glue jobs

Apr 23, 20234 min read647 views

Many data engineering use cases require you to repeat some ETL logic on different (database) tables or event streams. It is advised to separate the...

Use your own Python packages in Glue jobs

Defining AWS glue jobs as Infrastructure-as-Code

Apr 23, 20234 min read363 views

How to develop ETL workflows as Python AWS Glue jobs with AWS CDK and enable local development · Using Infrastructure-as-Code (IaC) for deployment of...

Defining AWS glue jobs as Infrastructure-as-Code

Typescript Monorepo for AWS Infra and Lambdas with CDK

Dec 11, 202210 min read2.1K views

Separating dependencies per Lambda and organizing your monorepo in a modular way · In this blog post, I show you how to organize a repository, so that...

Typescript Monorepo for AWS Infra and Lambdas with CDK