Pulling Azure Container Instance Logs into Azure Data Factory
A description of how to include Azure Container Instance logs into your Data Factory pipeline.
Hi there! My name is Paulo and I am an analytics/data engineer and endurance runner based in Berlin. Welcome to my blog.
When I am not building data pipelines, you will find me training for my next endurance race. I write about both.
Currently preparing for Spartathlon 2026 and documenting the journey in my 246 series.
Top 10 Books Read in 2022
Selected quotes from what I considered were the best books I read/listened to in 2022.
Syncing a Cloud Source Repository to your Composer Airflow Environment
And thus starting your CI/CD pipeline
Creating Minimalist Map Posters using R
Levering R and OpenStreetMaps to create custom minimalist posters
Working from Taghazout, Morocco
The beauty is found in the mess
A simple Dockerfile for a dbt Synapse
A sample Dockerfile to containerize a dbt project with Azure Synapse dependencies
Applying Scalers using DataFrameMapper()
An example on how to scale and hot-encode variables while preprocessing your data frame.
Creating Sample Datasets in Python
A script to create sample pandas data frames with randomly generated data.
Working from Santa Teresa, Costa Rica
Strong waves (surf, not WiFi)