Posts

How to Backfill a SQL query using Apache Airflow Jan 6, 2021
How to do Change Data Capture (CDC), using Singer Jan 1, 2021
What are Common Table Expressions(CTEs) and when to use them? Dec 22, 2020
10 Skills to Ace Your Data Engineering Interview Dec 10, 2020
6 Key Concepts, to Master Window Functions Nov 25, 2020
How to Pull Data from an API, Using AWS Lambda Nov 8, 2020
How to submit Spark jobs to EMR cluster from Airflow Oct 12, 2020
Data Engineering Project: Stream Edition Sep 26, 2020
ETL & ELT, a comparison Sep 5, 2020
What and Why Staging Aug 29, 2020
What is a Data Warehouse Aug 12, 2020
Ensuring Data Quality, With Great Expectations Jul 26, 2020
Designing a "low-effort" ELT system, using stitch and dbt Jul 11, 2020
3 Key techniques, to optimize your Apache Spark code Jun 19, 2020
What, why, when to use Apache Kafka, with an example Jun 11, 2020
A proven approach to land a Data Engineering job Jun 2, 2020
Data Engineering Project for Beginners - Batch edition May 23, 2020
Change Data Capture Using Debezium Kafka and Pg May 10, 2020
What Does It Mean for a Column to Be Indexed May 2, 2020
dbt(Data Build Tool) Tutorial Apr 25, 2020
Advantages of Using dbt(Data Build Tool) Apr 25, 2020
Apache Airflow Review: the good, the bad Apr 18, 2020
Review: Building a Real Time Data Warehouse Apr 11, 2020
3 Key Points to Help You Partition Late Arriving Events Apr 5, 2020
Scheduling a SQL script, using Apache Airflow, with an example Mar 29, 2020
10 Key skills, to help you become a data engineer Mar 20, 2020