Posts

How to Pull Data from an API, Using AWS Lambda Nov 8, 2020
How to submit Spark jobs to EMR cluster from Airflow Oct 12, 2020
Data Engineering Project: Stream Edition Sep 26, 2020
ETL & ELT, a comparison Sep 5, 2020
What and Why Staging Aug 29, 2020
What is a Data Warehouse Aug 12, 2020
Ensuring Data Quality, With Great Expectations Jul 26, 2020
Designing a "low-effort" ELT system, using stitch and dbt Jul 11, 2020
3 Key techniques, to optimize your Apache Spark code Jun 19, 2020
What, why, when to use Apache Kafka, with an example Jun 11, 2020
A proven approach to land a Data Engineering job Jun 2, 2020
Data Engineering Project for Beginners - Batch edition May 23, 2020
Change Data Capture Using Debezium Kafka and Pg May 10, 2020
What Does It Mean for a Column to Be Indexed May 2, 2020
dbt(Data Build Tool) Tutorial Apr 25, 2020
Advantages of Using dbt(Data Build Tool) Apr 25, 2020
Apache Airflow Review: the good, the bad Apr 18, 2020
Review: Building a Real Time Data Warehouse Apr 11, 2020
3 Key Points to Help You Partition Late Arriving Events Apr 5, 2020
Scheduling a SQL script, using Apache Airflow, with an example Mar 29, 2020
10 Key skills, to help you become a data engineer Mar 20, 2020