In this article we aim to go over the reasoning behind why someone might want to use dbt. If you are interested in running dbt check out this article dbt tutorial. Some common questions from Data Engineers about dbt are
it is not very clear to me why would I use
dbtinstead of running SQL queries on Airflow
When getting started with Apache Airflow, data engineers have questions similar to the two below
“What are people’s opinions of Airflow?”
Many data engineers coming from traditional batch processing frameworks have questions about real time data processing systems, like
“What kind of data model did you implement, for real-time processing?”
One of the most common use cases for Apache Airflow is to run scheduled SQL scripts. Developers who start with Airflow often ask the following questions
“How to use airflow to orchestrate sql?”