dbt(Data Build Tool) crash course for beginners: Zero to Hero

Подписаться 7 тыс.

Просмотров 23 тыс.

50% 1

In this video tutorial, we will learn about dbt (data build tool), the core concepts of dbt, exploring its project structure and key components.
It will guide us through setting up dbt Cloud using BigQuery and GitHub. Additionally, the tutorial covers various topics of dbt such as models, building & running them, understanding Macros, Generic and Singular Tests, and Snapshots within dbt.
▬▬▬▬▬▬ Links 🔗 ▬▬▬▬▬▬
► docs.getdbt.com/docs/supporte...
► github.com/AnandDedha/dbt-bq-...
► Data - github.com/AnandDedha/dbt-bq-...
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 Getting Started (Understanding dbt and its role in the data life cycle)
08:50 dbt core concepts & project structure
13:13 Configuring dbt Cloud with BigQuery and Github Integration
26:32 yml files in dbt
31:28 Model Creation Process and Execution in dbt
50:03 Exploring Macros in dbt
59:04 Overview of Generic and Singular Testing in dbt with example
68:04 Utilizing Snapshots in dbt
#dbt
#databuildtool
#dbtcloud
#dbtlabs
#bigquery
dbt
data build tool
dbt cloud
dbt labs
BigQuery
dbt (data build tool)
Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️
👉 Support us here: buymeacoffee.com/datatechdeq
Thank you for being such an amazing community. We couldn't do this without you! 🎥✨
Contact me : datatechdemo2@gmail.com

Опубликовано:

29 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 33

@junweizhang1034 15 дней назад

Best dbt tutorial for beginner u can find in RU-vid! Well done dude!

@dennisdmak 5 месяцев назад

Weldon. I'm using dbt Oracle and this really helped

@RahulDhanawade-im7su 5 месяцев назад

very helpful! Thanks mate.

@danieldumaraos 4 месяца назад

Thank you so much! I have learned a lot just by watching this video. Now, I am confident tackling simple using dbt. What I hope to have seen on this video is the documentation and a little bit more about the model dependency lineage but overall the video is awesome!

@DataTechByAnandKumar 4 месяца назад

Thanks for the feedback Daniel!! I will try to make video on documentation and model dependency lineage

@kirankumar1290 3 месяца назад

I was trying understanding dbt from various channels but finally I learned lot from your video which is boosting my career. Thanks bunch such wonderful and useful video.

@DataTechByAnandKumar 3 месяца назад

Thank you! Could you please share the video among your colleagues or organization? It would be help us

@kirankumar1290 3 месяца назад

@@DataTechByAnandKumar sure I will share the video in my organization. can you publish one more video on dbt with airflow

@toddai2721 Месяц назад

Because of your tutorial, my wife finally will have relations.

@aleksandrshipilo4467 6 месяцев назад

Thank you for the tutorial)

@ankushgupta2292 7 месяцев назад

Very well explained..

@nayeemsyed3033 5 месяцев назад

@Data Tech, by any chance can we get few scenario based interview questions on DBT cloud ?

@amacodes7347 4 месяца назад

Create video and thanks for this great content. I would like to highlight that when create the dataset in BQ choose multi region US if you would not overwrite the dbt project yaml file +location: , because you would face a hard time to run the models and could get the location not found in BigQuery

@GagandeepSingh-mq1id 13 дней назад

I am missing the part where you setup the project in GCP , can you share the timeline ?

@bhavesh6806 3 месяца назад

Nicely explained

@abdulghanishaik 23 дня назад

it was really good to start, but screen is not visible clearly.

@ugandarhari 2 месяца назад

Thanks for such a nice content. Now I can add one more tool in my resume. Very informative session! The only flaw is the video quality, please try to upload HD resolution from next time, rest is awesome.

@DataTechByAnandKumar 2 месяца назад

Thank you so much for watching and supporting our channel. If you like what we're doing and want to see more, consider supporting us on Buy Me a Coffee. Your donations will go directly towards improving our content and keeping us motivated to bring you the best videos possible. Every coffee counts! ☕️ 👉 Support us here: buymeacoffee.com/datatechdeq Thank you for being such an amazing community. We couldn't do this without you! 🎥✨

@anjaliacharya9506 6 месяцев назад

I do not have raw dataset in the dbt-training project I created, do we need to upload it or its created by default?

@DataTechByAnandKumar 6 месяцев назад

You must upload datasets, but there are also example datasets provided.

@yashhooda4441 4 месяца назад

can you please make a video on dbt core... if possible

@lakshmilfg1147 6 месяцев назад

Once dbt materializes all models as views, can I select a view directly in database and get the result I want? Because DAG will be defined within views ..right? Like View1--> View2--> View3.. Also if I dont have dbt in my company, Could I use nested views to recreate what dbt does?

@DataTechByAnandKumar 6 месяцев назад

We have the option to construct views upon existing views, but I wouldn't advise it because of potential performance issues.

@prashantchutke 2 месяца назад

Do you have to create schema.yaml or it is created automatically? Is it updated on it's own when a new model is created or we have to update in manually?

@DataTechByAnandKumar 2 месяца назад

In order to create dynamic yml , my guess is that you could use codegen and especially the generate_model_yaml. hub.getdbt.com/dbt-labs/codegen/latest/ So you would have to execute : dbt run-operation generate_model_yaml --args '{"model_names": ["orders"]}' then if you want the file .yml to be automatically created with the "description" key filled with the name preceding it, you can use www.dbt-power-user.com/

@apatidar32 6 месяцев назад

I'm trying to pass command dbt run but it keeps on failing the model I created, but if I preview the query it shows me table I am suppose to see. Can you help me out in what could be the issue? the other two example are running just fine.

@apatidar32 6 месяцев назад

it got resolved, apparently it's a location issue. My dataset was not multi-region so have to relocate it. Could make a small video on how to configure dataset location to auto detect in dbt itself, in profile.yml file