Advanced Materializations in data build tool (dbt) | Hands-on demo

Подписаться 8 тыс.

Просмотров 11 тыс.

50% 1

In our next video in this dbt series we look at table and view materializations as well as some advanced materializations including ephermal and incremental.
In this series I'll be producing a series of short videos which are based are dbt's excellent, free training modules found here:
courses.getdbt.com/collections
❄️Want to SUPERCHARGE your career and become an EXPERT in Snowflake??❄️
Mastering Snowflake is accepting applications now to work with us in a small group. Serious inquiries only pls.
forms.gle/WBqadnG7Y4tNe1wt8
❄️Order my book: Mastering Snowflake Solutions HERE: ❄️
Amazon UK - www.amazon.co.uk/Mastering-Sn...
Amazon US - www.amazon.com/Mastering-Snow...
Amazon AUS - www.amazon.com.au/Mastering-S...
Amazon IND - www.amazon.in/Mastering-Snowf...
❄️Get my Free SnowPro core guide HERE: ❄️
program.masteringsnowflake.co...
❄️Become a student on my course: ❄️
Snowflake Practice Questions - SnowPro Core Certified Udemy Course www.udemy.com/course/snowflak...
❄️Connect with me on Linkedin:❄️
/ adammorton121

Наука

Опубликовано:

22 май 2022

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 15

@user-bp6yj5ek5j Год назад

Hi Adam, based on incremental query, update was not happening, for dates lesser than max date

@yc859 Месяц назад

Hi Adam, How do you handle schema change in the source with the incremental loading? Thanks in advance. Your videos are awesome. Kr, Yahya

@mastering_snowflake 25 дней назад

By default, dbt WILL NOT populate new columns without a --full-refresh. The new column will be included in the first query against the source model, but not in the second query updating the destination model. dbt provides an on_schema_change config. append_new_columns: Add any new columns; populate with most recent subset. sync_all_columns: Adds new columns, drops removed columns. Populate with most recent subset. To populate new columns with historical data, a -full-refresh is required.

@mastering_snowflake 25 дней назад

Check this great article out for more details… medium.com/@aaronbannin/dbt-incremental-cookbook-d70331ef879a

@bhratkapoor5230 2 года назад

Hello Adam, Can we run 2 model script separately and insert the data into one single table? Thanks, Bhrat Kapoor

@mastering_snowflake Год назад

Hello Bhrat, good question. In this case you would have 3 dbt models. The first 2 populate your intermediate table and the 3rd model takes the intermediate table data to create you target table. Alternatively you could have one model joining tables 1 & 2 together which output your target result set. As ever, it depends on your specific requirements, such as how many data transformations you need to apply and if other downstream objects could also leverage the intermediate table using the 3 model approach described above.