Azure Data Factory Integration with Snowflake - Use cases for Analytics Engineers

Подписаться 565

Просмотров 9 тыс.

50% 1

In this talk, we will give an overview of Azure Data Factory and options to perform integration with Snowflake.
The focus will in particular be on use cases for analytics engineers who want to create and transform data inside Snowflake to create curated datasets.
We will show Copy activity to bring data into Snowflake and the new Script task introduced in March 2022 that lets you run SQL directly against Snowflake from Azure Data Factory using compute resources from Snowflake. We will focus on ways to make your code and pipelines reusable and cover KeyVault to store credentials and how CICD works with ADF.

Опубликовано:

7 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 4

@anithbabu3601 Год назад

I really liked the way you parametrized the Scripts under Script activity. Due to some reason the script parameters options were not working for me to write into Snowflake. Instead the way you built it as a dynamic content to build the SQL worked for me. Thank you for that idea!

@sehaconsulting Год назад

Glad to hear it worked!

@florashi7848 Год назад

i have a question, what if i do not have the table structure created in snowflake, can i use ADF to pull data directly to snowflake, like create a new table in snowflake by using ADF? just like Alteryx, i can choose 'create a new table' option in the output tool