Тёмный

Data Engineering Project: Quickly Build a Complex Data Pipeline 

Shipyard
Подписаться 998
Просмотров 9 тыс.
50% 1

In this video, we pull data from the Webflow and RU-vid API and transform them with dbt Core and take them into Looker Studio.
In this project, you will learn:
✅ How to create a pipeline in Shipyard from scratch
✅ How to run custom Python scripts on Shipyard
✅ How to use our open-source low-code templates to interact with BigQuery
✅ How to host dbt Core on Shipyard
What tools do you want us to feature in our next end-to-end pipeline? Let us know below!
▬▬▬▬▬▬ Timestamps ▬▬▬▬▬▬
0:00 Introduction
2:31 Extraction to BigQuery with Python
16:18 Transform with dbt Core
36:23 Putting Data in Looker Studio
▬▬▬▬▬▬ Connect with Shipyard ▬▬▬▬▬▬
﹡ Schedule a Meeting Time ▻ calendly.com/shipyard-data-ex...
﹡ Sign Up for a Free Developer Account ▻ app.shipyardapp.com/auth/sign...
﹡ Website ▻ www.shipyardapp.com/?...
﹡ LinkedIn ▻ www.linkedin.com/company/ship...
﹡ Blog ▻ www.shipyardapp.com/blog/?utm...
﹡ Newsletter ▻ allhandsondata.substack.com/

Наука

Опубликовано:

 

29 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 2   
@diaconescutiberiu7535
@diaconescutiberiu7535 3 месяца назад
Such an informative video. I found it very useful. Just got a new job where i need to migrate entire Hadoop (oozie) workflows in Snowflake using dbt, with all 4 technologies new to me. This type of videos are extremely helpful. If you can make more on the modelling part with dbt, would be great
@shipyardapp
@shipyardapp 3 месяца назад
Thanks for the comment! What type of modeling content would you like to see from dbt?
Далее
Airflow with DBT tutorial - The best way!
17:54
Просмотров 39 тыс.
Shipyard in 5-Minutes: Data Orchestration Tour
5:18
Просмотров 2,1 тыс.
Top AWS Services A Data Engineer Should Know
13:11
Просмотров 153 тыс.
Gizli Apple Watch Özelliği😱
0:14
Просмотров 4,3 млн
Собери ПК и Получи 10,000₽
1:00
Просмотров 1,6 млн
YOTAPHONE 2 - СПУСТЯ 10 ЛЕТ
15:13
Просмотров 110 тыс.