Manage complex SQL workflows and transformations in BigQuery

Подписаться 33 тыс.

Просмотров 13 тыс.

50% 1

Data pipelines continue to grow in complexity and size, yet 43% of all companies continue to identify data talent as their largest gap. Join Google Cloud as we go on a transformative journey to unlock the power of data engineers and data analysts to write complex data pipelines, all in a managed framework that can be easily deployed using Google Cloud's latest data innovation. Data professionals can now build complex SQL logic that engineers can deploy using various deployment patterns including CLI to support enterprise needs.
Stat Link → goo.gle/3an6l6M
Speaker: Jason Davenport
Watch more:
Watch all Data Engineering sessions → goo.gle/3yMj6Bk
Subscribe to Google Cloud Events → goo.gle/Google...
#GoogleCloudSpotlight

Опубликовано:

15 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 13

@Atee1995 11 месяцев назад

This video was awesome until you opened VS code. I think an approach from the UI side to VS would have been much better, also explaining local dependencies and what needs to be installed to make it work

@patriciomendez9240 10 месяцев назад

Excellent point. I agree.

@goodmanshawnhuang Год назад

thanks for good video, what's the difference between dataform and DBT please? thanks.

@resagratia Год назад

They achieve the same purpose. DBT is able to connect with various data warehouses including BigQuery, Redshift and Azure. While Dataform is an internal framework for BigQuery.

@zeleravideos Год назад

The first build seems to have failed, so I think the video should be edited to remove content from 15:40 to 16:15. 😅

@Satenc0 4 месяца назад

Any examples on how to use variables on the queries? like parametrizable variables, for example if you have a query that fetches records between 2 dates, how could you make those 2 dates variables that are inputs to the sqlx file