Тёмный
No video :(

A Deep Dive into Query Execution Engine of Spark SQL - Maryann Xue 

Databricks
Подписаться 114 тыс.
Просмотров 23 тыс.
50% 1

Опубликовано:

 

21 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 4   
@user-sw9kd9pv4n
@user-sw9kd9pv4n 3 года назад
Excellent session, very well explained
@megharaina7561
@megharaina7561 4 года назад
what is the difference between a normal stage in job and a WSCG . Do multiple pipelines within a single WSCG correspond to two separate stages
@vinayakalagwadi5866
@vinayakalagwadi5866 4 года назад
according to my understanding the stages are separated only if there is a blocking op which requires aggregations ,,
@reesewinterspoon9417
@reesewinterspoon9417 3 года назад
Pipelines are separated by blocking operations, while stages are separated by shuffles (in most cases). A stage can have multiple pipelines. For example: the stage with hash aggregate will have multiple pipelines because hash aggregate is a blocking op, if its just a partial hashagg since that does not need a shuffle, all operations would be in a single stage. Hope that helps
Далее
Deep Dive into the New Features of Apache Spark™ 3.4
1:13:19
Calcite tutorial at BOSS 2021
1:31:19
Просмотров 6 тыс.
I've been using Redis wrong this whole time...
20:53
Просмотров 353 тыс.
Spark Execution Plans for Databricks
44:13
Просмотров 1,1 тыс.