26. Databricks | Spark | Adaptive Query Execution| Interview Question | Performance Tuning

Подписаться 23 тыс.

Просмотров 22 тыс.

50% 1

#AdaptiveQueryExecution, #DatabricksOptimization, #SparkOptimization, #AQE, #DatabricksInterviewQuestions, #SparkInterviewQuestions, #DatabricksInterview, #DatabricksPerformance,
#Databricks, #DatabricksTutorial, #AzureDatabricks
#Databricks
#Pyspark
#Spark
#AzureDatabricks
#AzureADF
#Databricks #LearnPyspark #LearnDataBRicks #DataBricksTutorial
databricks spark tutorial
databricks tutorial
databricks azure
databricks notebook tutorial
databricks delta lake
databricks azure tutorial,
Databricks Tutorial for beginners,
azure Databricks tutorial
databricks tutorial,
databricks community edition,
databricks community edition cluster creation,
databricks community edition tutorial
databricks community edition pyspark
databricks community edition cluster
databricks pyspark tutorial
databricks community edition tutorial
databricks spark certification
databricks cli
databricks tutorial for beginners
databricks interview questions
databricks azure

Наука

Опубликовано:

25 июл 2021

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 26

@vydudraksharam5960 Год назад

Raja Sir, I never saw people explaining along with example and the way code execute. hope i will not forget any concept. proud that i found this channel.

@rajasdataengineering7585 Год назад

Thanks for your comment!

@praptijoshi9102 3 месяца назад

Great content, amazing explanation

@rajasdataengineering7585 3 месяца назад

Glad you liked it! Thanks

@suresh.suthar.24 Год назад

after selecting physical plan, DAG will be created or tungsten will generate code? i mean which process will take place after physical plan ?

@gulsahtanay2341 4 месяца назад

Great content!

@rajasdataengineering7585 4 месяца назад

Thanks

@karthikeyanr2108 Год назад

very good explanation

@rajasdataengineering7585 Год назад

Thank you

@ankitmathur4u Год назад

Great videos, one suggestion is to give link to the other related videos you talk about during the session. That will benefit students to refer and you to get more views.

@rajasdataengineering7585 Год назад

Great suggestion. Thank you! Will add the video link or other references going forward

@jandiarc 7 месяцев назад

Thanks!

@rajasdataengineering7585 7 месяцев назад

Thanks and welcome

@somisettyrevanthrs859 Год назад

can a spark executor can have multiple partitions. If so, how to calculate the ideal partition size?

@rajasdataengineering7585 Год назад

Yes partitions are distributed across executors and each executor can contain multiple partitions. Number of partitions should be multiples of number of cores, ideally 4x at least. So based on number of cores in your cluster and total file size, partition size can be determined