No video :(

Spark Interview Questions | Spark Context Vs Spark Session

Подписаться 9 тыс.

Просмотров 19 тыс.

50% 1

#Spark #Context vs #Session
Please join as a member in my channel to get additional benefits like materials in BigData , Data Science, live streaming for Members and many more
Click here to subscribe : / @techwithviresh
About us:
We are a technology consulting and training providers, specializes in the technology areas like : Machine Learning,AI,Spark,Big Data,Nosql, graph DB,Cassandra and Hadoop ecosystem.
Mastering Spark : • Spark Scenario Based I...
Mastering Hive : • Mastering Hive Tutoria...
Spark Interview Questions : • Cache vs Persist | Spa...
Mastering Hadoop : • Hadoop Tutorial | Map ...
Visit us :
Email: techwithviresh@gmail.com
Facebook : / tech-greens
Twitter :
Thanks for watching
Please Subscribe!!! Like, share and comment!!!!

Опубликовано:

21 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 25

@sndselecta 3 года назад

By far the best explanation after researching for a few days. I think main take away is config is moved from sc to each session, creating independently isolated sessions via one overall sc for the cluster.

@shr2000 2 года назад

Thank you, explained very well. better than anything i read/ referred before

@TechWithViresh 2 года назад

Your Welcome:)

@rudrasingh21 4 года назад

All the lectures really helping me to understand deeper. Thanks

@TechWithViresh 3 года назад

Thanks :)

@arindamnath1233 2 года назад

The best explanation I ever get about Spark Session and Spark Context.

@TechWithViresh Год назад

Thanks :)

@manubhatnagar8519 3 года назад

Very nice, keep them coming

@vinaykumardudi154 3 года назад

Very nice explanation. Crisp and clear.

@TechWithViresh 3 года назад

Thanks :)

@krishnakishorenamburi9761 4 года назад

Viresh, Please mention the version of spark in the Slide on the top @4:25 and @5:45 as an improvement to slides.

@BibekMishra84 2 года назад

Great explanation. Quick question: What Code Editor/IDE are you using at 7:06 ? If its specific to Scala, what is best code editor/IDE for pySpark ?

@TechWithViresh 2 года назад

I am using Databricks Notebooks, for PySpark - PyCharm is a good IDE.

@vijaybigdata752 4 года назад

I have a doubt, in this scenario if we have 2 spark sessions for a single spark context, when spark context goes down will all 2 spark sessions killed? Please confirm.

@unknown_traveller12 3 года назад

Correct

@vinujackify 3 года назад

Had a query....Suppose I have a spark-submit job, does this mean I can create multiple spark session within .scala code of this spark-submit job

@TechWithViresh 3 года назад

one spark-submit job can have only one spark session

@mohdrayyankhan6623 3 года назад

@@TechWithViresh so my doubt is one spark-submit will have only one spark session along with spark context ? What is the use of having both. 2- what is the meaning of multiple user/ multiple sessions. I am not clear

@mahammadshoyab9717 4 года назад

Viresh, can you make video on spark architectire ,because i had gone through so many videos of spark architecture but i m not satisfying, so can you make deeper spark architecture video.

@TechWithViresh 4 года назад

check these videos : ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-JSvzGJC8vjQ.html ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-LfsL4ot6iSU.html

@sarjfud 4 года назад

In case of multiple spark sessions can the data/dataframe of each session interact with each other? Can we take output from both spark session and do a union operation?