Тёмный
No video :(

spark sql engine in spark | Lec-8 

MANISH KUMAR
Подписаться 21 тыс.
Просмотров 22 тыс.
50% 1

In this video I have talked about spark sql engine in spark in great detail. please follow video entirely and ask doubt in comment section below.
Directly connect with me on:- topmate.io/man...
For more queries reach out to me on my below social media handle.
Follow me on LinkedIn:- / manish-kumar-373b86176
Follow Me On Instagram:- / competitive_gyan1
Follow me on Facebook:- / manish12340
My Second Channel -- / @competitivegyan1
Interview series Playlist:- • Interview Questions an...
My Gear:-
Rode Mic:-- amzn.to/3RekC7a
Boya M1 Mic-- amzn.to/3uW0nnn
Wireless Mic:-- amzn.to/3TqLRhE
Tripod1 -- amzn.to/4avjyF4
Tripod2:-- amzn.to/46Y3QPu
camera1:-- amzn.to/3GIQlsE
camera2:-- amzn.to/46X190P
Pentab (Medium size):-- amzn.to/3RgMszQ (Recommended)
Pentab (Small size):-- amzn.to/3RpmIS0
Mobile:-- amzn.to/47Y8oa4 ( Aapko ye bilkul nahi lena hai)
Laptop -- amzn.to/3Ns5Okj
Mouse+keyboard combo -- amzn.to/3Ro6GYl
21 inch Monitor-- amzn.to/3TvCE7E
27 inch Monitor-- amzn.to/47QzXlA
iPad Pencil:-- amzn.to/4aiJxiG
iPad 9th Generation:-- amzn.to/470I11X
Boom Arm/Swing Arm:-- amzn.to/48eH2we
My PC Components:-
intel i7 Processor:-- amzn.to/47Svdfe
G.Skill RAM:-- amzn.to/47VFffI
Samsung SSD:-- amzn.to/3uVSE8W
WD blue HDD:-- amzn.to/47Y91QY
RTX 3060Ti Graphic card:- amzn.to/3tdLDjn
Gigabyte Motherboard:-- amzn.to/3RFUTGl
O11 Dynamic Cabinet:-- amzn.to/4avkgSK
Liquid cooler:-- amzn.to/472S8mS
Antec Prizm FAN:-- amzn.to/48ey4Pj

Опубликовано:

 

29 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 43   
@dineshpandey5008
@dineshpandey5008 11 дней назад
I have watched so many videos of spark but never find such explanation... amazing ..... You have very deep knowledge about spark.... solute....
@lucky_raiser
@lucky_raiser Год назад
bro, why do not you ask people to like , share, and subscribe. such a great content, it needs to be reached to more audience.
@BlissOfSoul07
@BlissOfSoul07 8 месяцев назад
How cutely you said Byeee😉
@jaypurohit5566
@jaypurohit5566 23 дня назад
What a Great explanation.. This series is so useful. Highly appreciate your efforts.
@user-fb8df3ij3j
@user-fb8df3ij3j 7 месяцев назад
This is series is liquid gold amazing content❤
@engineerbaaniya4846
@engineerbaaniya4846 Год назад
Best Playlist for SPark Heads off to you man
@yashsharma8687
@yashsharma8687 Месяц назад
its "Hats off to you" :)
@goldykarn5922
@goldykarn5922 10 месяцев назад
Thank You Bhaiya for this amazing series
@Azure-Mahesh
@Azure-Mahesh 8 месяцев назад
wonderful explanation on DAG & LAZY EVALUATION, Thank you
@HanuamnthReddy
@HanuamnthReddy 7 месяцев назад
Buhuth archa bhathayavhain.. thank you nhaya ghee..😊
@lokeshrathi5500
@lokeshrathi5500 8 дней назад
What is the use of Physical Plan, what steps are required to create them?
@darshakkumarranpariya867
@darshakkumarranpariya867 Год назад
It's a great series, sir. Highly appreciated
@DataForgeAcademy
@DataForgeAcademy 11 месяцев назад
Great session, explained in depth. Thanks
@rohitgaikwad2266
@rohitgaikwad2266 11 месяцев назад
Thanks Manish . Detailed Explanation.
@adarsharora6097
@adarsharora6097 8 месяцев назад
Thanks Manish! Really informative lecture.
@ankitachauhan6084
@ankitachauhan6084 3 месяца назад
very nice explanation
@neerajCHANDRA
@neerajCHANDRA Год назад
Very nice Manish
@MayankKumar-if2bs
@MayankKumar-if2bs Год назад
Great session so far❤
@anshukumari6616
@anshukumari6616 Год назад
Thanks Manish !!
@user-lx1rq1yu1s
@user-lx1rq1yu1s Год назад
Thanks Manish for this , was waiting for your next video since last two days. But Please also make video on handling and working with other file formats, such as Parquet, ORC, AVRO it will also be useful.
@manish_kumar_1
@manish_kumar_1 Год назад
Next video will be on this
@bangalibangalore2404
@bangalibangalore2404 Год назад
Cost based model banane ke liye usko pata kaise chalta hai ki yeh operation zyada computation cost karega? Uske liye to spark ko actually us process ko karke dekhna parega? Ki metadata se andaja laga leta hai?
@mission_possible
@mission_possible Год назад
Thanks for the sessions ...can you please make video on Adaptive Query Execution
@mayankkandpal1565
@mayankkandpal1565 9 месяцев назад
nice explanation.
@raghunandan8390
@raghunandan8390 8 месяцев назад
You could give definitions for each concept
@rajnandinipadhy2533
@rajnandinipadhy2533 8 месяцев назад
please make a detailed video on catalyst optimizer and tungsten engine
@user-rh1hr5cc1r
@user-rh1hr5cc1r 4 месяца назад
what is DataFrame/Dataset APIs . is it same as Dataframe while loading the data to dataframe or some kind of API used to read the data and save into dataframe
@ManishSharma-fi2vr
@ManishSharma-fi2vr 4 месяца назад
❤Thank You!
@dexterslab7750
@dexterslab7750 9 месяцев назад
what is the difference between spark engine (which you have explained in spark ecosystem lecture) and spark SQL engine. and if they are same then why are we calling it spark SQL engine.?
@IamDanish99
@IamDanish99 9 месяцев назад
I think he mentioned it as spark sql engine. But as far as I know catalyst optimizer is an optimisation framework within Spark sql engine.
@DpIndia
@DpIndia Год назад
Nice Videos
@ChandanKumar-xj3md
@ChandanKumar-xj3md Год назад
Hey Manish, waiting for the next spark lecture.
@sankuM
@sankuM Год назад
Your series of #spark fundamentals is really helpful, @manish_kumar_1! 🙌🙌 Keep continuing this.. thanks on behalf of all existing/buddying data engineers! :)
@riptideking
@riptideking 6 месяцев назад
why cont catalog comes before unresolved logical plan? this may reduce the time and cost.
@yashwantdhole7645
@yashwantdhole7645 9 месяцев назад
Manish bhai hamara AQE, Dynamic Partition Pruning ye saare optimizations 'Optimised Logical plan' ke phase me bante hai?
@mohitdaxini3067
@mohitdaxini3067 Год назад
Request - Nested json reading without any udf
@manish_kumar_1
@manish_kumar_1 Год назад
Learn explode function in pyspark. You will get it
@ajaypatil1881
@ajaypatil1881 10 месяцев назад
bhaiya please spend little bit more time on explaining potential interview questions at the beginning
@manish_kumar_1
@manish_kumar_1 10 месяцев назад
Sure
@ajaypatil1881
@ajaypatil1881 9 месяцев назад
thank you@@manish_kumar_1
@saisreekar7414
@saisreekar7414 10 месяцев назад
Sir will all these steps will happen in application driver?
@manish_kumar_1
@manish_kumar_1 10 месяцев назад
Yes
@manish_kumar_1
@manish_kumar_1 Год назад
Directly connect with me on:- topmate.io/manish_kumar25
Далее
rdd in spark | Lec-9
24:54
Просмотров 25 тыс.
Can You Bend This Bar?
01:00
Просмотров 5 млн
DAG and Lazy Evaluation in spark
20:35
Просмотров 27 тыс.
how to read json file in pyspark
24:02
Просмотров 17 тыс.