Тёмный
No video :(

Apache Spark Architecture | Spark Cluster Architecture Explained | Spark Training | Edureka 

edureka!
Подписаться 4,2 млн
Просмотров 147 тыс.
50% 1

( ** Apache Spark Training - www.edureka.co... ** )
This Edureka Spark Architecture Tutorial video will help you to understand the Architecture of Spark in depth. It includes an example where we will create an application in Spark Shell using Scala. It will also take you through the Spark Web UI, DAG and Event Timeline of the executed tasks.
The following topics are covered in this video:
1. Apache Spark & Its features
2. Spark Eco-system
3. Resilient Distributed Dataset(RDD)
4. Spark Architecture
5. Word count example Demo using Scala.
Check our complete Apache Spark and Scala playlist here: goo.gl/ViRJ2K
--------------------------------------------------------------------------------------------------------
Instagram: / edureka_learning
Facebook: / edurekain
Twitter: / edurekain
LinkedIn: / edureka
-------------------------------------------------------------------------------------------------------
#ApacheSparkTutorial #SparkArchitecture #Edureka
How it Works?
1. This is a 4 Week Instructor led Online Course, 32 hours of assignment and 20 hours of project work
2. We have a 24x7 One-on-One LIVE Technical Support to help you with any problems you might face or any clarifications you may require during the course.
3. At the end of the training you will have to work on a project, based on which we will provide you a Grade and a Verifiable Certificate!
- - - - - - - - - - - - - -
About the Course
This Spark training will enable learners to understand how Spark executes in-memory data processing and runs much faster than Hadoop MapReduce. Learners will master Scala programming and will get trained on different APIs which Spark offers such as Spark Streaming, Spark SQL, Spark RDD, Spark MLlib and Spark GraphX. This Edureka course is an integral part of Big Data developer's learning path.
After completing the Apache Spark and Scala training, you will be able to:
1) Understand Scala and its implementation
2) Master the concepts of Traits and OOPS in Scala programming
3) Install Spark and implement Spark operations on Spark Shell
4) Understand the role of Spark RDD
5) Implement Spark applications on YARN (Hadoop)
6) Learn Spark Streaming API
7) Implement machine learning algorithms in Spark MLlib API
8) Analyze Hive and Spark SQL architecture
9) Understand Spark GraphX API and implement graph algorithms
10) Implement Broadcast variable and Accumulators for performance tuning
11) Spark Real-time Projects
- - - - - - - - - - - - - -
Who should go for this Course?
This course is a must for anyone who aspires to embark into the field of big data and keep abreast of the latest developments around fast and efficient processing of ever-growing data using Spark and related projects. The course is ideal for:
1. Big Data enthusiasts
2. Software Architects, Engineers and Developers
3. Data Scientists and Analytics professionals
- - - - - - - - - - - - - -
Why learn Apache Spark?
In this era of ever-growing data, the need for analyzing it for meaningful business insights is paramount. There are different big data processing alternatives like Hadoop, Spark, Storm and many more. Spark, however, is unique in providing batch as well as streaming capabilities, thus making it a preferred choice for lightning fast big data analysis platforms.
The following Edureka blogs will help you understand the significance of Spark training:
5 Reasons to Learn Spark: goo.gl/7nMcS0
Apache Spark with Hadoop, Why it matters: goo.gl/I2MCeP
For more information, Please write back to us at sales@edureka.co or call us at IND: 9606058406 / US: 18338555775 (toll-free).

Опубликовано:

 

22 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 28   
@edurekaIN
@edurekaIN 5 лет назад
Got a question on the topic? Please share it in the comment section below and our experts will answer it for you. For Edureka Apache Spark Certification Training Curriculum, Visit the website: bit.ly/2KHSmII
@sibikrishnap5739
@sibikrishnap5739 4 года назад
Being a Spark Developer. I would say this is the best content I have ever come across which explains Spark Architecture in detail within 21 minutes. Kudos to your work.
@edurekaIN
@edurekaIN 4 года назад
Thanks for the wonderful feedback! Do subscribe to our channel and stay connected with us. Cheers!
@balakk5009
@balakk5009 2 года назад
Thank you team of edureka! ,you did a such grate job entire subject into 10 minutes video. Can you explain DAG in detail like how filter work internally , group by ,sork ,insert statement ,update,delete how internally works Scan /seek Joining Filter Groupby Distinct Top Orderby Union ,unionall,intersect
@aggrawalnikhil02
@aggrawalnikhil02 5 лет назад
In 21 minutes, I learnt lot of things....
@ptbejoy
@ptbejoy 5 лет назад
This video is very informative and very well explained. This is the best Edureka video that i watched so far . Thanks for the trainer.
@edurekaIN
@edurekaIN 5 лет назад
Hey Bejoy, thank you for appreciating our efforts. We are glad you loved the video. Do subscribe to the channel and hit the bell icon to never miss an update from us in the future. Cheers!
@rohangurubhaiye2487
@rohangurubhaiye2487 3 года назад
Amazing Video ,Got to learn a whole lot about spark in a short duration ,Thank you Edureka.
@rsamurti
@rsamurti 2 года назад
In Spark is there any facility to capture the DAGs and the status of task scheduler before a job is executed? Is it possible to manually change the job scheduling policies?
@babarhassan7726
@babarhassan7726 2 года назад
Brilliant job👏 not only about spark architecture but also mini end to end project 👍
@edurekaIN
@edurekaIN 2 года назад
Thank you so much : ) We are glad to be a part of your learning journey. Do subscribe the channel for more updates : ) Hit the bell icon to never miss an update from our channel : )
@VivekYadav-gk9gy
@VivekYadav-gk9gy 5 лет назад
Web API was something new I learnt through this video.
@edurekaIN
@edurekaIN 5 лет назад
Hey Vivek, we are glad you loved the video. Do subscribe and hit the bell icon to never miss an update from edureka in the future. Cheers!
@LearnAndShare9222
@LearnAndShare9222 4 года назад
Thank edurka. It would be great if you guys help us to understand Spark vs YARN architecture ( in terms of similarities & differences)
@edurekaIN
@edurekaIN 4 года назад
Thanks for watching the video. We will process your request as soon as possible. Do subscribe to our channel and stay connected with us. Cheers :)
@ashinkajay
@ashinkajay 2 года назад
Thank you !
@anshumanster
@anshumanster 5 лет назад
Very nicely explained ... crisp and very professional
@edurekaIN
@edurekaIN 5 лет назад
Hey Anshuman, thanks for the compliment. We are glad you loved the video. Do subscribe and hit the bell icon to never miss an update from us in the future. Cheers!
@arunprakash3103
@arunprakash3103 5 лет назад
Thank You Edureka for such Informative videos.
@edurekaIN
@edurekaIN 5 лет назад
You are most welcome Arun, don't forget to Subscribe our channel.
@geethasudhakar6759
@geethasudhakar6759 4 года назад
Excellent Explanation.
@edurekaIN
@edurekaIN 4 года назад
Thank you. You can also check out our complete training here: Apache Spark and Scala Certification Training - bit.ly/3bWTxQh Use code "RU-vid20" to get Flat 20% off on this training.
@balajicherukuri
@balajicherukuri 4 года назад
Why there are multiple part files, rather than single part file?
@edurekaIN
@edurekaIN 4 года назад
The file gets divided into multiple part files as default. You can also keep one single part file as well. no issues regarding that.
@vikramj22
@vikramj22 5 лет назад
Why the output in spite of being so small in size got split in two parts ?
@edurekaIN
@edurekaIN 5 лет назад
Hi Vikram, it's because one partition could have hit the performance rate.
@skateforlife3679
@skateforlife3679 2 года назад
Nice spark is
@edurekaIN
@edurekaIN 2 года назад
Thank you so much for your review on our channel  Great to hear that Edureka is helping you learn better . We’ll strive to make even better learning contents/courses in the future ! Do subscribe the channel for more updates : )
Далее
The ONLY PySpark Tutorial You Will Ever Need.
17:21
Просмотров 129 тыс.
💀СЛОМАЛ Айфон за 5 СЕКУНД😱
00:26
Spark Architecture in Depth Part1
13:02
Просмотров 4,1 тыс.
Learn Apache Spark in 10 Minutes | Step by Step Guide
10:47
Apache Spark - Computerphile
7:40
Просмотров 246 тыс.
What exactly is Apache Spark? | Big Data Tools
4:37
Просмотров 125 тыс.