Install Apache Spark on Mac, Windows, Linux

Подписаться 29 тыс.

Просмотров 17 тыс.

50% 1

My Name is Harjeet and I am very happy to share my knowledge with you. I want to learn and share with our community. Please feel free to drop a message if you feel I can improve in any way or I could help you in any way.
Let us learn Together.
In this video, we are going to learn
1. Write Your First Streaming Job
2. Read data from sockets
3. Write data in a streamed way
4. Different output modes in a Streaming Job
Other Videos in Structured StreamingSeries
1. Environment Setup: • Install Apache Spark o...
2. What is Streaming: • Streaming Introduction...
3. Write First Streaming Job: • Writing Your First Str...
4. Structured Streaming From file Source: • Stream Files to Struct...
Here are a few Links useful for you
Git Repo: github.com/har...
Docker Download: www.docker.com...
Idea Intellij: www.jetbrains....
If you are interested to join our community. Please join the following groups
Whatsapp: chat.whatsapp....
Telegram: t.me/bigdata_hkr
You can drop me an email for any queries at
aforalgo@gmail.com
#spark #structuredstreaming #streaming #bigdata

Опубликовано:

11 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 25

@hiteshtaneja 4 года назад

Good to see you back on RU-vid your earlier videos where of great help.Please do cover how to query database based on records received in streaming DF.

@DataSavvy 4 года назад

Thanks for your suggestion Hitesh... I will plan for this... And I am happy these videos are useful for you :)

@bhargavhr8834 4 года назад

Welcome🎉 back harjeet

@DataSavvy 4 года назад

Thanks Bhargav... Please share your feedback and suggestions :)

@bhargavhr8834 4 года назад

@@DataSavvy sure, will follow and provide you feedback and suggestions

@DataSavvy 4 года назад

Thanks

@rahulpandit9082 4 года назад

Hope this series ll rock.... Keep it up Sir... improve video quality a little bit as I feel... Even in 480p, some texts are not clearly seen..

@DataSavvy 4 года назад

Thanks Rahul... Please share your suggestion and feedback

@DataSavvy 4 года назад

Sure... I will look into that aspect of video quality :)

@manishsahani4867 4 года назад

@@DataSavvy please make more videos on. databricks

@rohitkamra1628 4 года назад

Nice... Keep it up bro👍

@DataSavvy 4 года назад

Thanks Bro :)

@gonzalosurribassayago4116 3 года назад

Hi from Spain I like it very good

@jayantmeshram7370 Месяц назад

I am trying to run your code in ubuntu system but not able to .. could you please make a video how to run your code in ubuntu/linux .. thanks

@ravikirantuduru1061 4 года назад

Can you do practical videos on how to handle data skewness and how to do salting techniques

@DataSavvy 4 года назад

Ok Ravi... I will plan for that

@haradica5 8 месяцев назад

When I run the SparkBuildTest .... I am getting an error. scala: Error: Error compiling the sbt component 'compiler-bridge-2.12.1-65.0' sbt.internal.inc.CompileFailed: Error compiling the sbt component 'compiler-bridge-2.12.1-65.0' I even d/l Java 8 and pointed the JRE Path for sbt to C:\Program Files (x86)\Java\jre-1.8 and the scala version to 2.12.1. sbt build is running fine without error. Docker is running spark_st ..however when I run the sparkBuildTest ... running into this error.Any help would be appreciated

@DataSavvy 8 месяцев назад

Can you share more details

@prateekshukla8879 4 года назад

Sir pls make one video on Spark-Kafka integration in Hive including hands on experience with byte offset consumption through Kafka.

@DataSavvy 4 года назад

I have created spark Kafka integration video as part of this video... Can you elaborate on your ask... How do you plan to use hive... As output store?