03 Spark Streaming Local Environment Setup - Docker, Jupyter, PySpark and Kafka 

You're doing an excellent job! Learned PySpark from here. I'm eager to learn Spark Streaming from this channel too.

You are awesome man. I was trying to setup spark and kafka in docker for long time. done today. thank you very much

Waiting for more videos on this play list, you are the perfect teacher for fast learners.thank you so much for taking the time to post videos in this topic.

I am from from spark Scala background will it be fine to use that? if yes then how can I change programming to Scala in jupyter notebook ?

in search of gold , i found a diamons

HI, While creating the spark session, I am getting this error: RuntimeError: Java gateway process exited before sending its port number I encountered few others had the same issue in your pyspark -zero to hero series but couldn't find any solution .Please help. I followed the same instructions from this video to download the docker image and the container- 03 Data Lakehouse | Data Warehousing with PySpark | Setup Docker PySpark Jupyter Lab Environment

Hi, I just made changes in the yml file of your github repo, removing the version line which was giving an error, also with many new featured added to Spark 3.5.0 with addition of Apache Arrow which will make querying many times faster , pandas package 2.0x upgrade, autocompletion, Plenty of new features to PySpark, I'll run the whole and give you an update, would that be okay?

Hello , where did you continue with kafka in which video ?

Hi, thank you for your videos, can you be my mentor? i am willing to purchase your course on Real-time processing frameworks/engines.