Waiting for more videos on this play list, you are the perfect teacher for fast learners.thank you so much for taking the time to post videos in this topic.
Never actually tried setting up Jupyter lab with Scala, but you can definitely try. The core concept for Spark and Spark Streaming would remain same with some light code changes. Please checkout Databricks Community Edition, that supports working with Scala by default.
HI, While creating the spark session, I am getting this error: RuntimeError: Java gateway process exited before sending its port number I encountered few others had the same issue in your pyspark -zero to hero series but couldn't find any solution .Please help. I followed the same instructions from this video to download the docker image and the container- 03 Data Lakehouse | Data Warehousing with PySpark | Setup Docker PySpark Jupyter Lab Environment
Hi, I just made changes in the yml file of your github repo, removing the version line which was giving an error, also with many new featured added to Spark 3.5.0 with addition of Apache Arrow which will make querying many times faster , pandas package 2.0x upgrade, autocompletion, Plenty of new features to PySpark, I'll run the whole and give you an update, would that be okay?