I was facing issue since 3 days regarding spark installation. I was about to giveup the learning. Came across your video, Thanks for explaining and giving all requisites in decription. Thanks a Ton 🙏
i did everything properly but while running , import findspark findspark.init('/usr/local/spark') i encountered follwing error: IndexError Traceback (most recent call last) File ~\anaconda3\envs\pysparken\Lib\site-packages\findspark.py:159, in init(spark_home, python_path, edit_rc, edit_profile) 158 try: --> 159 py4j = glob(os.path.join(spark_python, "lib", "py4j-*.zip"))[0] 160 except IndexError: IndexError: list index out of range During handling of the above exception, another exception occurred: Exception Traceback (most recent call last) Cell In[1], line 2 1 import findspark ----> 2 findspark.init('/usr/local/spark') Exception: Unable to find py4j in /usr/local/spark\python, your SPARK_HOME may not be configured correctly Can you please help me solve this ?
ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0) org.apache.spark.SparkException: Python worker exited unexpectedly (crashed) at (Task.scala:141) at Getting above error while executing