Тёмный

Spark Installation on Mac and run Pyspark locally. 

Data Talkies
Подписаться 125
Просмотров 12 тыс.
50% 1

Downloading Apache Spark on laptop(MAC)
install java (prerequisite) to run pyspark
run pyspark abd check Web UI
link to download SPARK: spark.apache.o...
link to download JAVA: www.oracle.com...
NOTE:
Spark itself is written in Scala but it runs on Java Virtual Machines so you need java version 8 or newer on your laptop before running pyspark..

Опубликовано:

 

1 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 26   
@Yassou1985
@Yassou1985 Год назад
Clear, simple, short..... exactly what i was looking for thanks for your share and time
@balochcode
@balochcode 2 дня назад
This is the best video for installing PySpark on a Mac. I was struggling with the Java and Spark installation, but this video saved the day.
@deepkunwarmane2639
@deepkunwarmane2639 Год назад
Oh I watched lot of videos to solve my issue on downloading pyspark in Mac. but this one helped me Thank you so much!!! please keep it up and please make more videos on various topics. You do really tell well!!!!
@realShtayeh
@realShtayeh 6 дней назад
انت ملكة
@ahmetalperenyildirim6184
@ahmetalperenyildirim6184 11 месяцев назад
Thanks a lot! I took a course from Udemy but your video helped me to setup the programs. Great work thank you for sharing!
@rahulsaran_m
@rahulsaran_m Месяц назад
Love to see more videos on ur channel
@Prmmani
@Prmmani 10 месяцев назад
Thanks Sister 🙏.
@shelly1067
@shelly1067 Год назад
out of all the videos, only this one helped, thank you
@divyabhutani5135
@divyabhutani5135 Год назад
Good Work for Mac users, thank you
@amitjaiswal781
@amitjaiswal781 Год назад
Thank you so much for this video.
@goldymalik29
@goldymalik29 6 месяцев назад
You Should start posting more videos. Very well explained... Thanks Ashu!
@Mr.HappySoul09
@Mr.HappySoul09 Год назад
Thank you :)
@DileepG-h4t
@DileepG-h4t 11 месяцев назад
Good Explanantion..is it possible to add more videos
@allrounder3234
@allrounder3234 11 месяцев назад
Mam can you please take a minute for reply i m having big data need to solve on hive and spark is pyspark enough or i need to install else something extra
@datatalkies
@datatalkies 11 месяцев назад
Hi! It really depends what are you trying to solve. if you can describe the task more, I can guide better.
@shivatrivedi6964
@shivatrivedi6964 6 месяцев назад
thank you ❣️
@Venkat-w4l
@Venkat-w4l 8 месяцев назад
nice guidance
@patimz
@patimz 11 месяцев назад
I came here first to fix pyspark, but I keep coming back to listen to your voice ☺
@jayzen1
@jayzen1 10 месяцев назад
is this done every time we want to run a SparkSession?
@datatalkies
@datatalkies 9 месяцев назад
Once your laptop is set up for PySpark using these steps, you can simply run PySpark from the Spark folder; there's no need to reinstall Spark every time.
@ATothFTW18
@ATothFTW18 11 месяцев назад
when I try to install java it is telling me I need to install arm 64 installer?
@datatalkies
@datatalkies 11 месяцев назад
it means your laptop need arm 64 installer instead of x64. you can go to same link I showed in video and instead of x64 , click on arm64 installer. let me know it works.
@ATothFTW18
@ATothFTW18 10 месяцев назад
@@datatalkies Thank you! This is a very helpful video!
@harshithvarma961
@harshithvarma961 Год назад
Hi Ma'am, I have followed your video and installed pyspark and java. After installing when I tried to run "bin/pyspark" I got some strange error as below: " (base) harshithvarma@Harshiths-MBP spark-3.5.0-bin-hadoop3 % bin/pyspark /Users/harshithvarma/Downloads/spark-3.5.0-bin-hadoop3/bin/spark-class: line 71: /Library/Java/JavaVirtualMachines/openjdk-17.jdk/Contents/Home//bin/java: No such file or directory /Users/harshithvarma/Downloads/spark-3.5.0-bin-hadoop3/bin/spark-class: line 97: CMD: bad array subscript head: illegal line count -- -1 " Can you please help me out for resolving this issue?
@datatalkies
@datatalkies Год назад
what are you getting when you run following command: ls /Library/Java/JavaVirtualMachines/
@datatalkies
@datatalkies Год назад
also if you can print java home like: echo $JAVA_HOME
Далее
The ONLY PySpark Tutorial You Will Ever Need.
17:21
Просмотров 135 тыс.
Лучше одной, чем с такими
00:54
Просмотров 532 тыс.
Installing Apache Spark On Mac
3:49
Просмотров 31 тыс.
Download and Install Maven on macOS
10:23
Просмотров 44 тыс.
How To Install Spark Pyspark in Windows 11 ,10 Locally
17:37