how to deploy in prduction with the db.property or any other files .....reading dynaicaly kept in the same path as our jar file is running with the spark submit command .??

Very good. Thanks

Which vdi u installed?

where can I find the code?

Thanks man ! Clear and direct !

Thank you Bro, useful information

Good❤

can you please provide the link for the notes you are referring for?

hey! where can i get this notes ? is it in github ?

Thanks for sharing this. After 8 years and it's still relevant.

in 17th minute count function is referred as wide transformation. why is count wide transformation since we dont need any shuffling of data for counting??

What course is this , and how can I join ? Thanks

Thanks bro. To the point.

Thanks for the setup video, I was able to install PySpark but facing error while running scrypt sc.textFile("C:\\deckofcards.txt").first() Traceback (most recent call last): File "<stdin>", line 1, in <module> File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 2888, in first rs = self.take(1) ^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 2822, in take totalParts = self.getNumPartitions() ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark dd.py", line 952, in getNumPartitions return self._jrdd.partitions().size() ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\lib\py4j-0.10.9.7-src.zip\py4j\java_gateway.py", line 1322, in __call__ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\pyspark\errors\exceptions\captured.py", line 179, in deco return f(*a, **kw) ^^^^^^^^^^^ File "C:\Spark\spark-3.5.1-bin-hadoop3\python\lib\py4j-0.10.9.7-src.zip\py4j\protocol.py", line 326, in get_return_value py4j.protocol.Py4JJavaError: An error occurred while calling o38.partitions. : org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/C:/deckofcards.txt

Please explain python model using snowspark

Nice 🙂

Please fix the error in the second last video of apache spark virtual environment Playlist.

Plsssss fix the errrroooo @itversity

Still the video error persists can you pls fix this

Even docker got also error on my windows

thank you, it is very helpful!

if i started learning for now than there are very less data engineering internships(if one has data internship it is easy to get a job ,and that person also get hand on experience ) ,,,,so should i do data analyst first only for internship and after that i will study for data engineering for job because it is also a good way , and i need to do an internship because it is in our college criteria , they do not support much if you do not have done internship??

Thank you.....2013 to 2024....Big Data to DBT.... sad but true....

So clever and intelligent of you to use -ltr here

Amazing