This video was very informative. But could you make a video showing how things are being done practically? Also will you please make a video covering the spark.sql joins? That will be extremely helpful. Also, I must admit that I love taking notes from using your videos. Please make more.
Nice video , Can you explain the same concept from Dataframe standpoint in spark 3.0 ? Practically speaking we tend to use Dataframe( Or dynamic frame for AWS) over rdd for most of our task.