Hi Viresh, Thanks for sharing your videos.They are awesome! I am new to Apache Spark. I have worked in few projects using Spark but I need to explore more like more details including performance. can you please point me to some use cases, some datasets which I can practice that will give me an overall experience required to crack interviews in BigData? I am from Java background.
Hi Viresh , I am watching your videos regularly. I am into Hadoop production experience. Want to move spark development . Please help me with any project which I can work
didn't get the concept for filtering first and then scanning. Even if it is filtering first, let's say here for src=DEN, then doesn't that mean, it is checking for that "src" from amongst the all available "src"s, in a way scanning only. Kindly explain if I am wrong.
Think it from the perspective that , do you want to bring all the partitions into the context and then do filtering versus do the filtering first and bring only the required partitions into the context for further processing.