Thanks Sir for sharing such informative content. I am watching your video since long and indeed it helped me a lot in enhancing my Spark knowledge.:) I have one question which is asked to me during interview. what are the optimizations we can do while joining two large tables? apart from pre-bucketing and pre-sorting.
Thanks for answering my question .My question was if we are getting json data daily nested json we have to flatten json into dataframe dynamically we can do manually if json is nested into flatten but i want json file read and flatten into dataframe it can be any json that is in pyspark Thanks
sir 1am a 2013 bca graduated.....8 year gap..now i want to enter in hadoop big data software filed.. is it good decisions for me, in that 8 year i teach to students ICT subject but now this contract is over
Thankyou for all your valuable videos, I'm recently about to change to one of firm for big data developer, transitioned from telecom domain, what are other tools set-up required in my system other than below - I have eclipse IDE, Cloudera Setup, jupyter notebook, MySQL setup as of now, also any other important point which I should take care or consider before taking my 1st step, upcoming Monday would be my 1st day. Thankyou awaiting your response . @gkcodelabs