Тёмный
SparklingFuture
SparklingFuture
SparklingFuture
Подписаться
Hello Friends, I am Sravana and I have this channel specially for technical discussions. The channel has videos on Apache Spark with Scala , PySpark, Scala tutorials and Python tutorials and much more are in queue.
Комментарии
@RaXiUs007
@RaXiUs007 6 дней назад
a small correction i think --num-executors is across all nodes in cluster so it should not be 3 it should be 3 * 5 = 15
@higiniofuentes2551
@higiniofuentes2551 7 дней назад
Thank you for this very useful video!
@NarutoUzumaki-zv4wm
@NarutoUzumaki-zv4wm 12 дней назад
Baaga chepparu madam It helped me a lot
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 12 дней назад
@@NarutoUzumaki-zv4wm Thanks a lot.
@U1-rz3qm
@U1-rz3qm 14 дней назад
If i want add double headers how can we proceed
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 14 дней назад
@@U1-rz3qm please share some examples
@msobert4
@msobert4 25 дней назад
everything is good, is there any git link for these it will help everyone ????
@maheshchandrar8448
@maheshchandrar8448 29 дней назад
thanks so much for your help mam
@maheshchandrar8448
@maheshchandrar8448 29 дней назад
Appreciate your efforts mam
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 12 дней назад
@@maheshchandrar8448 Thanks a lot ☺️
@EDDGARRT
@EDDGARRT Месяц назад
Very helpful and well explained all the exercises!
@RajKumar-zw7vt
@RajKumar-zw7vt Месяц назад
Crystal clear explanation
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 Месяц назад
@@RajKumar-zw7vt Thank you 😊
@Arnob_111
@Arnob_111 Месяц назад
could not understand the lambda function in reduce in line 10.
@chandanmohanty8186
@chandanmohanty8186 2 месяца назад
HI Mam, thanks for the video. Here i have 1 doubt that for big size table where rows and column count are large and the result i want to show the actual value (no True false) then how to deal with that. Thank you.
@ashwenkumar
@ashwenkumar 2 месяца назад
Your contents are good
@sravankumar1767
@sravankumar1767 2 месяца назад
Nice explanation Sravana
@sravankumar1767
@sravankumar1767 2 месяца назад
Nice explanation sravana 👌 👍 👏
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 2 месяца назад
Thank you Sravan...
@aparnakatika1822
@aparnakatika1822 2 месяца назад
Good evening madam can you please give me how to write a star(⭐) program in scala
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 2 месяца назад
@aparnakatika1822 please give more details about the question. Are you talking about the star pattern code? Please use and tweak thr below as per your requirement. If its not, please give me the expected output. object PyramidPattern { def main(args: Array[String]): Unit = { val numberOfRows = 5 for (i <- 1 to numberOfRows) { // Print leading spaces for (j <- 1 to numberOfRows - i) { print(" ") } // Print stars for (k <- 1 to 2 * i - 1) { print("*") } println() } } }
@venukumargadiparthy8233
@venukumargadiparthy8233 2 месяца назад
Much needed for interviews, Thanks for sharing sravana.
@venukumargadiparthy8233
@venukumargadiparthy8233 3 месяца назад
Thanks for sharing..)
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
^[\w*]$ will match a string consisting of a single character, where that character is alphanumeric (letters, numbers) an underscore (_) or an asterisk (*).
@isharkpraveen
@isharkpraveen 3 месяца назад
The last part from the video was confusing... The regular expression. Can you please make a video on regular expression...
@venukumargadiparthy8233
@venukumargadiparthy8233 3 месяца назад
Thanks for sharing Sravana
@sravankumar1767
@sravankumar1767 3 месяца назад
Nice explanation sravana 👌 👍 👏
@venukumargadiparthy8233
@venukumargadiparthy8233 3 месяца назад
Thanks for sharing Shravana..)
@jayisrihari2064
@jayisrihari2064 3 месяца назад
I'm a beginner to this python language..ur explanation is simply gud
@Amarjeet-fb3lk
@Amarjeet-fb3lk 3 месяца назад
How 1TB is equals to 84 lakhs block, when each block is 128 MB.?
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Actually it's: Thank you. Consider each hadoop block size as 128MB. 1TB = 1000000 MB 128MB = 1 block 1000000 /128 = 7813 blocks.
@Amarjeet-fb3lk
@Amarjeet-fb3lk 3 месяца назад
@@sravanalakshmipisupati6533 it’s not 84 lakhs na. You said its around 84 lakhs block. Am I right or missing something? 1TB =1048576 MB 1048576/128 MB= 86317 block Its 86thousand 3hundred and 17 block
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
@@Amarjeet-fb3lk yes, you are correct.
@mohitupadhayay1439
@mohitupadhayay1439 3 месяца назад
Super helpful. Helped me on my work.
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Thank you
@sravankumar1767
@sravankumar1767 3 месяца назад
Superb explanation Sravana 👌 👏 👍
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Thanks Sravan.
@venukumargadiparthy8233
@venukumargadiparthy8233 3 месяца назад
Insightful, thanks for sharing Shravana.
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Thanks Venu 😊
@sravankumar1767
@sravankumar1767 3 месяца назад
Nice explanation sravana, very useful 👌 👍 👏
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Thanks Sravan...
@kunalk3830
@kunalk3830 3 месяца назад
Great work and initiative...but I am bit confused, did u consider the list as already sorted or we sorted it in the code, if so then we have completely ignored the sorting process in our complexity right?
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Thank you. Yes, the complexity will be changed based on the order of the list.
@venukumargadiparthy8233
@venukumargadiparthy8233 3 месяца назад
Thanks for the videos Sravana, very informative..)
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Thanks a lot for the feedback.
@kubersharma1971
@kubersharma1971 3 месяца назад
You have nailed it . Would be looking to connect with you over Linkedin pls share your LinkedIn profile link
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
@kubersharma1971 Thank you. www.linkedin.com/in/sravana-lakshmi-pisupati-b2b6478a
@sravankumar1767
@sravankumar1767 3 месяца назад
Nice explanation Sravana 👌 👍 👏
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Thank you Sravan.
@venukumargadiparthy8233
@venukumargadiparthy8233 3 месяца назад
Very informative, thanks for the video
@rohithreddysureddy9151
@rohithreddysureddy9151 3 месяца назад
First view..😅
@souvikdas811
@souvikdas811 3 месяца назад
Will this work if 2 dataframes have different number of rows?
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
We can tweak the method a little to have the columns filter for comparison.
@giri41
@giri41 3 месяца назад
I need help.. I will pay .. need assistance
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Hi, Please share me your queries at sravana.pisupati@gmail.com
@adammorgan1556
@adammorgan1556 3 месяца назад
Thank you so much for this! For the record, you have a lovely speaking voice.
@hajriimen6247
@hajriimen6247 3 месяца назад
java.io.FileNotFoundException: Could not locate Hadoop executable: C:\Hadoop\bin\winutils.exe -see wiki.apache.org/hadoop/WindowsProblems at org.apache.hadoop.util.Shell.getQualifiedBinInner(Shell.java:619) at org.apache.hadoop.util.Shell.getQualifiedBin(Shell.java:592) at org.apache.hadoop.util.Shell.<clinit>(Shell.java:689) at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79) at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:1691) at org.apache.hadoop.security.SecurityUtil.setConfigurationInternal(SecurityUtil.java:104) at org.apache.hadoop.security.SecurityUtil.<clinit>(SecurityUtil.java:88) at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:312) at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:300) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:575) at org.apache.spark.util.Utils$.$anonfun$getCurrentUserName$1(Utils.scala:2539) at scala.Option.getOrElse(Option.scala:201)
@yashwantdhole7645
@yashwantdhole7645 4 месяца назад
Excellent
@SriRamTrading
@SriRamTrading 4 месяца назад
Its long method, we can obly use split+ explode to solve this if any one wants the answer will post here
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 3 месяца назад
Sure, thanks
@venkatasai-ce5ok
@venkatasai-ce5ok 4 месяца назад
I have doubt if dag ha fault toranlence why lineage
@venukumargadiparthy8233
@venukumargadiparthy8233 4 месяца назад
Insightful, thanks for sharing..)
@raviyadav-dt1tb
@raviyadav-dt1tb 4 месяца назад
video is not clear , please make it little clear
@SenRam-iv4sc
@SenRam-iv4sc 4 месяца назад
good effort , when i tried with unionByName between df1 & df3 i got duplicate records please check and let me know your commends
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 4 месяца назад
Regarding duplicates, unionByName does not inherently remove duplicates. However, if you want to remove duplicates after performing the union, you can use the dropDuplicates() function.
@mondritaroy21
@mondritaroy21 4 месяца назад
Can u please provide the dataset as it is not there link you git repo.
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 4 месяца назад
github.com/sravanapisupati/SampleDataSet/blob/main/xml_data.csv Thanks for watching the video. Please find the link for the dataset.
@mondritaroy21
@mondritaroy21 4 месяца назад
Thank you so much :) @@sravanalakshmipisupati6533
@DanceMania_Ankita
@DanceMania_Ankita 5 месяцев назад
Hey Sravana need your help in flattening one complex xml file
@sravanalakshmipisupati6533
@sravanalakshmipisupati6533 4 месяца назад
Please see if this is useful to you - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-qkiz53baIks.htmlsi=3-m2lQDybWyjCzI7
@nagendran-wn6ws
@nagendran-wn6ws 5 месяцев назад
Nice explanation ..appriciated madam
@naveennoel9496
@naveennoel9496 5 месяцев назад
Explained in a very clear manner. Thanks.
@ankitnayan4688
@ankitnayan4688 5 месяцев назад
Thanks
@nagamanickam6604
@nagamanickam6604 5 месяцев назад
Thank you