Тёмный

111. Databricks | Pyspark| SQL Coding Interview: Exchange Seats of Students 

Подписаться
Просмотров 5 тыс.
% 94

Azure Databricks Learning: Coding Interview Exercise: Pyspark and Spark SQL
=================================================================================
Coding exercises are very common in most of the Bigdata interviews. It is important to develop coding skills before appearing for Spark/Databricks interviews.
In this video, I have explained a coding scenario to exchange the seats of students in a class. This is Leet Code SQL Exercise number 626. This is also one of the FAANG company question Google, Microsoft, Amazon, Apple, Meta etc.,
Also have customised the scenario a bit and solved the problem. To get more understanding, watch this video
#LeetCodeSQL, #HackerRankSQL,#FAANGCodingQuestion, #GoogleCodingSQL, #AmazonCodingSQL, #MicrosoftCodingSQL,#SQLSeatsExchange,#PysparkSeatsExchange, #CodingInterviewQuestion, #ApacheSparkInterview, #SparkCodingExercise, #DatabricksCodingInterview,#SparkWindowFunctions,#SparkDevelopment,#DatabricksDevelopment, #DatabricksPyspark,#PysparkTips, #DatabricksTutorial, #AzureDatabricks, #Databricks, #Databricksforbeginners,#datascientists, #datasciencecommunity,#bigdataengineers,#machinelearningengineers
Input table:
+------------+--------------+
| id |Student |
+------------+--------------+
| 1 | Alice |
| 2 | Bob |
| 3 | Charlie |
| 4 | David |
| 5 | Eve |
+------------+--------------+

Наука

Опубликовано:

 

11 июл 2023

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 36   
@GANGAEDIGA
@GANGAEDIGA 2 месяца назад
For given exercise: exchange_df1 = df.withColumn("ExchageStudent", when (col('id')%2==1 , coalesce(lead('name',3).over(Window.orderBy('id')),col('name'))). when (col('id')%2==0 , coalesce(lag('name',3).over(Window.orderBy('id')),col('name'))). otherwise(col('name')) )
@rajasdataengineering7585
@rajasdataengineering7585 2 месяца назад
Thanks
@user-du5bs8fk6l
@user-du5bs8fk6l 4 месяца назад
Assignment Qn: if below approach is incorrect, pls let me know spark.sql("""select id, name, case when id=1 then lead(name,3) over(order by id) when id=4 then lag(name,3) over(order by id) else name end as fname from users""")
@ranjansrivastava9256
@ranjansrivastava9256 9 месяцев назад
Really very informative videos, please upload more. you are explaining in very good manner. Keep it going !!!
@naveenraj9977
@naveenraj9977 11 месяцев назад
Thanks for Sharing the real time scenario, Waiting for more information,Keep it going..!!!!!!
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Thanks Naveen, will do!
@srinubayyavarapu2588
@srinubayyavarapu2588 11 месяцев назад
Sir, Thanks a lot for your commitment and Please Upload more coding exercise videos , This will be the game changer , Respect to you
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Thanks Srinu! Glad you liked it Sure we will upload more videos
@sumitchandwani9970
@sumitchandwani9970 11 месяцев назад
Please upload more coding excercise videos they are amazing. Really helpful for developing analytical thinking.
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Thanks Sumit! Will upload more videos
@venkatasai4293
@venkatasai4293 11 месяцев назад
Good explanation Raja . Keep it going .
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Thanks Venkat!
@zub3rahmed76
@zub3rahmed76 7 месяцев назад
Exactly keep uploading more videos like this
@rajasdataengineering7585
@rajasdataengineering7585 7 месяцев назад
Sure, will create more videos on coding exercises after completing delta live table series soon
@DineshTelegenic
@DineshTelegenic 11 месяцев назад
Thanks for the valuable content.
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
My pleasure! Glad it helps data engineers
@Munchkin_K
@Munchkin_K 12 дней назад
You speak continuous, need time to grasp 😊
@rajasdataengineering7585
@rajasdataengineering7585 11 дней назад
Thank you for your feedback. I will try to speak slowly
@nagarajanmurugesan6932
@nagarajanmurugesan6932 11 месяцев назад
Keep up the good work. 🙂
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Thanks, will do!
@prabhatgupta6415
@prabhatgupta6415 11 месяцев назад
Thanks sir u gave the data. please keep going sir. Please include how to present project infront of interview,manerial round question etc. How to handle big data managerial question. how to dominate interview in our ways.
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Sure Prabhat, will create videos on these topics. Thanks for your comment
@ATHARVA89
@ATHARVA89 11 месяцев назад
superb!
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Thank you! Cheers!
@Jangampavan2021
@Jangampavan2021 11 месяцев назад
Thank You ..! Please attach the the notebook
@bhanukiran7916
@bhanukiran7916 10 месяцев назад
Thank you😮
@rajasdataengineering7585
@rajasdataengineering7585 10 месяцев назад
You're welcome 😊
@ranjansrivastava9256
@ranjansrivastava9256 9 месяцев назад
Plz answer the Quiz question.
@ShubhamSharma-sy2ce
@ShubhamSharma-sy2ce 4 месяца назад
SELECT id, CASE WHEN student = 'Alice' THEN (SELECT student FROM students_view WHERE student = 'David') WHEN student = 'David' THEN (SELECT student FROM students_view WHERE student = 'Alice') ELSE student END as updated_student, student FROM students_view;
@ShubhamSharma-sy2ce
@ShubhamSharma-sy2ce 4 месяца назад
in pyspark: updated_students_view = students_view.withColumn("updated_student", when(students_view["student"] == 'Alice', students_view.filter(students_view["student"] == 'David')["student"] ) .when(students_view["student"] == 'David', students_view.filter(students_view["student"] == 'Alice')["student"] ) .otherwise(students_view["student"]) )
@rajasdataengineering7585
@rajasdataengineering7585 4 месяца назад
Thanks for sharing your approach
@TejaswiniNandam
@TejaswiniNandam 11 месяцев назад
Great scenario to practice Thanks for providing. I have been following your channel for Spark, and your explanation for every topic is clean and easy to understand for everyone. Here is the code that I practiced, it may help anyone to practice. please let me know of any corrections or suggestions in terms of performance. #creating Dataframe data=[(1,'Alice'),(2,'Bob'),(3,'Charlie'),(4,'David'),(5,'Eve')] df=spark.createDataFrame(data,['id','student']) df.show() #Pyspark solution from pyspark.sql.functions import col,lead,lag,when from pyspark.sql.window import * df.withColumn('new',when (col('id')%2==0,lag('student').over(Window.orderBy('id'))).\ when (col('id')%2== 1,coalesce(lead('student').over(Window.orderBy('id')),'student'))).drop('student').show() #creating tempview df.createOrReplaceTempView('sampl') #sql solution %sql select id,case when id%2=0 then lag(student) over(order by id) when id%2=1 then lead(student,1,student) over(order by id) end new from sampl
@rajasdataengineering7585
@rajasdataengineering7585 11 месяцев назад
Thank you! It looks good. Hope it helps data engineers in this community
@mohammediqbal2406
@mohammediqbal2406 7 месяцев назад
this code is for the assignment which raja sir has given in the last?