Тёмный

day 11 : american express scenario based interview questions and answers in pyspark 

DEwithDhairy
Подписаться 5 тыс.
Просмотров 924
50% 1

Create DataFrame Code
friends_data = [(1, 2),
(1, 3),
(1, 4),
(2, 1),
(3, 1),
(3, 4),
(4, 1),
(4, 3)]
friend_schema = "user_id int , friend_id int"
friends_df = spark.createDataFrame(data =friends_data , schema = friend_schema )
likes_data = [
(1, 'A'),
(1, 'B'),
(1, 'C'),
(2, 'A'),
(3, 'B'),
(3, 'C'),
(4, 'B')
]
like_schema = "user_id int , page_id string"
likes_df = spark.createDataFrame(data =likes_data , schema = like_schema )
display(friends_df)
display(likes_df)
Need Help ? Connect With me 1:1 - topmate.io/dew...
Let's connect on LinkedIn : / dhirajgupta141
pyspark 30 days challenge : • pyspark 30 days challenge
top interview question and answer in pyspark :
• top interview question...
PySpark Installation and Setup : • Spark Installation | P...
DSA In Python Interview Series : • dsa for data engineer ...
PySpark Interview Series : • pyspark interview ques...
Pandas Interview Series : • pandas interview quest...
SQL Interview Series : • sql interview question...
Your Queries :
===========
american express scenario based interview questions and answers in pyspark
american express online assessment
american express interview questions and answers
american express interview questions and answers for data engineer
#pyspark #americanexpress #dataanalytics #dataengineers #youtube #dataengineers #coding #interview #faang

Опубликовано:

 

26 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 7   
@DEwithDhairy
@DEwithDhairy 2 месяца назад
We need this piece also after the filter condition. # Finding the unique records. answer_df = friend_page_concat_df.select(col("friend_id").alias("user_id"), col("page_id")).distinct() answer_df.show()
@SureshK-gr4vc
@SureshK-gr4vc 2 месяца назад
pls provide code repo for this
@DEwithDhairy
@DEwithDhairy 2 месяца назад
Haven't created any repo.. You may write the code while going through the vdo.
Далее
How I Passed The Google Coding Interviews
18:50
Просмотров 47 тыс.
[Top 80] Business Analyst Interview Questions and Answers
2:58:07