In this video I have discussed on Interview question asked in PWC interview for data engineers.
Q1 : read the address as street_name, city_name, country_name?
Sample Data:
emp_id|emp_name|emp_add
1|Alice|123 Main Street,New York,USA
2|Bob|456 Oak Avenue,San Francisco,USA
3|Carol|789 Pine Road,Los Angeles,USA
4|David|321 Elm Lane,Chicago,USA
5|Emily|654 Maple Drive,Miami,USA
Q2 : Get student id of student who topped in the respective subjects
Sample data
data = [
(1, 'Math', 90),
(1, 'Science', 93),
(1, 'History', 85),
(2, 'Math', 85),
(2, 'Science', 79),
(2, 'History', 96),
(3, 'Math', 95),
(3, 'Science', 87),
(3, 'History', 77),
(4, 'Math', 78),
(4, 'Science', 91),
(4, 'History', 90),
(5, 'Math', 92),
(5, 'Science', 84),
(5, 'History', 88),
]
Solution is in PySpark
Check out this video and do let me know your doubts we can connect on
linkedIn : / priyam-jain-0946ab199
Do subscribe @pysparkpulse for more such Questions.
#pyspark #spark #bigdata #bigdataengineer #dataengineering #dataengineer #deloitte
22 сен 2024
