Great video akka, but I had problems with just mounting because there had to be some persistent connection. If someone is seeing this and if the script didn't work for them, they can maybe try adding an excel workbook to the input folder within the container and directly accessing it using the below command # Set the configurations for the Spark session for key, value in configs.items(): spark.conf.set(key, value) try: #try to read df = spark.read.format("csv").option("header", "true").load(filePath) #display the df.head(20) df.show() print("Successfully accessed the data in ADLS Gen2") except Exception as e: print("Failed to access ADLS Gen2:", e) Either way, your tutorial had saved me, thanks for the great video.
excellent, instead of just showing the steps, appreciate for explaining the reason why we are doing the steps. keep up the good work, unfortunately, there is no option to double / triple like on youtube. so could only give one like for the video.
Your videos are awesome! I am very much new to data engg stuff, learning things from google and youtube. Your contribution in this space excellent. Could you please provide the Microsoft documentation link to find this code
How to Merge Spark DataFrame - Complex type if we have two json files json 1 schema and json2 schema is differenr how can we merge using pyspark. can you please explain this scenario.
Hi, thank u for the amazing content. I followed the tutorial, but I got this error "The operation is not allowed by RBAC. If role assignments were recently changed, please wait several minutes for role assignments to become effective. ". Please help me on this. Thanks in advance
Super! Thanks very much... I have tried this many times but I am unable to mount it.. getting the below error. can you please help me.. "Waiting for cluster to start: The operation could not be performed on your account with the following error message: azure_error_code: OperationNotAllowed, azure_error_message: Operation could not be completed as it results in..."
