@easewithdata this is really really useful , please continue with this series for delta lake. Regrading the last question about converting delta file to parquet i think post you run the vaccum command you need to delete the _detla log folder. In this way u will have the parquet file left only.
Hi Shubham, I have been learning databricks and pyspark for a new client, but nowhere I can see how it is working in real time project, it would be great if you could give some insights on your experience working in these techs.