Hey Kahan, my company is transitioning from using a data warehouse to lakehouse so I will need to get comfortable with tech like Trino, Apache Iceberg, etc. Would you be able to cover this topic in a future video? Thank you and I love your content!
I have noticed many of my friends wanted to breach into the data engineering or similar DEV role however were not clear what exactly they want to be (maybe DB expert, maybe web developer or....). The thing is in order to get a fine paid DEV job you need to be absolutely sure what you want and focus on the necessary tech stack. It's a tough journey working as IT developer of any kind & many simply are not well focused / suited for it therefore it is so well paid.
Thinking of pet projects, I've got a lot of workout data in google sheets i'd like to automate loading into a database (I've manually inserted data into db before so trying to broaden more than that). What would you use/learn to automate loading data. Does airbyte -> dbt -> postgress make sense?
