This channel is a central repository for all talks and videos related to Apache Airflow.
Check out airflow.apache.org for more information.
Apache Airflow, Apache, Airflow, the Airflow logo, and the Apache feather logo are either registered trademarks or trademarks of the Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including the Apache Software Foundation.
You really don’t want us to use custom transformations on AirByte, you put DBT to video’s title, you put it into the slide as a seperate page but you just use one little sentence about it in whole video. There’s nothing about what did you transform? How did you transform? Interesting. Btw, the video might be 2 years old but I have feelings quite new.
+1, I once created some operators (i.e., ExtractOperator) with the idea of leveraging connection/hook. So we could extract data from various type of DB with the same operator but different connection name and much lesser operators to maintain in house.
Very good presentation, in fact that's the next topic I'll cover with our data engineering team, I'll send them a link to this video beforehand. On the topic of not wasting money, in most use cases, EMR Serverless might really not be cost effective. It's like Glue jobs, depending on your usage, it might cost you several *times* more than EMR on EKS for instance. But I digress, great video, thank you :)
