Тёмный

How to Use Redshift with Airflow! 

The Data Guy
Подписаться 8 тыс.
Просмотров 2 тыс.
50% 1

Discover the seamless integration of Amazon Redshift and Apache Airflow in this step-by-step tutorial. Whether you're managing vast datasets or orchestrating complex workflows, learn how to harness the power of Redshift's data warehousing capabilities with Airflow's dynamic workflow scheduling. This video covers setup, best practices, and real-world use cases, ensuring you can efficiently scale and optimize your data operations. Perfect for data engineers, architects, and those eager to boost their data infrastructure skills. Dive in now, and take your Redshift and Airflow expertise to new heights! Don't miss out - subscribe for more cutting-edge data tutorials.
registry.astro...
airflow.apache...

Опубликовано:

 

6 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 21   
@andynelson2340
@andynelson2340 11 месяцев назад
Great info. It seems like every month there's a new orchestration tool that pops up. I'm sure they all have their pros and cons but it seems like airflow has the biggest community and it's battle tested.
@thedataguygeorge
@thedataguygeorge 10 месяцев назад
My opinion exactly! Everyone wanna be Airflow, but ain't no body Airflow!
@ingenieroriquelmecagardomo4067
@ingenieroriquelmecagardomo4067 11 месяцев назад
Would be cool if we had an Airflow + Spark / PySpark video.
@thedataguygeorge
@thedataguygeorge 10 месяцев назад
Ask and you shall receive!
@bananaboydan3642
@bananaboydan3642 9 месяцев назад
when i try to use the astro dev init command it says "Try 'astro --help' for help. Error: No such command 'dev'."
@bananaboydan3642
@bananaboydan3642 9 месяцев назад
i already pip installed the astro-cli
@thedataguygeorge
@thedataguygeorge 9 месяцев назад
Oh interesting, would you mind running the astro version command and letting me know what you get?
@bananaboydan3642
@bananaboydan3642 9 месяцев назад
@@thedataguygeorge the problem is that pip installing and brew installing is only for Unix based systems, I read the documentation for windows and installed airflow with docker so im gonna try to set up an environment now, thank you though!
@bananaboydan3642
@bananaboydan3642 9 месяцев назад
it works ! just had to use the Winget method
@bananaboydan3642
@bananaboydan3642 9 месяцев назад
@@thedataguygeorge btw man are you on LinkedIn or any other social media? Feel like I'll have a ton of questions about the astro cli while working with it if you're open to that
Далее
Don't Use Apache Airflow
16:21
Просмотров 92 тыс.
Bike Challenge
00:20
Просмотров 14 млн
Нарвался на сотрудника ФСБ⚡️
01:00
How to submit Spark jobs to EMR cluster from Airflow
14:38
What They Don't Tell You About Apache Airflow
11:10
Просмотров 6 тыс.
Apache Airflow Architecture 101
18:29
Просмотров 11 тыс.
Bike Challenge
00:20
Просмотров 14 млн