Тёмный

AWS Lakehouse Automation: Loading and unloading data from Amazon Redshift using Apache Airflow 

Gary Stafford
Подписаться 1,6 тыс.
Просмотров 4,4 тыс.
50% 1

In the following video demonstration, we will learn how to programmatically load data into and upload data from Amazon Redshift using Amazon Managed Workflows for Apache Airflow (Amazon MWAA). Using Airflow, we will COPY raw data into staging tables and then merge that staging data into a series of tables. We will then load incremental data into Redshift on a regular schedule. Next, we will aggregate data from several tables and UNLOAD that data to an Amazon S3-based data lake. Lastly, we will catalog the data in S3 using AWS Glue and query with Amazon Athena.
All open-source files on GitHub: github.com/garystafford/ticki....
This video represents my own viewpoints and not of my employer, Amazon Web Services (AWS). All product names, logos, and brands are the property of their respective owners.
📣 Please subscribe to my RU-vid channel for future videos.

Наука

Опубликовано:

 

30 ноя 2021

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 2   
2 года назад
Excellent demostration thanks for sharing
@joggyjames
@joggyjames 2 года назад
great work gary, thank you.
Далее
How to Use Redshift with Airflow!
10:31
Просмотров 1,7 тыс.
Она Может Остановить Дождь 😱
00:20
Building a Data Lake on AWS with Apache Airflow
40:14
iPhone 16 - НЕ СТОИТ ПРОПУСКАТЬ
4:50
How to Soldering wire in Factory ?
0:10
Просмотров 2,9 млн
НЕ БЕРУ APPLE VISION PRO!
0:37
Просмотров 119 тыс.