Тёмный

How to Read S3 Partitioned Data as Columns in AWS Glue DF 

Soumil Shah
Подписаться 43 тыс.
Просмотров 250
50% 1

How to Read S3 Partitioned Data as Columns in AWS Glue DF
Exercise Files
github.com/sou...

Опубликовано:

 

14 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 3   
@balajis4788
@balajis4788 2 месяца назад
Many Thanks Soumil. This is what exactly I was looking for. We have Kinesis data stream and we are exporting to S3 through firehose. The firehose exports data in yyyy/MM/dd/HH format. We needed to write batch-ETL in glue to transform the data and store this in different S3 location. The new location should have the same format, yyyy/MM/dd/HH. This code really helped in solving this issue.
@SoumilShah
@SoumilShah 2 месяца назад
Thank you sir
@TheSarfarazahmed
@TheSarfarazahmed 4 месяца назад
शानदार👌
Далее
Set up a CloudFront CDN for an S3 Bucket
11:49
Просмотров 71 тыс.
Top AWS Services A Data Engineer Should Know
13:11
Просмотров 169 тыс.
AWS Glue: Write Parquet With Partitions to AWS S3
8:23
Database Replication & Sharding Explained
6:53
Просмотров 25 тыс.