Тёмный

ETL | AWS Glue | AWS S3 | Data Cleansing | Transforming data with AWS Glue in ETL workflows 

Cloud Quick Labs
Подписаться 15 тыс.
Просмотров 10 тыс.
50% 1

===================================================================
1. SUBSCRIBE FOR MORE LEARNING :
/ @cloudquicklabs
===================================================================
2. CLOUD QUICK LABS - CHANNEL MEMBERSHIP FOR MORE BENEFITS :
/ @cloudquicklabs
===================================================================
3. BUY ME A COFFEE AS A TOKEN OF APPRECIATION :
www.buymeacoff...
===================================================================
In this lab you will learn about AWS Glue, which is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources for analytics, machine learning (ML), and application development. You can use a crawler to populate the AWS Glue Data Catalog with tables. This is the primary method used by most AWS Glue users. A crawler can crawl multiple data stores in a single run. Upon completion, the crawler creates or updates one or more tables in your Data Catalog. Extract, transform, and load (ETL) jobs that you define in AWS Glue use these Data Catalog tables as sources and targets. The ETL job reads from and writes to the data stores that are specified in the source and target Data Catalog tables.
example data : github.com/Rek...
#awsglue #etl #datatransformation #s3 #cloudquicklabs #crawler #etljob
#dataengineering #data #datacleansing #datamodificada

Опубликовано:

 

5 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 20   
@richardlphillips
@richardlphillips 24 дня назад
Very helpful video. Thank you 🙂
@cloudquicklabs
@cloudquicklabs 24 дня назад
Thank you for watching my videos. Glad that it helped you.
@KamalKumar-s7t
@KamalKumar-s7t 8 месяцев назад
Excellent video, please make more videos like that on ETL, admire your hard work, very smooth explanation…… Thanks
@cloudquicklabs
@cloudquicklabs 8 месяцев назад
Thank you for watching my videos. Indeed , I shall make videos on data engineering. Glad that my videos helped you.
@sujithadas9844
@sujithadas9844 8 месяцев назад
Loved your series on AWS Glue.. nicely explained.. 😊 Please upload more scenarios with other transformations such as join and filter ! Subscribed already.. thank you !!
@cloudquicklabs
@cloudquicklabs 8 месяцев назад
Thank you for watching my videos. Glad that it helped you. Indeed I shall make more videos around this topic ahead.
@rashmishah5682
@rashmishah5682 8 месяцев назад
Thanks a lot....please make more videos with different transformation and also the use of cloudwatch and lambda with it....
@cloudquicklabs
@cloudquicklabs 8 месяцев назад
Thank you for watching my videos. Glad that it helper you. I shall make more videos around this topic and Thank you for giving inputs.
@yadi4diamond
@yadi4diamond 4 месяца назад
excellent
@cloudquicklabs
@cloudquicklabs 4 месяца назад
Thank you for watching my videos. Glad that it helped you.
@WolfmaninKannada
@WolfmaninKannada 7 месяцев назад
Excellent brother❤
@cloudquicklabs
@cloudquicklabs 7 месяцев назад
Thank you for watching my videos. Glad that it helped you.
@bellamkondapushpashree4923
@bellamkondapushpashree4923 6 месяцев назад
It is showing failed at the end after running the job ...can you make a video on how to debug this issue
@cloudquicklabs
@cloudquicklabs 6 месяцев назад
Thank you for watching my videos. You can find ETL pipeline logs if you go pipeline runs or you can also find the same at Cloudwatch log groups.
@NandhuVlogs.
@NandhuVlogs. 7 месяцев назад
Bro You create Glue job by using python script...... In real time..... Visual ETL is Never preferred......
@cloudquicklabs
@cloudquicklabs 7 месяцев назад
Thank you for watching my videos. Indeed , I would creating videos on creating job via python script. But this video is to focus on ETL topic.
@manibaddireddy5477
@manibaddireddy5477 23 часа назад
Bro your copying one one file could please tell me how to copy multiple files
@cloudquicklabs
@cloudquicklabs Час назад
Thank you for watching my videos. It does copies all files present underneath folder path given in job. It's been mentioned in videos.
@faisalmali3809
@faisalmali3809 6 месяцев назад
How can I run multiple glue jobs.
@cloudquicklabs
@cloudquicklabs 6 месяцев назад
Thank you for watching my videos. Do you mean creating multiple job or multi threading within a job ?
Далее
НЮША УСПОКОИЛА КОТЯТ#cat
00:43
Просмотров 781 тыс.
AWS Hands-On: ETL with Glue and Athena
22:35
Просмотров 29 тыс.
AWS Data Engineer Project | AWS Glue |  ETL in AWS
17:58
НЮША УСПОКОИЛА КОТЯТ#cat
00:43
Просмотров 781 тыс.