LINKS
ℹ️ GitHub: github.com/joh...
ℹ️ AWS Docs: docs.aws.amazo...
In this video we cover what an AWS Glue Crawler is and how you can use it to populate the AWS Glue Data Catalog. We cover the basics of the AWS Crawler before diving into a full demo where we register data in S3 with the AWS Glue Data Catlaog using a crawler we define on the AWS Console. All the resources required to follow long are provided for free at the GitHub link above.
SUPPORT THE CHANNEL:
☕ Buy Me A Coffee: www.buymeacoff...
🖥️ My VPN: go.nordvpn.net...
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:34 - What is a Glue Crawler
01:54 - Demo
02:02 - Download Data
02:25 - Table Schema
02:57 - Create S3 Bucket
03:41 - Upload Data To S3
04:25 - Create Crawler
04:56 - Create Data Source
05:36 - Create IAM Role
06:22 - Run Crawler
06:44 - crawler Output
08:03 - Outro
OTHER USEFUL LINKS:
ℹ️ My Website: johnnychivers....
🔗 Linkedin: / johnny-chivers
Are you preparing for the AWS Certified Data Engineer - Associate (DEA-C01) exam? This comprehensive full course is designed to guide you through every aspect of the certification, from data modeling and storage solutions to ETL processes and data analysis on AWS. We'll dive deep into key AWS services like S3, Redshift, DynamoDB, and Glue, with hands-on examples and real-world scenarios to solidify your understanding. Whether you're new to AWS or looking to validate your data engineering skills, this course will equip you with the knowledge and confidence to ace the DEA-C01 exam. Don't forget to subscribe and hit the notification bell to stay updated with the latest content!
DISCLAIMER
This course, youtube video, revision/exam guide, and/or slide deck for the AWS Certified Data Engineer certification is intended as a supplementary resource to aid in your preparation for the certification exam. While it is designed to help you identify and address knowledge gaps, it does not guarantee a passing score. Success on the exam depends on your understanding of the material, practical experience, and familiarity with AWS services and best practices. We recommend using this guide alongside other study materials and hands-on practice to enhance your readiness for the certification exam.
😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software
14 окт 2024