Amazon S3 Event Notifications with Amazon EventBridge - Step By Step Tutorial

Подписаться 18 тыс.

Просмотров 15 тыс.

50% 1

This is a step-by-step video on how to configure an S3 event notification with EventBridge with the destination being SNS. This video will walk through how to configure your S3 Bucket, SNS Topic, and Event Bridge rule to achieve this. At the end of this video, I cover how to write to an SNS topic from event bridge when your topic is encrypted.
#eventbridge
#aws
Resources:
useful tutorial guide: aws.amazon.com/blogs/aws/new-...

Опубликовано:

7 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 32

@top-notch-tech 2 года назад

Top quality content. Keep up the great work! This is exactly what i was looking for. Your channel will blow up soon with new subscribers.

@DataEngUncomplicated 2 года назад

Thanks for your kind words! I really appreciate it!

@hoijongjung3929 2 года назад

very practical content! thanks a ton!

@DataEngUncomplicated 2 года назад

You're welcome Hoijong! Thank for leaving me a comment, I appreciate the feedback.

@sany2k8 2 года назад

Keep up the great hand's on example. Quality content

@DataEngUncomplicated 2 года назад

Thank you for the feedback!

@VamsiKrishna-vf5gm Год назад

Thanks a lot for the video... Really appreciate your efforts!!!

@DataEngUncomplicated Год назад

Thanks Vamsi!

@sany2k8 2 года назад

Subscribed. Keep continue on aws and data engineering hands on tutorials.

@DataEngUncomplicated 2 года назад

Thanks for subscribing Sany, Yes! A ton more aws and data engineering tutorials are in the pipeline!

@sany2k8 2 года назад

@@DataEngUncomplicated sounds awesome 😎

@breakdancerQ Год назад

Thanks dude this led me to achieve what I needed to do

@DataEngUncomplicated Год назад

I'm glad it helped!

@gayathrichakravarthy1056 Год назад

Great intro tutorial. Can I filter by a filename instead of a prefix / suffix? We get multiple files dropped in the same bucket so filtering on a name is what would make EventBridge attractive. Thanks

@madhurmishra7110 Год назад

I am trying to do the same thing but the file which i am trying to track is uploaded into a dynamically named folder with name as current date . Do you habe any suggestions how can i track its upload or creation. Also the filename have a predefined prefix . Lets assume xyz_ how to configure it in an event trigger. if you can help me out thay will be great

@adventuresofa9jaguy322 Год назад

the s3 stuff has now been updated. you do not need to manually copy it now, it auto updates bucket name under event pattern but without the key and prefix. ill check if it works well though

@DataEngUncomplicated Год назад

Thanks for leaving a comment about this update! The process is always changing.

@adventuresofa9jaguy322 Год назад

@@DataEngUncomplicated it sure it! Can you do one with Sqs dead letter queue and event bridge triggered by a lambda function?

@skiphanson5020 Год назад

Hello. Where did the "key" and "prefix" come from when editing the Event pattern?

@DataEngUncomplicated Год назад

Hello, it comes from your aws s3 bucket for the directory/object you are interested in being the trigger

@skiphanson5020 Год назад

@@DataEngUncomplicated Thank you. If you wanted the trigger on the whole bucket would the prefix be the bucket name itself?

@skiphanson5020 Год назад

I see. No prefix if using the bucket itself.

@shishirborkar-ho6gq Год назад

do you have terraform scripts to perform this same operation? How to perform this using Terraform script ? Please help

@DataEngUncomplicated Год назад

Unfortunately I don't, I have been using terraform recently and was thinking of making some aws terraform videos in the future.

@osamabinsaleem6596 2 года назад

its not working when I choose step functions as a target. Nothing happens , I can not see any invocation on the eventbridge rule side as well

@DataEngUncomplicated 2 года назад

Hi Osama, I would check cloud watch insights to see if there was a failed invocation, most likely there is a permission missing somewhere which may be the cause of the issue of nothing happening.

@saishashank655 2 года назад

How can we get alert if the bucket size reaches certain bytes Ex: If my bucket size reaches or exceeds 5TB then i should get an alert. Can you please help me in this.

@DataEngUncomplicated 2 года назад

Hi Sai, sorry I don't know the answer to this. I figure you could look into cloudwatch events or eventbridge to set up some notification event with your specific criteria.

@saishashank655 2 года назад

@@DataEngUncomplicated Yes in event bridge we don't have any specific option that tracks/ collects the size of the bucket.

@DataEngUncomplicated 2 года назад

Maybe this is a good question for the aws community: repost.aws/

@datag1199 Год назад

Fantastic tutorial. Thank you. Great introduction. Subscribed. Edit: this worked. However, the SNS sent the notification to another email. I have an email separate for AWS testing, which is what I added to the setup for this tutorial, but it sent it to my personal email. There must be some configuration in my account that allowed that to happen.

@DataEngUncomplicated Год назад

Thanks for subscribing! You must have subscribed to the topic on your personal account. That's the only way it would know to email that address.