How to Deploy a Docker App to AWS using Elastic Container Service (ECS)

Подписаться 224 тыс.

Просмотров 273 тыс.

50% 1

In this step by step tutorial, I show you how to deploy a Flask based Docker app to AWS. We start by building a local docker image and uploading it to Elastic Container Registry. We create an ECS Cluster, and configure a task to run our docker image. Finally, we launch a Task into the cluster and expose the app to the internet via VPC.
Looking to get hands on experience building on AWS with a REAL project? Check out my course - The AWS Learning Accelerator! courses.beabetterdev.com/cour...
00:10 Example Overview
02:15 Application Walkthrough
04:34 Creating a ECR Repository
05:16 Uploading your Image to ECR
06:28 Creating an ECS Cluster
09:10 Creating a ECS Task Definition
11:35 Running a Task on your Cluster
13:03 Testing our app
Want the docker file used in this video? Check out docker-curriculum.com/ Tutorial (about a third down the page). docker-curriculum.com/
How to install the AWS CLI - • How to install and con...
Source Code + Policy Template - gist.github.com/awssimplified...
🎉SUPPORT BE A BETTER DEV🎉
Become a Patron: / beabetterdev
📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚
Clean Code - amzn.to/37T7xdP
Clean Architecture - amzn.to/3sCEGCe
Head First Design Patterns - amzn.to/37WXAMy
Domain Driver Design - amzn.to/3aWSW2W
Code Complete - amzn.to/3ksQDrB
The Pragmatic Programmer - amzn.to/3uH4kaQ
Algorithms - amzn.to/3syvyP5
Working Effectively with Legacy Code - amzn.to/3kvMza7
Refactoring - amzn.to/3r6FQ8U
🎙 MY RECORDING EQUIPMENT 🎙
Shure SM58 Microphone - amzn.to/3r5Hrf9
Behringer UM2 Audio Interface - amzn.to/2MuEllM
XLR Cable - amzn.to/3uGyZFx
Acoustic Sound Absorbing Foam Panels - amzn.to/3ktIrY6
Desk Microphone Mount - amzn.to/3qXMVIO
Logitech C920s Webcam - amzn.to/303zGu9
Fujilm XS10 Camera - amzn.to/3uGa30E
Fujifilm XF 35mm F2 Lens - amzn.to/3rentPe
Neewer 2 Piece Studio Lights - amzn.to/3uyoa8p
💻 MY DESKTOP EQUIPMENT 💻
Dell 34 inch Ultrawide Monitor - amzn.to/2NJwph6
Autonomous ErgoChair 2 - bit.ly/2YzomEm
Autonomous SmartDesk 2 Standing Desk - bit.ly/2YzomEm
MX Master 3 Productivity Mouse - amzn.to/3aYwKVZ
Das Keyboard Prime 13 MX Brown Mechanical- amzn.to/3uH6VBF
Veikk A15 Drawing Tablet - amzn.to/3uBRWsN
📚 References:
Getting started with AWS: • Introduction to AWS | ...
☁Topics covered include:
Docker
Flask App
Elastic Container Registry
Elastic Container Service
🌎 Find me here:
Twitter - / beabetterdevv
Instagram - / beabetterdevv
Patreon - Donations help fund additional content - / beabetterdev
#SoftwareEngineer
#SoftwareDeveloper
#ElasticContainerService
#AWS

Опубликовано:

21 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 237

@AlexeyYanovski 3 года назад

For anyone getting this error: CannotStartContainerError: Error response from daemon: OCI runtime create failed: container_linux.go:370: starting container process caused: process_linux.go:338: getting the final child's pid from pipe caused: read init-p: connection reset by peer: unkno The cause is there's not enough memory assigned for your Task. If you followed along to the video, in task definition, change memory from 1 to 512 and CPU to 512 as well. Hope it helps

@BeABetterDev 3 года назад

Thanks for pointing this out Alexey! I've had a few folks comment on this same issue and wasn't sure of the reason. Glad you were able to figure this out and share with others. I'm going to pin this to the top so others can benefit. Cheers!

@xuebosun766 3 года назад

It doesn't work for me.

@xuebosun766 3 года назад

I am using GitLab Container registry. ARN seems not working as well.

@xuebosun766 3 года назад

GitLab returned an error "unauthorized: HTTP Basic: Access denied You must use a personal access token with 'api' scope for Git over HTTP. You ca". Not sure how to set GitLab personal access token in AWS secret used for ARN.

@xuebosun766 3 года назад

I just made it work. I need personal access token as password. :)

@daCorasla Год назад

Thanks for this awesome tutorial! For anyone actually trying to deploy some kind of code that needs to be built on the machine, please take EXTRA care in making sure that the instance type has more than enough memory to actually build the app and start it properly. Figured this out only after ssh-ing into the EC2 container and interactively running commands on the docker image to try and manually build the project

@go_better 2 года назад

Man! I wanna hug you! I suffered for about a month through bullshitery guides from amazon on how to do it! But you explained it so simply! Now I will need to make a pipeline with autodeploy. I hope you'll have videos on that topic. THANK YOU once again for such clear explanation.

@BeABetterDev 2 года назад

You're very welcome !!!

@7enso 3 года назад

This was amazing, I've ben looking for this exact kind of tutorial for ages and it really cuts through the verbose aws documentation! Thank you so much!

@BeABetterDev 3 года назад

Glad it helped!

@miguelchiquin9354 3 года назад

You saved my day! Thanks. Specially when you showed that the public IP wasn't accesible because of the default security group that the instance had attached.

@BeABetterDev 3 года назад

Glad I could help!

@ngneerin 3 года назад

Have been looking for such a tutorial since two months now

@BeABetterDev 3 года назад

Glad you enjoyed!

@juandiegoescobarlondono6095 2 года назад

Thank you so much, I have a container enabled on port 9000 but didn't know why it wasn't working, this is a life saver. Thanks again.

@BeABetterDev 2 года назад

You're very welcome Juan!

@fichthammerli7413 3 года назад

straight forward and quick, thank you!

@isragaytanmistico 2 года назад

Love your video!! Thanks!!..quick and easy !...with no garbage! God Bless you! You won one subscriber!

@BeABetterDev 2 года назад

Thanks so much Israel and welcome to the channel!

@rajanagori3166 3 года назад

Thank you so much saviour you made my task like flawless. huge respect

@Billbillbillhahagdvdve Год назад

Great video - really helps with understanding ECR, ECS and EC2. 😀

@cmlaio8119 2 года назад

Thank you for the video, I was about to give up trying to run a container from a Docker image because I could not understand Amazon's documentation. This video was incredibly helpful.

@BeABetterDev 2 года назад

Glad I could help!

@DarkMatter-zk3bo Год назад

This is a great tutorial! Thank you very much. It'll be great to see this being done using a CI/CD pipeline!

@andremazetto 2 года назад

How could one figure all this out without this tutorial... the amount of steps are insane and the AWS CLI is so not intuitive! thanks for demystifying it for us

@BeABetterDev 2 года назад

Thanks so much ad ma! I feel your pain - doing this the first time I almost wanted to rip my hair out :P

@enricosaccheggiani3192 2 года назад

Great video Thanks a lot. I tryed many times to do this but only with your video I solved the problem very very great thanks

@bijayaadhikari442 3 года назад

Thank you for the consistence aws videos.

@BeABetterDev 3 года назад

You're very welcome!

@viniciusvendramelgalhiardi6067 3 года назад

Man, congrats!!! This video helped me a lot! Very nice!!

@BeABetterDev 3 года назад

Thanks Vinicius! Glad you found it helpful.

@1982sridhar 3 года назад

Thanks lot for your wonderful videos .. content are sharp and crisp

@BeABetterDev 3 года назад

Thanks Sridhar!

@darrenklein6090 3 года назад

Thanks for this helpful tutorial, it got me up and running! However, one issue that I ran into was trying to run multiple clusters (one for a staging release of my app, one for production) - I found that if I put both clusters on the same subnet, the second cluster wouldn't start an EC2 instance; putting them on different subnets resolved that. This is my first foray into AWS and I have about zero experience with networking, so maybe that's totally expected and normal - but if you're like me and you're just starting to learn your way around, maybe this'll be helpful for you.

@BeABetterDev 3 года назад

Hi Darren, I can't say I've personally experienced this issue but thank you for sharing your knowledge! I'll keep this in mind next time I set up ECS. Cheers!

@rahulbadiger940 3 года назад

Well explained, thanks for good tutorials.

@BeABetterDev 3 года назад

Glad you like them!

@MikeDolar1 3 года назад

You make it seem easy, thank you

@BeABetterDev 3 года назад

Only after hours of struggles ;)

@ChanceMinus Год назад

Thank you. Extremely helpful info.

@dmitrydukhovny6567 3 года назад

thanks man, great tutorial !

@BeABetterDev 3 года назад

Glad you liked it!

@ramirez368 11 месяцев назад

Super nice....thanks, vey useful, especially the task definition part.

@severtone263 5 месяцев назад

Thanks for this awesome overview

@eplurp 3 года назад

Precise and on point. Thank you.

@BeABetterDev 3 года назад

Glad it was helpful!

@pathurleyuk Год назад

Great tutorial, thank you.

@viniciusalvess Год назад

The video was very helpful. Thanks for sharing such a great content. But it is confusing the part you call the image and the repository 'test', having them with the same name makes the watcher confused if they are using other names.

@eamonkelly215 2 года назад

Thanks for this it was exactly what I was looking for to learn about ECS. Great tutorial!

@BeABetterDev 2 года назад

Very welcome.

@jacques-dev 3 года назад

How would we go about connecting the flask app to a db like mongodb with persistent storage?

@carlossouza5151 2 года назад

you are a life saver! thanks!

@BeABetterDev 2 года назад

Happy to help Carlos!

@shakeddotan4299 3 года назад

Thanks a lot, great video, great explaining

@BeABetterDev 3 года назад

Glad it was helpful!

@althrunsun Год назад

wonderful tutorial!!!!!!

@YannMjl 4 месяца назад

Thank you for sharing. This is was greatly done, straightforward and so much easy to understand. Thinking on the monitoring, What are some things that you'd recommend to be monitored for apps running on ECS, whether it's setup using EC2 or Fargate?

@vishwajeetohal9137 Год назад

The cat gifs make everything worth it

@BeABetterDev Год назад

Haha I agree!

@arpankhetani7818 Год назад

Thank you Sir Very much for your guidance

@sureshd7685 3 года назад

Thanks a lot. Nice tutorial.

@BeABetterDev 3 года назад

Glad it was helpful!

@MrKelebras 2 года назад

Part about VPC very helpt, thank you very very much!

@BeABetterDev 2 года назад

Glad it was helpful!

@ruixue6955 Год назад

1:30 *task* 3:33 *login to ECR* 4:18 create repository in ECR 4:46 upload the built image onto ECR repo 4:52 tag image: docker tag 5:17 push 6:24 create a cluster

@enricosaccheggiani3192 2 года назад

The Flask application works without any problem . Thanks a lot for this important example.then I have tried to deploy a django application on a ecs container following your instructions. I am afraid that the T2micro is too small to load a imagine of 1.24 Gb .

@hermiloalexanderfebresbarr1911 3 года назад

how'd be the process for a multi container application ?

@shivujagga 2 года назад

Thank you for this !

@BeABetterDev 2 года назад

You're very welcome!

@AlbertSuwandhi 3 года назад

Nice and simple as always. I don't see the Dockerfile dan Python code on the Gist. Please advice.

@barrypun6979 3 года назад

Great this tutorial worked for me! Question in mind tho, do i need to change SG and network mode when deploying to ElasticIp and Route53?

@BeABetterDev 3 года назад

Great to hear Barry! In order to make your instance publicly accessible, you would need to make your instance able to receive traffic from the public internet (inbound rule with 0.0.0.0/0). Hope this helps.

@reinaldogomes8666 2 года назад

very helpful. do you have any videos showing how to deploy images on ecs from local docker CLI? I'm getting this error: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

@maoryahalomi-work1869 3 года назад

Great one Thanks!

@BeABetterDev 3 года назад

You're very welcome Maor!

@williamtrombly284 Год назад

Awesome!

@shanmukhasarathkondiparthi8155 Год назад

Great intro for me

@runtcpip-morganlucas 2 года назад

Nice and helpful - around 7:46, I get an error at this step saying ' For container instances to receive the new ARN and resource ID format, the root user needs to opt in for the container instance IAM role. Opt in and try again. I made the role, but it doesn't show up in the drop down, and I can't find where to attach it to root. Any one have an idea?

@cassiojp 3 года назад

Thank you man!

@BeABetterDev 3 года назад

Happy to help!

@veenak108 3 года назад

Great Video Thanks! Quick question... Is this video a part of some series ..I would like to know how/what docker files are.

@BeABetterDev 3 года назад

Hi Veens! This video was meant to be a standalone one, however I do have a video explaining what Docker is. Check it out here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-oyD5yIEAeoA.html Cheers

@user-ee9jz4jy5g 2 года назад

Hi great video. I followed this along but got stuck where the task was pending status. Can you show me how you fixed it exactly? I was following exactly what you were doing.. I don’t know what typo you made.. is that container name ?

@erics.samuel9582 3 года назад

Good job man.

@BeABetterDev 3 года назад

Thanks eric!

@kalyankalapala8940 3 года назад

how to deploy multiple docker containers on a single ec2 instance with the load balancer and assign a custom route 53 dns to it. Please help to sort it out

@miguelgarzonnaranjo2858 3 года назад

Thaks! nice video!!!

@mikecmw8492 2 года назад

Do you have a video that shows how to add --env to the docker run command? I need to do this although we use terraform to actually provision the fargate container. Maybe terraform adds those env vars?

@BeABetterDev 2 года назад

Hey Mike, Unfortunately I've never done this with Terraform before. However I found this link that you may find helpful: stackoverflow.com/a/40784106/13872863 Thanks, Daniel

@sebastianmocanu9423 2 года назад

Thanks mate!!!

@BeABetterDev 2 года назад

You're very welcome Sebastian!

@mohamedyoussef8835 Год назад

Awesome video ++++++++++++ 🙂

@user-re7tb3vy5l 2 года назад

4:10 If you cannot login, you need to allow access for "AWSAppRunnerServicePolicyForECRAccess" at AWS IAM console. I watched AWS CLI tutorial, but I struggled because I didn't know about "AWSAppRunnerServicePolicyForECRAccess".

@user-re7tb3vy5l 2 года назад

also, I allowed access for "EC2InstanceProfileForImageBuilderECRContainerBuilds". I'm not sure which is necessary to login.

@shakakruft5227 3 года назад

How did you end up fixing the issue with image uri being incorrect format?

@morpheus7422 2 года назад

Mahnn, you was dishing out the info hitting me like arrows, had a take nap to recover from the information overload.

@BeABetterDev 2 года назад

Haha I hope it was useful!

@Dude-iz2dw 3 года назад

thanks man!

@BeABetterDev 3 года назад

You bet!

@kuronoalien1511 2 года назад

Is there a way you can do it as an auto deploy to EC2?

@JIGNESHPATEL-qk4yg 2 года назад

nice, thanks!

@BeABetterDev 2 года назад

You're very welcome!

@fxx3702 2 года назад

Hi, what was the mistake you defined the task definition? I dont know what you mean by the wrong url. The wrong url of the registry/image? I copied pasted that. Please help. Not sure whats wrong

@kdeng7 Год назад

Thank you for the great tutorial! Based my observation and the time of this video, I guess you were using an Intel Mac? For anyone also on M1 chip Mac: I use Apple M1 chip Mac and it creates ARM64 image by default. It’s not runnable on EC2 t3.micro instance. If you still want to run the an ARM64 image with EC2, you’ll need to select instances powered by Graviton, for example t4g.micro, which can run ARM64 workload. OR you need to run `docker buildx build` to build an amd64 image at the beginning.

@aryanagrawal8096 Год назад

luv it

@BeABetterDev Год назад

Thanks!

@mariomolinar4606 2 года назад

Does this tutorial works if I try to deploy a SB application with MySQL using docker compose?

@umairw235 2 года назад

thank you very much

@BeABetterDev 2 года назад

You're very welcome!

@interesting917 2 года назад

Thank you!

@BeABetterDev 2 года назад

You're very welcome!

@samtx 2 года назад

Tasks are similar to deployment in k8s Load balancer target group?

@t3coding732 2 года назад

Great tutorial, I have a question. I have a similar set-up and wonder if there is any way to handle clients loosing connection each time you make a deployement? E.g every time I deploy the users that were authenticated and signed in to the site gets kicked out since the container with redis gets cleared

@BeABetterDev 2 года назад

Hi Tolga, this is an interesting problem. Is it possible your Redis instances can dump state onto disk so the caches can be recovered on startup? Else, you may want to use the dedicated AWS ElasticCache service with Redis. Hope this helps

@t3coding732 2 года назад

@@BeABetterDev Hmm that could be possible, I will have to look into it. Thanks for the tip!

@yekohein1528 2 года назад

Thanks a lot.

@BeABetterDev 2 года назад

You're very welcome!

@gilcd85 3 года назад

Great tutorial! Thank you!

@BeABetterDev 3 года назад

You're very welcome!

@scoop13186 3 года назад

I’m guessing that using a nginx proxy would be declared within the task definition?

@rishiraj2548 Год назад

Thanks

@B1TCH35K1LL3R 3 года назад

Hey man! Excellent tutorial. However, I am struggling when trying to use a private image (stored in ECR). Documentation is a bit confusing and I cannot seem to find aby good resource for dealing with that. Wondering if you or someone else might help ? Thanks

@BeABetterDev 3 года назад

Hi Farid. I haven't dealt with this personally. Can you share what kind of error your are running into? I may be able to help.

@B1TCH35K1LL3R 3 года назад

@@BeABetterDev thanks. it looks like if you are using private ECR images when setting up your containers on ECS (and the ECR image is from the same AWS account), no additional setup is needed for ECS to function properly, yet your Docker image is still private. sweet!

@patricioceron5251 3 года назад

there is a way to do the same, but with docker compose?

@tudoranastasiu770 Год назад

At 10:54 the port mapping in the user interface has both a container port and a host port, however when I look at my console there is no host port. I can no longer map the container port 5000 to port 8888. How should you go about that now?

@zhdan5887 3 года назад

if i wanna use fargate, should i choose everywhere fargate option instead of ec2? I mean cluster template : networking only 6:32 task : fargate 9:17 run task : fargate 11:44

@BeABetterDev 3 года назад

Hi Zhdan, To ensure compatibility (and not run into any headaches / configuration problems), I would definitely suggest clicking the fargate option. Cheers

@learner8084 Год назад

If I use fargate, does it mean I don't need to define any EC2/ECS ? Thanks.

@pikaa-si9ie 4 месяца назад

Hello. what if i have a database that i want run in a docker container but don't want it to scale? Do i put in in a separate cluster with 1 desire & maximum capacity?

@superswitchbros9245 Год назад

What did you change at 12.33 to make your task run

@nishantnarsale6279 2 года назад

Can anyone tell how to update the changes in our code to aws repo after deployment

@PeterSaumur 9 месяцев назад

What was the policy document for? I didn't need to use it ... ?

@daabakedpotato 3 года назад

Just want to give a heads up to anyone running a react container and have issues with your task exiting after starting. The error I'm talking about it "essential container in task exited". If you are facing this issue you need to turn on the pseudoTerminal within your task so it doesn't exit immediately while react is starting up. 1. Find your task and click "create new revision" 2. Scroll all the way down until you see "volumes" and click "Configure via JSON" 3. Find "pseudoTerminal" and set the value to "true" 4. Assign the task again and everything should be working fine now

@zachkurdi3178 3 года назад

thank you for this i had this problem and i tried the solution but it still exists even after modifying the json file edit: i created another revision with 512mb and that seems to work

@piyushpandey4042 3 года назад

Thank you It worked! Can you pls explain why this happened?

@mubashirali6202 2 года назад

Hi, i have the same error on the running task.

@shreyb1409 2 года назад

I have a doubt here, what is the need to create a service when a task can do the work just fine? thanks in advance.

@dingding4898 2 года назад

Cannot access the app using Public IPV4 DNS of my EC2 instance. I tried deploying a streamlit and a flask app.

@alchemication Год назад

Tutorial also works for running serverless Fargate tasks (at least in Nov'22 🙂).

@aditmodi 3 года назад

where can i get your docker-file and flask-app, I would like to follow along with your application.

@BeABetterDev 3 года назад

Hi Adit, check out the description section of the video - the docker file was from a tutorial on the official Docker documentation.

@TheGeekJourney 3 года назад

How about Docker Hub registry?

@lifeatrailway Год назад

i am getting this error Stopped reason Essential container in task exited. Do u know about this error.

@scigama71 3 года назад

Excellent..Thank you. How much do you think it would cost for the application you wrote to run on ecs for a month?

@BeABetterDev 3 года назад

Hi James, if you use this guide the costs zero. Be sure to use the Free Tier eligible EC2 instances (provided that fits your use case) and you can try this out with minimal costs. Also, be sure that your docker image is below 500mb in size so that you can stay in the free tier. Hope this helps, Daniel

@himeshkoli8607 Год назад

@@BeABetterDev hey if image size exceeds 500 mb is there any workaround to still deploy it under free tier, like resize image, etc

@djohnworthy1040 Год назад

In the new UI we can't select a host port. How can I make it like 8888:5000?

@NosurfOfficial Год назад

Can you please share the flask/python code so we can completely follow along? That's be super helpful.

@mohammedhashmi1384 2 года назад

Where can I get the flask app code

@karanpatil706 3 года назад

How to get static IP for aws ecs

@XpanderTN 2 года назад

You sir are a lifesaver! I've been trying to figure this out for a week. I do have a question. I created the ECS cluster but i don't see any ECS instances, even though i have an image pushed to ECR. Any idea what i'm missing?

@krishnans1665 2 года назад

Hey...same here. Do let me know if you find a solution.

@XpanderTN 2 года назад

@@krishnans1665 I ended up deleting the cluster and then recreating it. I think the only thing i did differently was add a different VPC and then followed the video from there. It showed up this time.

@mathematica7 2 года назад

@@XpanderTN Weird, I had the same problem, I deleted the cluster and did exactly the same setup (not change in VPC) and now the instance shows up. 😕

@XpanderTN 2 года назад

@@mathematica7 Super weird. I wonder what determines if the cluster is able to see the instance? They were both valid ec2 instances and i built the first one from the cluster creation screen.