Twitter System Design on AWS | Microsoft, Google, Facebook Whiteboarding Interview Question

Подписаться 110 тыс.

Просмотров 21 тыс.

50% 1

Designing Twitter is a common system design interview question. In this video, we will cover features like tweeting, retweeting, timeline, trending. This design needs to be scalable, highly available, and secure.
In addition to the design, this whiteboard architecture is also implemented using AWS services.
VP of Engineering at Twitter Design Talk: www.infoq.com/presentations/T...
Please Subscribe
▶ / @cloudwithraj
*Connect with me*
🤳 Instagram: / cloudwithraj
🏢 LinkedIN: / rajdeep-sa-at-aws
🐦Twitter: / cloudwithraj
🖼 Facebook: / cloudwithraj
👩🎓**My Courses - Comment in video for discount coupons**
Discounted Link for my Kubernetes on EKS course: www.udemy.com/course/rocking-...
Discounted Link for my Serverless Course: www.udemy.com/course/aws-serv...
Discounted Link for my CloudFormation, CDK with Devops, Interview Guide Course: www.udemy.com/course/rocking-...
Timestamps:
0:00 Requirements and features
2:06 Table design
5:36 Twitter timeline design
8:53 Tweet, retweet design
12:34 Database selection
17:21 Edge case and design challenge
19:24 Trending feature design
21:34 Security
#SystemDesignInterview #WhiteboardInterview #AWSArchitecture

Наука

Опубликовано:

30 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 65

@cloudwithraj 2 года назад

My Rocking Systems Design course is out now in Udemy! Limited time discounted link to get the course for $9.99 - www.udemy.com/course/rocking-system-design/?couponCode=LEARNSYSTEMDESIGN

@muratcosar6303 2 года назад

I cant watch it in corporate side of the udemy. is it not available to companies?

@TheElan5 2 года назад

Raj, your videos are incredibly helpful. You are masterful at breaking down complex technical requirements into readily understood concepts. I’ve learned a ton from just a few videos. Thank you for all of your help!

@mattborisov 2 года назад

Amazing episode! Thank you.

@samhunk1227 3 года назад

Thanks ! Excellent understanding .

@kashmorakash4396 3 года назад

Explanation is precise and simple. Please continue with such videos. Thanks for your effor

@cloudwithraj 3 года назад

Thank you Kashmora

@goodnightmr5892 2 года назад

Excellent presentation!

@nilaindeethin1803 Год назад

Raj, this is super simple. Have also bought your course.

@ronnmv 3 года назад

Thanks Raj!! Let it flow....it's amazing how you turn this complex topics in to simple & understandable

@cloudwithraj 3 года назад

Thanks Rony for the kind words 🙏

@ejbjms Год назад

Great videos from you ! I am learning a lot of AWS !! Thanks a lot

@madhivanandurai452 26 дней назад

Good One ..thanks

@idabagusdiazagasatya9900 Год назад

AMAZING

@AliTwaij Год назад

Excellent thankyou

@cantbefooled8044 Год назад

youre like the only channel that makes information so digestible i really appreciate it

@cloudwithraj Год назад

I appreciate that!

@totsubo2000 2 года назад

Great video! When explaining when to generate timelines: "It will only create the timelines for the users who have been active in the last 10 hours". I'm assuming that this reduces the compute strain? But what happens when everyone on the US East Coast wakes up, everyone starts logging and looking at their Twitter feed at roughly the same time? The system is busy creating timelines for millions of users at the same time. How does this solution cope with such a situation? Some content suggestion/request for future videos - Compare/contrasts different way to implement a problems using different AWS technology. So for example so how you would implement something using EC2 vs. using Fargate vs. Lambda and contrast the trade-offs. Same for using Redis vs. Elasticache vs DAX, or using SNS vs. SQS, etc...

@amitparks 3 года назад

Your biggest fan..keep sharing the knowledge 👍 ...More system design please 😁

@cloudwithraj 3 года назад

More to come!

@abhi1ertu 7 месяцев назад

Nice video

@tindisommers3313 2 года назад

Hello Raj, thank you for the video. It was very informative. I am curious though. Is Twitter really using a kind of table as you described for the relationships; where a user's name appears in multiple rows to link that user to his or her followers? I had always assumed some kind of graph database based on what I read on data structures and algorithms.

@zubyranks80 2 года назад

Perfect as usual!

@cloudwithraj 2 года назад

Thank you! Cheers!

@ambikaprasad9464 2 года назад

Appreciate the great knowledge sharing course.

@cloudwithraj 2 года назад

Glad it was helpful!

@babusivaprakasam9846 2 года назад

Brilliant Video. Many Thanks Raj

@cloudwithraj 2 года назад

Glad you liked it!

@machireddyshyamsunder987 3 года назад

Nicely explained Raj , Thank you so much

@cloudwithraj 3 года назад

Thanks Shyam for your support as always 🙏

@nah0221 3 года назад

brilliant as usual .. Thank You!

@cloudwithraj 3 года назад

Thanks again!

@Neelu2023 3 года назад

Thank you. This is very informative. Please do create more such videos. I am great fan of your videos

@cloudwithraj 3 года назад

Thank you, I will Mahesh

@sharathsachin001 3 года назад

Hey Raj Thanks for the awesome video... Smashed the like button as you said😃😃👍

@cloudwithraj 3 года назад

Thanks Sharath for your support as always 🙏

@lguevarae 3 года назад

Hi Raj! excellent video! I have a question about the EC2 and ASG part, what if instead of EC2 we use Step Functions with Lambda and EventBridge? could be an option? I mean having a Step Functions workflow that inserts the tweet on Redis and then to Kinesis. And also, could Redis be replaced with Dynamodb?

@totsubo2000 2 года назад

Hi Luis, Raj mentions in the video that Redis can be replaced by DynamoDB and if the system needs even better performance than plain DDB, you can use DynamoDB Accelerator (DAX)

@agmos01 2 года назад

Great video! TY!

@cloudwithraj 2 года назад

Glad you enjoyed it!

@techsolutions123 3 года назад

For mobile app deployment will need separate two builds ? One for apple other android app store right?

@megabenman 2 года назад

How would the schema look like if you were to use DynamoDB? The keys need to be unique, so you could not have three rows of Tina unless you had some other partition key. Would you have some random-ish hashkey as the partition key and then have the Tina column be a GSI?

@cloudwithraj 2 года назад

Another great comment megabenman. Yes, the table needs to have both partition and sort key to make each record unique.

@ahsanali-gm4ci Год назад

Raj thanks a lot for this video. As far as group messaging is concerned, we will use notification service with one queue. As for grouping message is same for every member so our message will pass by SQS and after SQS we will use a notification to every single group member. Is it right please suggest? Rest of the design would be the same.

@indelible.M. 2 года назад

You are amazing

@cloudwithraj 2 года назад

Ty for the kind words Mesanga

@resham1729 2 года назад

Like ur shirt bru👊

@cloudwithraj 2 года назад

Ty bro!

@mangeshxjoshi 3 года назад

Thank you , excellent video , very well explained , in simple language . really appreciated your video can we have some video on AWS Glue ETL tool ?

@cloudwithraj 3 года назад

Thanks Mangesh, yes planning on doing an AWS Analytics video in near future!

@hemanthgadarla86 11 месяцев назад

We can use any graph db to store followers relationship if not why?

@megabenman 2 года назад

Would API Gateway scale enough to handle twitter-esque scale, or would you need ALB/NLB? The AWS Quotas docs state that AWS Gateway is limited by default to 10,000 RPS, but it can be increased upon request. Still, even at a 10x increase, I'm not sure 100k RPS would be enough.

@cloudwithraj 2 года назад

Great question megabenman! The limits are based on account/region. Beyond raising the limits, you also segregate the APIs on different region/API based on user location. Also CloudFront comes into play to cache certain contents without hitting the backend API. Generally it's a mix of ALB and API Gateway for different APIs. ALBs you can prewarm to handle high spokes for certain events (New Year), but it does cost you more.

@mahmoudsakr3136 3 года назад

Hi Raj, great videos, please continue , I like your content, but question: is iy sql or nosql DB?

@cloudwithraj 3 года назад

Hey Mahmoud, Redis is considered a NoSQL database, however it has limited capabilities to create keys and query using the keys. The primary reason to use Redis is to have really fast read/write ability.

@codewithmubin8866 2 года назад

Can you please make a video on Bandwidth pricing of AWS and other cloud providers?

@Moccar Год назад

Pretty funny you chose Elon Musk as the famous person way prior to him buying the company. Great video btw!

@cloudwithraj Год назад

Thanks Moccar!

@Udayanverma 2 года назад

Question: kms gets overloaded with high number of api calls, they cached it with S3 but how does it happen with other services. What is the throughput and how kms cops up with api calls

@techsolutions123 3 года назад

Thank you , assume full stack code ready, deployment of web twitter.com will be on container s but not server less ? As there's database?

@amolwadekar2554 2 года назад

Why do we do not use EKS or Kubernetes in EC2 before Database rather than use Autoscaling and EC2? It will reduce Cost of Autoscaling and invocation of EC2?