Тёмный

System Design Interview - Rate Limiting (local and distributed) 

System Design Interview
Подписаться 101 тыс.
Просмотров 290 тыс.
50% 1

Please check out my other video courses here: www.systemdesignthinking.com
Topics mentioned in the video:
- Token bucket algorithm.
- Object-oriented design of the rate limiting solution.
- Load balancer max connections, auto-scaling.
- Message broadcasting: full mesh network topology, gossip communication, distributed cache, coordination service.
- Communication protocols: TCP, UDP.
- Embedded rate limiter vs daemon process.
- Bucket management, synchronization.
Inspired by the following interview questions:
Amazon (www.careercup.com/question?id...)
Google (www.careercup.com/question?id..., www.careercup.com/question?id...)
Uber (leetcode.com/discuss/intervie...)

Наука

Опубликовано:

 

10 апр 2019

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 423   
@DavidSuarez09
@DavidSuarez09 5 лет назад
This is an extremely thorough answer with interviewer gotcha's and system tradeoffs. Exactly the type of videos needed for us engineers. Thank you so much! Keep up the excellent work! Subscribed!
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Appreciate your feedback, David! Words like these inspire further endeavor.
@hangnm81
@hangnm81 5 лет назад
Just landed my SD2 job at Amazon. Thank you so much. Your channel is really helpful
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Congratulations, Hannah! Really glad for you!
@nammi895
@nammi895 4 месяца назад
Still working at amazon, promoted to SDE 3 or not ?
@mostinho7
@mostinho7 Год назад
4:00 why a rate limiter needs to be designed as a distributed system and not just for a single host 11:00 algorithm for deciding wether to accept or reject req, token bucket algorithm keeps a bucket of tokens for each unique client, and has a re-fill rate. When client makes a req we check if it has tokens remaining, if not reject 14:50 classes and interfaces oop 17:00 rate limiter across different hosts in a cluster 18:30 how token buckets communicate each just says how much they’ve used so far and the others can sum and make decision
@GunjanSharma-iw6ou
@GunjanSharma-iw6ou 2 года назад
This is the most detailed, thorough and informative video I have seen so far in system design series across all the channels. Glad I came across it. Please keep making videos. Subscribed!
@ShubhamJain-ch7et
@ShubhamJain-ch7et 3 года назад
This is really thorough and truly mirrors the way system at scale are architected in companies. The best set of videos on system design out there. Please continue making more of these :). Mom's favorite flower part was really funny. I can totally relate to this. Selling your platforms to different teams in your company is already super hard, never complicate it further by telling them to add a service client :D
@singhalvikash
@singhalvikash 3 года назад
The best System Design explanation on Rate limiter I have found so far . Kudos to you.
@fokkor
@fokkor 5 лет назад
Probably one of the best videos in system design! You're an awesome instructor! I like the the presentation through animation and thoroughness of your videos. This is how in real world interviews are conducted.
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Thank you, Rajarshi. Appreciate your feedback!
@vishnusingh4121
@vishnusingh4121 3 года назад
By faaaaar the BEST VIDEO and EXPLANATION in this topic! He even has code implementations!! That was super helpful. Thanks a million!
@muskanroxx22
@muskanroxx22 2 года назад
I am a beginner in System Design and I totally loved this video. I have a MSFT interview this week and I couldn't be more grateful! :)
@zhongyanyuan8421
@zhongyanyuan8421 3 года назад
I'm working on some rate limiting stuff now. Although my task is no so complicated as your video topics, it really helped me build up basic concepts. Thanks!
@howellPan
@howellPan 5 лет назад
I had to watch it second time around to appreciate the detail and thoroughness. Great work, thanks.
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Thank you Howell for the feedback and all your other comments! Working on answers to those.
@integralCalculus
@integralCalculus 5 лет назад
Truly amazing amount of details covered. Very coherent and organized content. Keep up the excellent work!
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Thank you for the feedback, @integralCalculus!
@boqunzhang8045
@boqunzhang8045 2 года назад
Best system design interview I have ever watched. Short, clean, and thorough. Subscribed!
@secondsandthings
@secondsandthings 5 лет назад
This is the best video style I've seen on System Design interviews because it's also educational and covers lots of useful concepts for engineers.
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Thank you for the feedback, @secondsandthings! Glad you liked the content.
@babylife8342
@babylife8342 3 года назад
This is the best system design youtube channel. Thank you so much for sharing your knowledge generously!
@prakritidevverma4315
@prakritidevverma4315 3 года назад
Oh my God, you are so good at this. I don't think anyone on RU-vid is providing this much of quality content.
@roshrajthoppilan
@roshrajthoppilan 2 года назад
What happened to this channel ? This is the best content out there for System Design Interviews , why did they stop making videos ?
@VivekSundararajan
@VivekSundararajan 2 месяца назад
paid version on his website.
@BobbyDigMOB
@BobbyDigMOB Месяц назад
His content is the system design crash course on Leetcode
@gxbambu
@gxbambu 3 года назад
the best system design channel I've ever found on internet! Bravo!
@MrSatishkumarchakka
@MrSatishkumarchakka 4 года назад
This is the best series on system design I found on youtube. Excellent presentation. Really appreciate the genuine intentions to share your knowledge. Keep up the excellent work.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thanks a lot, Satish, for the feedback!
@waiyonglow7354
@waiyonglow7354 4 года назад
After looking through multiple resources to refresh my memory on distributed system design, your channel contains hands down the most thorough and educational content - easily rivaling university level courses I've taken on similar topics. I've never written a RU-vid comment in my life, but I felt compelled to do so after watching your videos. Thank you for your excellent work.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Wow! That was...awesome. Thanks a lot for the detailed feedback!
@jaewonlee76
@jaewonlee76 3 года назад
This is the best channel for system design interviews. I watched all videos a week before my onsite interviews and got 4 offers from 4 interviews.
@zhengwenzhou6188
@zhengwenzhou6188 4 года назад
What an AMAZING channel! All videos are super helpful and detailed. Thank you Mikhail. Keep posting more videos and materials!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you, Zhengwen, for the kind words!
@yueliang171
@yueliang171 4 года назад
This is awesome! Best and most comprehensive one I can find on RU-vid. Keep up the great work! Looking forward to more videos!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Glad you liked! And thank you for all your comments, Yue Liang. Appreciate your feedback!
@himani1349
@himani1349 3 года назад
Your videos are really helpful, probably one of the best resources on the internet. Please make more system design videos around instagram, news feed, WhatsApp, Netflix, google docs etc.
@feirao9027
@feirao9027 4 года назад
As a new architecture, I think this channel is VERY HELPFUL starting point for me, with all key points.It is useful not only for interviews. I'm looking forward to more patterns explained. Thanks a lot man!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
My pleasure!
@yuegu2526
@yuegu2526 4 года назад
I have to say this is a really awesome system design video, good content, good pictures. Like it so much, please upload more!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you, Yue, for the feedback. Much appreciated! More videos to come.
@zustaz
@zustaz 2 года назад
Thanks for covering the most interesting and difficult topics on you channel!
@karthikeyankrishnamoorthy5540
@karthikeyankrishnamoorthy5540 4 года назад
I admire the deep knowledge that you possess in system design. Your videos are elegant and thorough - simply great! Thanks a lot for sharing the knowledge! Keep sharing!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you for the kind words, Karthikeyan!
@kommisettyveerendranath53
@kommisettyveerendranath53 Год назад
One of the best and finest content with simple examples. Your way of explanation and content coverage is really amazing. Thank you very much for explaining such valuable concepts in this video.
@neilteng1735
@neilteng1735 3 года назад
Most resourceful and deep system design video on the Internet.
@kapilgupta8543
@kapilgupta8543 3 года назад
So organised, structured, through video seen ever on system design. At any point I expect that would be good if next section explains this thing, and in I see it's there. Felt like it reads mind. :)
@DarkKnight-tt7sz
@DarkKnight-tt7sz 4 года назад
Of all the videos on system design I have seen, this is by far the best! Please keep making these videos.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you, Dark Knight, for the kind words!
@TheRohkan
@TheRohkan 3 года назад
We need more videos :) this is the best channel for in-depth system design interview prep after scouring the tube
@perpetualcurious4425
@perpetualcurious4425 2 года назад
This is the first video I watched on your channel and you earned a subscriber. Thanks for making it so simple.
@siweizhu7559
@siweizhu7559 4 года назад
best system design lessons I have seen so far!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thanks!
@curiossoul
@curiossoul 2 года назад
My Lord, I am spellbound by the breadth and depth of various aspects of a design. I just completed reading same design in a very popular design book and it was nothing compared to this. Truly loved it Can't believe such precious stuff is free when it can be 5 star content on udemy. Big thanks and looking forward to more videos 🙏
@sureshiva4605
@sureshiva4605 10 месяцев назад
Whats the book name..
@djBC10000
@djBC10000 4 года назад
I automatically like the video before watching it because I know it will be of high quality. Thanks again for doing this.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you a lot for the kind words, bc10000!
@santoshbhatnagar2155
@santoshbhatnagar2155 11 месяцев назад
Hey, really love the depth in which you cover in the videos, please make some new videos as well. Looking forward for them
@vedprakash-bw2ms
@vedprakash-bw2ms 4 года назад
Thank you for such detailed explanation. I am just starting in system design journey and its the best I have seen so far.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Glad it was helpful! Let me know if you have any questions on this or any other video on the channel.
@loojnow
@loojnow 3 года назад
Amazing content! Really appreciate the English subtitles. Keep up the good work!
@monishchhadwa777
@monishchhadwa777 5 месяцев назад
A rate limiting concept cannot be explained better than this! Great job sir!
@user-uskxnfiw729
@user-uskxnfiw729 4 года назад
Very informative and educational! Exceptional quality as well. Thank you. I subscribed this channel with the hope you will produce more technical videos like this.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thanks a lot for the feedback, tillnothingleft! Working on a new video right now.
@kiransriramula
@kiransriramula Год назад
You are really amazing. Thanks for making such a high quality video. Cant believe that you explained all these in 30 mins :)
@im5DII
@im5DII 3 года назад
I felt tired and boring about learning these CS knowledge these days. But after watching diagram with clear explanation here, curiosity comes back to me and now I felt "wow easy and interesting"
@shaleenchauhan1618
@shaleenchauhan1618 4 года назад
Simple and thorough explanation. Amazing work. Thanks a lot!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you for the feedback, Shaleen! Glad you liked the video!
@guanpenggao1463
@guanpenggao1463 3 года назад
oh man, this is a really good in depth discussion, love this channel
@RaviNagubandi
@RaviNagubandi 4 года назад
One of the best for System Design preparation. Came across lot of new concepts which I'm not aware of. Keep coming!!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Glad I could help! Thank you for the feedback, Ravi!
@RR8401674
@RR8401674 5 лет назад
Very nice. Please upload more videos. You put together this very nice and I appreciate your time.
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Thank you for the feedback! More videos to come.
@KacyCodes
@KacyCodes 2 года назад
This is so well put together. Absolute legend.
@youngbay6315
@youngbay6315 4 года назад
Best system design channel. Will recommend to all my friends
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you, Yang. I feel like I have the best subscribers ever.
@muthukumarankothandaraman2371
@muthukumarankothandaraman2371 3 года назад
23:04 and there's one more elephant in the room!! This man's presentation is highly enjoyable - whatever one runs into in practical system-design problems, this man speaks of it 👌👌👌👌
@mohitsamarth
@mohitsamarth 2 года назад
Wish we had more of your videos on these topics! I dont mind paying for such quality content :)
@raghavendraprasad1963
@raghavendraprasad1963 6 месяцев назад
Excellent video covering all corner cases related to Rate Limiting system design.. Much Appreciated !!
@nadezhda-r
@nadezhda-r 3 года назад
Thank you! This explanation is exactly what I was looking for.
@andreyvalverde4780
@andreyvalverde4780 2 года назад
Please make more videos like this! This is great content!
@shr_q
@shr_q 2 года назад
Excellent explanation! Thank you so much for doing this. Wish I had discovered this sooner.
@shashankx
@shashankx 2 года назад
dude, you rock! I haven't seen better videos which are so concise and accurate!
@iitgupta2010
@iitgupta2010 5 лет назад
what a master piece man .. awesome .. really loved it.
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Thank you, Nitin! Appreciate the feedback.
@zhiguoqin5930
@zhiguoqin5930 5 лет назад
Pretty high-quality video, thanks!!!
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Welcome! Thank you for the feedback.
@victoriapuscas7028
@victoriapuscas7028 3 года назад
More content, please! This is awesome!
@rahulkulkarni1780
@rahulkulkarni1780 3 года назад
Fantastic video! Keep it going! Well structured
@drakezen
@drakezen 5 лет назад
Great videos. I will be looking forward to more updates
@SystemDesignInterview
@SystemDesignInterview 5 лет назад
Thanks, appreciate the feedback! The next video (Distributed Cache Design) will come out by the end of this week.
@jisesi
@jisesi 3 года назад
I miss your new videos bro. This is the best system design channel I have ever seen in all places
@arundhwajiiith
@arundhwajiiith 4 года назад
Thanks Mikhail for posting such good qualities content for Rate Limiter.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
My pleasure.
@aditi9059
@aditi9059 4 года назад
Awesome explanation !!! Please keep up the excellent work and upload more such videos !!!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you, Aditi, for the feedback!
@talivanov93
@talivanov93 4 года назад
Greate video. It helped me that you gave what possible questions the interviews could ask. Thank you.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
You are welcome, Tal. Thank you for the feedback!
@59sharmanalin
@59sharmanalin 3 года назад
A lot of people simply just stuff out the information, loved this guy's engineer's approach to every use case he explained!! Although this guy's english is great it's just that the accent is hard to understand at times but subtitles get you covered there!
@nishant07kumar
@nishant07kumar 3 года назад
Amazing stuff so details and simple to understand. this is something like System Design Master Class :)
@bullyellis1
@bullyellis1 2 года назад
Hand's down best system design study interviews on youtube.
@maximpodkolzin865
@maximpodkolzin865 3 года назад
Best system design videos by far
@AnuragSharma-kb9pc
@AnuragSharma-kb9pc 2 года назад
one of the best system design discussion, please continue making videos
@zhongbot
@zhongbot 4 года назад
Took 4 pages of notes from this, very good indeed!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Nice!
@ameyapatil1139
@ameyapatil1139 4 года назад
This is best ever !!! Please keep adding more.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Glad you liked it, Ameya!
@hadimajeed1078
@hadimajeed1078 4 года назад
When I understood the problem statement, I thought of solution - Zookeeper as counter solution but when I continued listening, you made me think of diversified solution (starting from simple solution as you have rightly mentioned). Thank you.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you for the feedback, Hadi.
@sureshbabu8794
@sureshbabu8794 Год назад
Waiting for more such videos. Very good explanation. Thanks!
@graghukalyan
@graghukalyan 3 года назад
One of the best SD content i've come across. We are waiting for more content. When is it coming :) ?
@puneetjain5021
@puneetjain5021 2 года назад
Please add more videos. These are very helpful.
@shadowknight140
@shadowknight140 Год назад
This is GOLD!!! Pure GOLD...
@sarathn47
@sarathn47 2 года назад
Amazing video. Please continue the good work!!
@krishnaaggarwal9228
@krishnaaggarwal9228 4 месяца назад
Very well Explained, Keep up the good work! Subscribed!
@deepaksoundappan3244
@deepaksoundappan3244 3 года назад
awesome job man,, love this video so much... ur content is very precise and no nonsense...
@Whaleshamu
@Whaleshamu Год назад
Awesome content. Your way of explanation is really amazing. Please make more videos on system design.
@yashnasery8501
@yashnasery8501 2 дня назад
I have seen no content which is better than this for system design!
@salmanahmed3949
@salmanahmed3949 4 года назад
Another excellent System Design video... looking forward to your next video.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you, Salman. Glad to see you back!
@salmanahmed3949
@salmanahmed3949 4 года назад
@@SystemDesignInterview looking forward to your next video!🙂
@shivang.agarwal
@shivang.agarwal 4 года назад
Great work and in depth explenation. you just nailed it.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Glad you liked it, Shivang! Thanks for the feedback.
@chitrasomasingh5388
@chitrasomasingh5388 4 года назад
Thank you for this explanation. Please come up with more such system design videos.
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you for the feedback, Chitrasoma! I will surely post more videos on the channel.
@nikeshtt8703
@nikeshtt8703 Год назад
Excellent explanation. Explaining the concept in terms of interviewer and interviewee helped to grasp the topic in great detail🙂
@sidharthbansal5835
@sidharthbansal5835 10 дней назад
Amazing explanation, covering every edge case
@muthukumarankothandaraman2371
@muthukumarankothandaraman2371 3 года назад
I recollect an instance (not in interview) when I was asked if CircuitBreaker can be used as RateLimiter 😊
@AmitKumar-sj9gr
@AmitKumar-sj9gr 3 года назад
Premium quality content .. Cheers.
@MrMukulj
@MrMukulj 3 года назад
@MIkhail, pretty awesome work you have done. Thank you!. I wanted to propose a slight change to refill method see if you accept it. 1. private void refill ( int tokens) 2. replace line #3 in refill method with -> currentBucketSize = Math.min(currentBucketSize + tokenToAdd, maxBucketSize + tokens); Also in the allowRequest method first line will change from refill() to refill(tokens);
@serjz.9154
@serjz.9154 4 года назад
I am amazed by the quality of the material and broadness of topics. I wish your vids get more views and be ranked much higher
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Thank you for the kind words, Serj!
@serjz.9154
@serjz.9154 4 года назад
@@SystemDesignInterview Btw, your vids helped me a lot for the architecture interview section :) I am literally recomennding them everyone I know
@SystemDesignInterview
@SystemDesignInterview 4 года назад
I am really glad for you, Serj! Thank you a lot for recommending the channel!
@vancouverbill
@vancouverbill 2 года назад
absolutely incredible content. in the section on message broadcasting you mentioned that for gossip protocol the nodes randomly choose a neighbor like a disease and this propogates, in this case if a new node is added and the IP is not known to neighbors how can they randomly choose a neighbor and reach that one? looking forward to doing your course
@TheProximator
@TheProximator 3 года назад
Great video, thank you very much, please add more :)
@choucolin6742
@choucolin6742 Год назад
Thank you very much. This is so helpful.
@kumarc4853
@kumarc4853 2 года назад
Very detailed and thorough. Thank you
@mingli9370
@mingli9370 4 года назад
lol, Mon's favorite flowers. Thank you, Sir!
@SystemDesignInterview
@SystemDesignInterview 4 года назад
Yeah... Some teams may feel quite paranoid about bringing in any new piece of software as a dependency. Although, these are typically very strong and healthy teams.
@jamess5330
@jamess5330 Год назад
Amazing session! Another super effective way to prepare system design interviews: Do mock interviews with FAANG engineers at Meetapro.
@nameunknown007
@nameunknown007 2 года назад
Haha I liked your content and you are funny too, subscribed to your channel.
@metallaser4409
@metallaser4409 3 года назад
Great video, as always! Quick question - when you speak of "components" on the service host, are they different processes belonging to the same service or different services altogether? How do these components talk to each other?
Далее
System Design Interview - Distributed Cache
34:34
Просмотров 353 тыс.
System Design Interview - Top K Problem (Heavy Hitters)
36:18
Телеграмм-Колян Карелия #юмор
00:10
System Design Interview - Distributed Message Queue
26:28
Rate Limiting - System Design Interview
24:04
Просмотров 26 тыс.
Why, where, and when should we throttle or rate limit?
19:05
Design a Payment System - System Design Interview
31:40
System Design Interview - Notification Service
25:11
Просмотров 250 тыс.
Собираем комп за 500 000 рублей!
6:44:35
#engineering #diy #amazing #electronic #fyp
0:59
Просмотров 1,9 млн