Тёмный

How Instagram Scaled to 14 Million Users With Only 3 Engineers 

Kiki's Bytes
Подписаться 23 тыс.
Просмотров 78 тыс.
50% 1

In this video, we will explore how Instagram managed to scale so well with only 3 engineers in their early days.
Corrections:
• How Instagram Scaled t... , I meant to say "not to be confused sql schema of a table"
As requested description of each technology has been added below.
Timelines:
00:00:00 - Intro
00:00:14 - Webservers
00:00:50 - Postgres
00:02:27 - Sharding (unique identifiers)
00:05:32 - Sharding (postgres schema)
00:06:00 - Replication
00:06:19 - Task queue & push notification
00:06:43 - Other technologies
00:07:09 - Ending
Technologies:
EC2: Amazon Elastic Compute Cloud (EC2) is a web service that provides resizable compute capacity in the cloud, allowing you to run virtual servers for various computing needs.
Django: Django is a high-level Python web framework that simplifies the process of building web applications by providing pre-built components and enforcing a clean and pragmatic design.
Load balancer: A load balancer distributes incoming network traffic across multiple servers to ensure optimal resource utilization, maximize throughput, and minimize response time.
NGINX: NGINX is a high-performance web server and reverse proxy server that handles incoming web requests, serving static content efficiently, and can also act as a load balancer.
Postgres: PostgreSQL (often referred to as Postgres) is a powerful open-source relational database management system (RDBMS) known for its reliability, robustness, and extensibility.
ZooKeeper: Apache ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. It is often used in distributed systems for coordination and consensus.
Original article links:
instagram-engi...
instagram-engi...
Stock video credits:
Scrolling IG video - Video by cottonbro studio: www.pexels.com...
mointor with program - Video by Tima Miroshnichenko: www.pexels.com...
Background music credits:
⏫ Uplifting Cheerful Dance No Copyright Travel Celebration Background Music | Ocean Vibes by Waesto - • ⏫ Uplifting Cheerful D...
🌅 Summer Happy Instrumental Uplifting No Copyright Music | Follow The Sun by Luke Bergs & Waesto - • 🌅 Summer Happy Instrum...

Опубликовано:

 

7 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 84   
@wlockuz4467
@wlockuz4467 6 месяцев назад
When I saw the core principles part I thought this was going to be yet another generic regurgitation of the said topics, like they wrote clean code, followed blah blah principles etc. But the actual content of the video proved me wrong. You explained a real engineering problem in great detail without it getting boring due to technicalities. Earned a sub from me.
@kikisbytes
@kikisbytes 6 месяцев назад
Are you trying to make my day better??? I hope you're happy because you did. 😍
@santiagoescobar22
@santiagoescobar22 5 дней назад
Nice job, only the issue is that theres another video about this and with same title but he did first lmao. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-lrg8ZWI7MCg.html&ab_channel=CodingwithLewis
@ngochunglongnguyen4523
@ngochunglongnguyen4523 6 месяцев назад
The ID generation strategy that has information about database shard ID is genius.
@kikisbytes
@kikisbytes 6 месяцев назад
yeah it's amazing how an ID can give so much information about a piece of data.
@semenivanoff8615
@semenivanoff8615 6 месяцев назад
Quite common approach. There are more sophisticated methods used, those just not discussed widely in videos
@olhoTron
@olhoTron 6 месяцев назад
Only 3 engineers to create an army of narcisists... amazing
@SherifNeamatalla
@SherifNeamatalla 6 месяцев назад
No the army of narcissists has always been there, we call them "humans", the 3 engineers just provided the apes for a way to show their narcissism.
@numanunal6699
@numanunal6699 6 месяцев назад
@@SherifNeamatallaI don’t see monkeys using social media
@MJM703
@MJM703 5 месяцев назад
@@SherifNeamatalla they just did what they have been told to do.
@timeimp
@timeimp 6 месяцев назад
Hahaha "notice me senpai!" - very sneaky in there Kiki! Great video as always - succinct and informative
@kikisbytes
@kikisbytes 6 месяцев назад
hahahhah you noticed!!! I would love for him to roast my video
@da40au40
@da40au40 6 месяцев назад
Surely prime must come for him😂😂😂
@infinitelog
@infinitelog 6 месяцев назад
Stumbled upon this video and I loved it! You covered lot of key details and managed to explain things as well! Subscribed!
@kikisbytes
@kikisbytes 6 месяцев назад
That's great to hear and thank you for subbing!!!
@semenivanoff8615
@semenivanoff8615 6 месяцев назад
Funny is, that in reality this takes months to decide and consider, when people expect you to do the same within 15 minutes on job interview 😂😂😂😂😂😂
@kikisbytes
@kikisbytes 6 месяцев назад
and also know how to scale a parking lot :p
@yassinesafraoui
@yassinesafraoui 6 месяцев назад
Well having watched this video you can now hopefully reinvent it in less than an hour ;)
@connorchen3937
@connorchen3937 6 месяцев назад
Love these vids - been looking to learn more about production system setups
@kikisbytes
@kikisbytes 6 месяцев назад
that's awesome! Stay tune for more to come 😎
@knockonwall
@knockonwall 5 месяцев назад
This was very helpful on a conceptual basis. Thank you so much
@CalculusCoder.
@CalculusCoder. 4 месяца назад
How is your channel still not huge. Your videos are insanely underrated 🔥🔥. I would like to see more videos like this one in the future.
@namaefumei
@namaefumei 6 месяцев назад
Great video. Learned a lot. Your way of explaining and talking is great. Thanks a lot!
@kikisbytes
@kikisbytes 6 месяцев назад
Thank you so much!
@vigneshaithal
@vigneshaithal Месяц назад
Great video as always
@ananayarora
@ananayarora 6 месяцев назад
Beautiful video! Subscribed!
@kikisbytes
@kikisbytes 6 месяцев назад
Thanks for the sub!
@ahsin.shabbir
@ahsin.shabbir 4 месяца назад
Django as the backend is really interesting, its a great framework that makes it easy to get started with minimal boilerplate. Smart choice for a lean startup.
@lokylee7872
@lokylee7872 6 месяцев назад
Another one for the algorithm!
@kikisbytes
@kikisbytes 6 месяцев назад
you're the best!!! 😍
@hoangdesu
@hoangdesu 6 месяцев назад
I'm here before this channel blows up
@kikisbytes
@kikisbytes 6 месяцев назад
hahaha thank you! But the real question is, who do you main in league?
@hoangdesu
@hoangdesu 6 месяцев назад
@@kikisbytes oh hahaha didnt expect that. I main Zed but don't play as much as I wish now
@kikisbytes
@kikisbytes 6 месяцев назад
@@hoangdesu hahaha I checked out your channel and saw the league app (that you made?).
@HuanDN
@HuanDN 6 месяцев назад
Great video!
@kikisbytes
@kikisbytes 6 месяцев назад
thank you!
@invincibearofficial
@invincibearofficial 6 месяцев назад
7:10 you are a man of culture
@andrefu4166
@andrefu4166 6 месяцев назад
great video!
@kikisbytes
@kikisbytes 6 месяцев назад
thank you so much!
@Richard_GIS
@Richard_GIS 6 месяцев назад
Wow didn't know that they used postgres, great choice ;-), Great Video of course i subscribed immediately
@kikisbytes
@kikisbytes 6 месяцев назад
postgres is awesome! And thank you for subscribing!
@visakh_vijayakumar_
@visakh_vijayakumar_ 6 месяцев назад
Great video thanks. Earned one more subscriber. 😁
@kikisbytes
@kikisbytes 6 месяцев назад
Thank you for subbing!!!
@luizarnoldchavezburgos3638
@luizarnoldchavezburgos3638 6 месяцев назад
Just amazing
@oversocialized601
@oversocialized601 5 месяцев назад
Just hide this from my boss, OK?
@lowkeygaming4716
@lowkeygaming4716 Месяц назад
Are they still using Django until now? This success story really inspires me as a backend dev that primarily uses Python.
@Nhuzaa11
@Nhuzaa11 6 месяцев назад
I am curios ur motion graphics are so sutle but conveys a lot what do you use ??
@kikisbytes
@kikisbytes 6 месяцев назад
I use motion canvas to make my videos!
@bitwisedevs469
@bitwisedevs469 6 месяцев назад
These are awesome but at the end it is the timing that sets it. Even if you create a system that is super optimize and well structured if the concept, idea, and timing does not met then it matters too little how well developed a system is.
@Markyroson
@Markyroson 6 месяцев назад
Nice Stargate nod there!
@Log4Jake
@Log4Jake 6 месяцев назад
Wow how only 19 Comments this video is excellent.
@kikisbytes
@kikisbytes 6 месяцев назад
thank you for adding another comment! :)
@TRoss-ru6sg
@TRoss-ru6sg 6 месяцев назад
Great vid!
@kikisbytes
@kikisbytes 6 месяцев назад
thank you!
@the.sixthsense
@the.sixthsense 6 месяцев назад
My question is how do you know all this?
@kikisbytes
@kikisbytes 5 месяцев назад
Good question, I actually had a call with the Zuck himself a few months ago. Hhahaa jk jk. The original articles can be found in the description and I try to fill in additional details as needed.
@pedroyanez2638
@pedroyanez2638 6 месяцев назад
didnt coding with lewis make this same video a couple months back? 😬
@kikisbytes
@kikisbytes 6 месяцев назад
ah yes thank you for letting me know, just watched his video and it was 🔥. Looks like we both covered the same blog from IG.
@cotyhamilton
@cotyhamilton 6 месяцев назад
How did 3 people afford that infra 😂
@kikisbytes
@kikisbytes 6 месяцев назад
I think they had funding early on
@AliHassan-iy1eb
@AliHassan-iy1eb 6 месяцев назад
yeah it must have been very expensive
@tptodorov123
@tptodorov123 6 месяцев назад
Instagram is quite trivial from functionality point of view. Most of issue should have been scaling issue. What do you need more than 3 ppl for in an early stage startup?
@twitchizle
@twitchizle 6 месяцев назад
is supavisor considered solid change from pgbouncer
@kikisbytes
@kikisbytes 6 месяцев назад
haven't used it personally but I heard that it's pretty good.
@louielee3583
@louielee3583 6 месяцев назад
Sir would you mind to explain the differences between an SQL schema and PSQL schema at 5:32? Because I thought they are the same thing
@kikisbytes
@kikisbytes 6 месяцев назад
ah bleh sorry I meant to say "not to be confused with sql schema of a table". Thank you for catching this. Updated the description to show the correction.
@louielee3583
@louielee3583 6 месяцев назад
@@kikisbytes Oh that makes sense now! Thank you for the clarification and awesome content, looking forward to your future videos!
@kikisbytes
@kikisbytes 6 месяцев назад
@@louielee3583 Thank you for catching that! And yeah hoping you'll stick around for more videos!
@programmer1840
@programmer1840 6 месяцев назад
What's the difference between this video and another video by someone else: How Instagram Scaled to 14 Million Users With Only 3 Engineers (ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-lrg8ZWI7MCg.html&ab_channel=CodingwithLewis)
@kikisbytes
@kikisbytes 6 месяцев назад
I had to watch Lewis' video to know what the diff is. While we did cover the same article, I would say that the majority of this video was spent on postgres and database related work. For instance, what sharding strategy, what options they were considering etc. Hope that you can still give this video a look!
@thaibuixuan8807
@thaibuixuan8807 5 месяцев назад
Yeah. An overview of system design. But you know it's a lot of thing behide.
@Alpha_GameDev-wq5cc
@Alpha_GameDev-wq5cc 6 месяцев назад
I don’t understand the ID, aren’t they going to encounter overflow soon? I mean they are jumping by large numbers in the address space are they not? I think I’m missing something Important….
@twitchizle
@twitchizle 6 месяцев назад
no
@kikisbytes
@kikisbytes 6 месяцев назад
The IDs are broken down into 3 parts: time, shard id and auto increment. If you're referring to the time overflowing, then yes eventually but that's a problem for way later in the future.
@fgwesgfqef5020
@fgwesgfqef5020 Месяц назад
Wordpress premium hosting
@ayonsamajder
@ayonsamajder 6 месяцев назад
❤❤
@kikisbytes
@kikisbytes 6 месяцев назад
❤️❤️❤️
@Septumsempra8818
@Septumsempra8818 6 месяцев назад
Any Django peeps here?
@kikisbytes
@kikisbytes 6 месяцев назад
have heard many good things about it!
@bekiraltindal9053
@bekiraltindal9053 Месяц назад
Instagram and X are one of the buggiest and shittiest sites ever. The layout is shit. The design is absolute garbage.
@acedecastro83
@acedecastro83 6 месяцев назад
🫡
Далее
98% Cloud Cost Saved By Writing Our Own Database
21:45
Просмотров 387 тыс.
Little kitten 💓💜❤️🥰
00:17
Просмотров 19 тыс.
Harley Quinn is amazing.  #cosplay #joker#Harriet Quinn
00:11
The Weird Rise Of Anti-Startups
12:57
Просмотров 348 тыс.
How Instagram Grew to 14,000,000 Users With 3 Devs
13:59
The only Cloud services you actually need to know
17:17
Microservices are Technical Debt
31:59
Просмотров 454 тыс.
18 Weird and Wonderful ways I use Docker
26:18
Просмотров 259 тыс.
Little kitten 💓💜❤️🥰
00:17
Просмотров 19 тыс.