Тёмный

What is Database Sharding? 

Be A Better Dev
Подписаться 221 тыс.
Просмотров 150 тыс.
50% 1

Database sharding is a technique used to optimize database performance at scale. It relies on separating data into logical chunks so that they can be separated and queried independently. Learn more about sharding in this video.
Looking to get hands on experience building on AWS with a REAL project? Check out my course - The AWS Learning Accelerator! courses.beabetterdev.com/cour...
📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚
Clean Code - amzn.to/37T7xdP
Clean Architecture - amzn.to/3sCEGCe
Head First Design Patterns - amzn.to/37WXAMy
Domain Driver Design - amzn.to/3aWSW2W
Code Complete - amzn.to/3ksQDrB
The Pragmatic Programmer - amzn.to/3uH4kaQ
Algorithms - amzn.to/3syvyP5
Working Effectively with Legacy Code - amzn.to/3kvMza7
Refactoring - amzn.to/3r6FQ8U
🎙 MY RECORDING EQUIPMENT 🎙
Shure SM58 Microphone - amzn.to/3r5Hrf9
Behringer UM2 Audio Interface - amzn.to/2MuEllM
XLR Cable - amzn.to/3uGyZFx
Acoustic Sound Absorbing Foam Panels - amzn.to/3ktIrY6
Desk Microphone Mount - amzn.to/3qXMVIO
Logitech C920s Webcam - amzn.to/303zGu9
Fujilm XS10 Camera - amzn.to/3uGa30E
Fujifilm XF 35mm F2 Lens - amzn.to/3rentPe
Neewer 2 Piece Studio Lights - amzn.to/3uyoa8p
💻 MY DESKTOP EQUIPMENT 💻
Dell 34 inch Ultrawide Monitor - amzn.to/2NJwph6
Autonomous ErgoChair 2 - bit.ly/2YzomEm
Autonomous SmartDesk 2 Standing Desk - bit.ly/2YzomEm
MX Master 3 Productivity Mouse - amzn.to/3aYwKVZ
Das Keyboard Prime 13 MX Brown Mechanical- amzn.to/3uH6VBF
Veikk A15 Drawing Tablet - amzn.to/3uBRWsN
🌎 Find me here:
Twitter - / beabetterdevv
Instagram - / beabetterdevv
Patreon - Donations help fund additional content - / beabetterdev
📚 References:
Great Sharding Article - aws.amazon.com/blogs/database...
#Databases
#Sharding
#SoftwareEngineer

Опубликовано:

 

25 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 207   
@RandomShowerThoughts
@RandomShowerThoughts Год назад
honestly might be the most complete and thorough explanation of sharding.
@BeABetterDev
@BeABetterDev Год назад
Thanks so much for your kind words!
@hamadaparis3556
@hamadaparis3556 2 года назад
You've simplified your explanation like google engineers do when they give lectures, I'm sorry if that sounds strange but I've realized that the people who simplify complex things they really know what they are doing awesome man Cheers.
@BeABetterDev
@BeABetterDev 2 года назад
Thank you so much for the kind words!
@mohamedshehata3979
@mohamedshehata3979 Год назад
Nice words
@Aidanhyland
@Aidanhyland 3 года назад
I am burning through all your videos. You are making me a better SAAS Test Engineer! Keep up this great work!
@abhishekghosh5550
@abhishekghosh5550 2 года назад
This is seriously such a great video man. I spent the entire Sunday understanding Sharding. Not that I didn't get started with the concept, however, this video just made everything clear at the end of the day. Thank You.
@bharat_arora
@bharat_arora 2 года назад
Finally found some decent content over this topic. I already had an idea on this topic just wanted to revise it. Thanks a lot for making the insightful videos.
@yfzhangphonn
@yfzhangphonn Год назад
Best lesson about database scalability I found, so easy to understand.
@v.m.5850
@v.m.5850 Год назад
Watched countless videos and barely understood the concept. Your video on the other hand explained everything along with pros and cons super simply. Thanks a ton.
@cd92606
@cd92606 3 года назад
Great video, especially your description about the non-uniformity problem.
@BeABetterDev
@BeABetterDev 3 года назад
Thanks Rotary Dialer! Yea the non-uniformity issue is one I've been personally bitten by in the past. Glad you enjoyed the video!
@dannydatt
@dannydatt 3 года назад
Network guy trying to get an understanding in a different field. That's an outstanding walk-through and very much appreciated. Thank you for your work and quality presentation.
@BeABetterDev
@BeABetterDev 3 года назад
Glad it was helpful!
@poloska9471
@poloska9471 2 года назад
Dude you make some really awesome content. Please please keep making videos! I love the clarity of your speech, voice, and presentation. I understand and can follow along in your videos a lot better than more other channels. Earned my subscription and likes! Keep killing it homie!
@BeABetterDev
@BeABetterDev 2 года назад
Thank you so much for your kind words and welcome to the channel!
@wlcheng
@wlcheng Год назад
Great video! Such a clear explanation of how database sharding works.
@ChauDuong1982
@ChauDuong1982 3 года назад
Thanks for the videos. Great explaination.
@quangluu79
@quangluu79 10 месяцев назад
Good stuff man. I love the clarity you bring to a subject. Subscribed.
@Alexan6548
@Alexan6548 Год назад
Very clear. One of the best tutorial I have ever seen
@mathisinav4267
@mathisinav4267 2 года назад
Hands down! the best explanation I've seen on database sharding, excellent!
@BeABetterDev
@BeABetterDev 2 года назад
You're so welcome. Glad you enjoyed.
@ase713
@ase713 2 месяца назад
Dude, this was outstanding! Super helpful and covered everything I needed to know!
@JamesQQuick
@JamesQQuick 2 года назад
This was awesome. Thanks!
@Bhaskarlnm
@Bhaskarlnm 2 года назад
Daniel, no words.. looking at your playlists content and videos …amazing. Great great effort to help people. Kudos to you 👏👏👌👌👌
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome!
@ihateorangecat
@ihateorangecat Год назад
Best of the best explantion I kinda start to understand the Sharding in just video.Thank You and I subbed!
@patrick1778
@patrick1778 2 года назад
you are so good at explaining concepts
@codespace747
@codespace747 3 месяца назад
Best video ever made on sharding
@willemplug3366
@willemplug3366 Год назад
Super clear. Thank you!
@antonrozhansky7254
@antonrozhansky7254 3 года назад
Great explanation, Daniel. Thank you
@BeABetterDev
@BeABetterDev 3 года назад
You're very welcome Anton!
@nodrift9503
@nodrift9503 Год назад
Perfect explanation. Thank you
@saiaussie
@saiaussie 3 месяца назад
Hey dude, you're a star! Very clear and upto the point! I cant thank you enough.
@IQUE928
@IQUE928 5 дней назад
incredible explanation, thank you!
@eternalnight9453
@eternalnight9453 3 года назад
New here. Loved your talk! Your presentation and teaching is elegant and simple. Really appreciate it, thank you!
@BeABetterDev
@BeABetterDev 3 года назад
You are so welcome!
@sharonleibel
@sharonleibel 2 года назад
Great explanations! Thanks, Keep it coming!
@BeABetterDev
@BeABetterDev 2 года назад
Thanks Sharon!
@user-zr4jl4ms3v
@user-zr4jl4ms3v 2 года назад
best explanation of sharding i've heard!
@BeABetterDev
@BeABetterDev 2 года назад
Thank you very much!
@santoshlml
@santoshlml 3 года назад
Well explained. Thank you!!
@BeABetterDev
@BeABetterDev 3 года назад
You're very welcome Santosh! Glad you enjoyed.
@panggrayta
@panggrayta 3 года назад
woww...!! great videos, great presentation, great explanation. thank you, keep sharing..
@Lordnoashi
@Lordnoashi Год назад
Amazing explanation, loved it. Thank you, it will help for the future interviews I have.
@BeABetterDev
@BeABetterDev Год назад
Glad I could help!
@harishbendale6818
@harishbendale6818 Год назад
Very clear, and simple explanation.
@BeABetterDev
@BeABetterDev Год назад
Glad it was helpful!
@lucasarbex926
@lucasarbex926 2 года назад
Great content man!! It helped me a lot!! Keep up with the good work!
@BeABetterDev
@BeABetterDev 2 года назад
Thank you!
@taniaasim
@taniaasim 2 года назад
This is great and super clear. Thank you!
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome
@rjjlucy
@rjjlucy 3 года назад
In most ~20min videos, I get tired soon and close them after 5min. I can’t believe your video is so good that I totally forgot time and finish watching all of it
@BeABetterDev
@BeABetterDev 3 года назад
Thank you so much Jingyi! Its these kinds of comments that keep me motivated to make more content :) Stay safe Daniel
@arikedada
@arikedada Год назад
great video, I understand what idempotency operations entails, thank you
@AnilKumar-lb3qf
@AnilKumar-lb3qf 2 года назад
Excellent presentation, very good explanation 👍👍
@jackforcecity
@jackforcecity 2 года назад
Great job. Very well explained!!!
@BeABetterDev
@BeABetterDev 2 года назад
Thanks so much Jackson! Glad you enjoyed :)
@francoisbourdages2906
@francoisbourdages2906 Год назад
très bien expliqué, merci
@OscarMartinez-nt6zn
@OscarMartinez-nt6zn 2 месяца назад
Great explanation!
@user-ws5xs1nv4p
@user-ws5xs1nv4p Год назад
Thanks a lof for this video!
@dorbenmoyal7639
@dorbenmoyal7639 2 года назад
Great explanation..! Thanks 🙏🏼
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome Dor!
@estebanquintana156
@estebanquintana156 2 года назад
Great explanation. Thank you
@BeABetterDev
@BeABetterDev 2 года назад
You are welcome!
@rajt1998
@rajt1998 2 года назад
Very well explained. Thank you
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome!
@duzgunkenan
@duzgunkenan Месяц назад
Great content, thank you
@shubhamchandra9258
@shubhamchandra9258 Год назад
Awesome video. Very clearly explained.
@BeABetterDev
@BeABetterDev Год назад
Thanks!
@filesopen6188
@filesopen6188 2 года назад
this video entails very good explanation and this also entails complex understanding.
@BeABetterDev
@BeABetterDev 2 года назад
Thank you!
@devdewboy
@devdewboy Год назад
Thanks for the straight forward easy to grasp concept of sharding. Give this to someone else and we would have gotten a bunch of technical wordy mumbo-jumbo.
@rschmidtzalles
@rschmidtzalles 3 года назад
clear and concise. subscribed
@BeABetterDev
@BeABetterDev 3 года назад
Thanks Libert and welcome!
@RajuGupta-st1hj
@RajuGupta-st1hj 2 года назад
Thank you so much for the post. Good work. Keep it up.
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome Raju!
@eugeniosp3
@eugeniosp3 2 года назад
Bro I'll watch anything you make. If you made a video teaching me how to watch paint dry I'd take notes. Keep up the damn good work my mans.
@mivel9763
@mivel9763 2 года назад
Had a hard time grasping on what database sharding actually meant but your video really helped me understand it, thanks! :)
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome!
@kishoretvk
@kishoretvk 2 года назад
Great vidoe, keep up the good work
@sandrojorgeoliveira175
@sandrojorgeoliveira175 10 месяцев назад
Thank you, Dude!!!
@jeevaengg
@jeevaengg Год назад
good explanation!!
@tamaraamanda2483
@tamaraamanda2483 2 года назад
Prepping for Amazon TPM interview and this is so helpful!
@BeABetterDev
@BeABetterDev 2 года назад
Thanks Tamara and good luck on your interview! Make sure you focus on those leadership principles !
@milequinze
@milequinze 2 года назад
Awesome! Thanks a lot!
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome
@SofiaGoyal
@SofiaGoyal 3 года назад
Really good work man... such a detailed video...
@BeABetterDev
@BeABetterDev 3 года назад
Thanks Sofia! Glad you enjoyed :)
@user-tu1kf6xd8d
@user-tu1kf6xd8d 3 года назад
great explanation thank u so much
@BeABetterDev
@BeABetterDev 3 года назад
You are welcome!
@hpandeymail
@hpandeymail 2 года назад
Very well formed content .. thanks 🙏
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome!
@rayprusia4753
@rayprusia4753 2 года назад
Your videos are awesome! Thanks
@BeABetterDev
@BeABetterDev 2 года назад
Thanks ray!
@itiscinnamoncafe
@itiscinnamoncafe 9 месяцев назад
Love longer videos ❤
@kgcpk
@kgcpk 2 года назад
Superb explanation 😍
@chandnisaini9176
@chandnisaini9176 2 года назад
Well explained!!
@BeABetterDev
@BeABetterDev 2 года назад
Thank you!
@simonemariottini1011
@simonemariottini1011 2 года назад
Really useful content! Keep it up!
@BeABetterDev
@BeABetterDev 2 года назад
Thanks so much Simone!
@samlinsell900
@samlinsell900 2 года назад
Vids are awesome, really enjoy them. Interesting that you didn't touch on the lack of thought to database design, indexing and maintenance etc as a way to improve performance. Interested to know why? Especially given the cost of scaling in serverless environments.
@3042640426
@3042640426 Год назад
Thank you so much
@donaldkennedy7993
@donaldkennedy7993 Год назад
superb explanation of DB scaling & sharding & W/R databases for a non DB person ;)
@drummerboi4eva
@drummerboi4eva Год назад
excellent video
@trantrongty8065
@trantrongty8065 2 года назад
Thank you that really helpful great video
@BeABetterDev
@BeABetterDev 2 года назад
You're very welcome Tran!
@random-characters4162
@random-characters4162 Год назад
God bless you, sir ✌️
@JayPatel12928
@JayPatel12928 2 года назад
Watched some of your random videos on sys design, and now im hooked. Great content!
@BeABetterDev
@BeABetterDev 2 года назад
Thanks so much J! Glad you enjoyed!
@amrikmalhans
@amrikmalhans 2 года назад
@@BeABetterDev yes
@markryan430
@markryan430 Год назад
OMG, I just Sharded myself!
@andrewkicha1628
@andrewkicha1628 Год назад
Great job on this one, I came here to know more about sharding, but I learned lots of useful information before you even dived into the topic ;)
@BeABetterDev
@BeABetterDev Год назад
Glad it was helpful!
@vikasravindran1312
@vikasravindran1312 2 года назад
Excellent !
@BeABetterDev
@BeABetterDev 2 года назад
Thank you so much Vikas!
@gulsimsek7988
@gulsimsek7988 3 года назад
thank you!
@shivakumarranjithn5584
@shivakumarranjithn5584 3 года назад
Great content!
@BeABetterDev
@BeABetterDev 3 года назад
Thanks so much Shivakumar!
@subhasishhalder4817
@subhasishhalder4817 2 года назад
How come I didn't find your channel before?
@geekaffairs6475
@geekaffairs6475 2 года назад
very well explained
@BeABetterDev
@BeABetterDev 2 года назад
Thanks so much!
@fethicetin9186
@fethicetin9186 3 года назад
Thanks for the video
@BeABetterDev
@BeABetterDev 3 года назад
You're very welcome Fethi!
@skmahaboobbasha6059
@skmahaboobbasha6059 2 года назад
Great vedio please make vedio on opsmanager installation on production environment
@Tiparium_NMF
@Tiparium_NMF 8 дней назад
I love this breakdown, but it does somewhat leave me wondering when Sharding would be a good vs a bad idea. The cons seem pretty hefting in comparison to the pros. It would have been nice to run through a few specific different use cases and when one strategy would be better than another.
@rishiraj2548
@rishiraj2548 Год назад
Thanks
@hualiang2182
@hualiang2182 2 года назад
Nice tutorial. Wonder in real word scenairo, is the routing layer something sits in the application code or it's implemented on the database side?
@royal4210
@royal4210 2 года назад
Thank you programmer charlie
@swaroopas5207
@swaroopas5207 2 года назад
Great video! But how do we handle foreign keys in sharding?
@drew4980
@drew4980 3 года назад
Are there any database tools that make this easier? Couldn't someone write some software to create a wrapper around a sharded DBMS that could handle the routing and re-sharding with a given hashing key?
@ibrahimkoz1983
@ibrahimkoz1983 2 года назад
You're great.
@BeABetterDev
@BeABetterDev 2 года назад
Thank you!!!
@DuyTran-ss4lu
@DuyTran-ss4lu Год назад
Awesome
@loaizar95
@loaizar95 Год назад
amazing video!! Understood almost everything and am not a it guy.. the only thing I did not get is the difference between partition mapping and routing :(
@mohamedyoussef8835
@mohamedyoussef8835 Год назад
Awesome video +++++++++++ 🙂
@r-rtz
@r-rtz 10 месяцев назад
A more interesting concept though is how you generate these unique id's that are used in the sharding / partitioning and ensure uniqueness
@alexeykorovko6704
@alexeykorovko6704 Год назад
very good explanation, thank you one point is not clear - do we really have advantage of availability / fault tolerance, in case we have an intermediate layer that routes the requests? for me it is like the same, isn't it?
@poketopa1234
@poketopa1234 Месяц назад
What I always miss in these videos is, doesn’t introducing a routing layer just kick the can down the road? Now you have all traffic going to a singular routing node, which is not scalable and can fail. What happens when you need to scale the routing node?
@peterroger249
@peterroger249 Год назад
Much thank you for your great RU-vid help. I am new to Excel and Chatbot. How can I migrate the Excel database, export it from Microsoft Azure WebApp, and import it into AWS Chabot? Keep having errors missing QID and others on the AWS Chabot console. Please help show me the fastest way to convert the Excel and make it compatible with AWS Chatbot?
@HeavensMeat
@HeavensMeat 3 года назад
I know you have had other dynamodb videos here but would it be possible to have a more in depth video dealing with sharding in dynamodb and also utilizing this with python/boto3 vs the cli? I know it's not really the same type of sharding per se but this video reminded me that I am interested in seeing that kind of thing
@BeABetterDev
@BeABetterDev 3 года назад
Hey HeavensMeat! You're suggestion is a great idea for a new video idea, thanks you! I'll work on incorporating this into my todo list. Cheers!
@Anonimus_13
@Anonimus_13 Год назад
Cool video) What app do you use for drawing?
@BeABetterDev
@BeABetterDev Год назад
Adobe Photoshop and a Veikk drawing tablet!
@ashishsharma9008
@ashishsharma9008 2 года назад
Which is better architecture, microservice or using single database n use sharding later when it scales?
@atacoonthis
@atacoonthis 3 года назад
This dude is the Cr1tikal of databases
@BeABetterDev
@BeABetterDev 3 года назад
Haha thank you Daniel!
Далее
SQL vs NoSQL Explained
11:37
Просмотров 326 тыс.
System Design: What is Horizontal vs Vertical Scaling?
10:13
ОБНОВАА?? ЛУТАЕМ МЕГАЯЩИКИ
3:12:14
Просмотров 312 тыс.
Database Sharding and Partitioning
23:53
Просмотров 65 тыс.
Database Sharding in 200 Seconds
5:04
Просмотров 20 тыс.
Learn Database Normalization - 1NF, 2NF, 3NF, 4NF, 5NF
28:34
What is DATABASE SHARDING?
8:56
Просмотров 902 тыс.
System Design: What is Load Balancing?
9:28
Просмотров 46 тыс.
7 Database Paradigms
9:53
Просмотров 1,5 млн
Latency vs Throughput | System Design Essentials
20:51