Тёмный

Distributed Systems in One Lesson by Tim Berglund 

Devoxx Poland
Подписаться 15 тыс.
Просмотров 411 тыс.
50% 1

Normally simple tasks like running a program or storing and retrieving data become much more complicated when we start to do them on collections of computers, rather than single machines. Distributed systems has become a key architectural concern, and affects everything a program would normally do-giving us enormous power, but at the cost of increased complexity as well.
Using a series of examples all set in a coffee shop, we’ll explore topics like distributed storage, computation, timing, messaging, and consensus. You'll leave with a good grasp of each of these problems, and a solid understanding of the ecosystem of open-source tools in the space.

Наука

Опубликовано:

 

9 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 201   
@saurabht3540
@saurabht3540 3 года назад
Tim's lectures are so funny and captivating that I can binge on them instead of Netflix.
@PaddleRock
@PaddleRock 5 лет назад
"I am the very definition of mutable state" Awesome. I think I may need to steal this. Thank you Tim!
@matheusdallrosa4698
@matheusdallrosa4698 3 года назад
I don't know if it is a natural skill from this speaker, but he speaks in a very clear way that i can watch the talk in 1.5 speed. Thank you.
@vetiarvind
@vetiarvind 2 года назад
Tim has a knack for explaining things in a clear and intuitive way. A great teacher, I hope he does more of this. Regards from Chennai.
@DevoxxPoland
@DevoxxPoland 2 года назад
Many thanks!
@amjadk12
@amjadk12 5 лет назад
Amazing single place to know about Distributed system, tools and techniques. Thanks for sharing...
@divyeshgaur
@divyeshgaur 5 лет назад
made it pretty clear from start to end. thank you for sharing.
@princejain1101
@princejain1101 5 лет назад
wonderful presenter, great delivery of crisp information.
@Shogoeu
@Shogoeu 4 года назад
This talk brings some light into all these technologies and helps decide what to learn next.
@amadeus4280
@amadeus4280 5 лет назад
"I like americano today, tomorrow maybe [...] mocca with extra foam - I'm the definition of mutable state" 😂
@xueliyue9127
@xueliyue9127 3 года назад
Mllk
@cihadguzel2159
@cihadguzel2159 3 года назад
He had worked in cassandra in earlier and now for kafka. Dude, you are the evolution of the distributed systems.
@wishfulbuy
@wishfulbuy 5 лет назад
A great speaker , at the same time an expert and pro educator :) I love your speech, wish I could have your presentation skills..
@andersondantas2010
@andersondantas2010 3 года назад
Thanks for the lessons m Berglund. This was by far one of the educating 40 minutes I had in years. I'd like to thank you for sharing your knowledge.
@DevoxxPoland
@DevoxxPoland 3 года назад
Glad it was helpful!
@StanislavKozlovsk
@StanislavKozlovsk 6 лет назад
What a great speaker
@PakluPapito
@PakluPapito 4 года назад
very concise and to the point !
@hellelo.5840
@hellelo.5840 4 года назад
This is Jeff Winger fron Community tv show LOL
@vardaansharma178
@vardaansharma178 4 года назад
Same thoughts.
@tachnicalcorner970
@tachnicalcorner970 2 года назад
@@hellelo.5840 d d. Nnfnd. F d. De. D. N n. D nd. B ndd nn. D y b. D dd d. De. D. Fb. D. D. D. D. L D. D. De. D. Ddn.. D. F d f. DIY d. Xl dd. D d. D d d. D d. Dad d d d d d. D. D. D d. D d
@tachnicalcorner970
@tachnicalcorner970 2 года назад
@@hellelo.5840 d d. Nnfnd. F d. De. D. N n. D nd. B ndd nn. D y b. D dd d. De. D. Fb. D. D. D. D. L D. D. De. D. Ddn.. D. F d f. DIY d. Xl dd. D d. D d d. D d. Dad d d d d d. D. D. D d. D d. Y d. Fu d
@yuvrajjag2558
@yuvrajjag2558 2 года назад
Love this video ❤️ didn't expect such an amazing content to be available for free. Internet is really a bliss most of the times
@DevoxxPoland
@DevoxxPoland 2 года назад
Glad you enjoyed it!
@Samarpanrai94
@Samarpanrai94 Год назад
Well the idea is that you later go buy Confluent’s services 😉 Kafka is a monster to maintain yourself
@vedambala
@vedambala 3 года назад
A great piece of presentation from a great speaker.
@NOCDIB
@NOCDIB 4 года назад
Great introduction to Distributed Systems. So often the industry gets bogged down in buzzwords and cliche terms that newcomers find it difficult to know where to begin. This is a great starting point.
@heh2k
@heh2k 2 года назад
Marketing loves to obfuscate.
@bhatanand
@bhatanand 2 года назад
Simply love the way Tim Bergland covers the topics. Excellent skills displayed.
@DevoxxPoland
@DevoxxPoland 2 года назад
Many thanks!
@limouwang5376
@limouwang5376 5 лет назад
I love this guy. Cristal clear and definitely he loves distributed systems.
@soggie7157
@soggie7157 5 лет назад
Gavin Belson? :O
@kevinjom1117
@kevinjom1117 5 лет назад
Lol
@rayhanmahmudshihab
@rayhanmahmudshihab 5 лет назад
:xD Haha... I got confused after seeing this comment :p
@MayurPatil
@MayurPatil 5 лет назад
Dude same here ! I also thought on what earth Gavin Belson is here...
@robsciuk729
@robsciuk729 5 лет назад
Yeah. You kind of nailed it. ;-)
@abod4gamer
@abod4gamer 5 лет назад
WTF lol hooli
@mahiprabhanjan
@mahiprabhanjan 3 года назад
Great speaker n teacher! Thanks for sharing!
@michaelzion8024
@michaelzion8024 3 года назад
Really enjoyed listening to this lecture, thanks :)
@mitalivarshney5168
@mitalivarshney5168 5 лет назад
Amazingly explained. Interesting speaker :)
@srbwin1
@srbwin1 5 лет назад
Great job Tim, nice stuff.!!
@sujaikumarj07
@sujaikumarj07 Год назад
Great content on introduction to Distributed Computing. I enjoyed the session. Thank you Tim.
@DevoxxPoland
@DevoxxPoland Год назад
Glad it was helpful!
@deadleaves1985
@deadleaves1985 4 года назад
Excellent speaker, that was pure joy
@nceevij
@nceevij 5 лет назад
Awesome talk, great learning on distributed systems
@korniszon68
@korniszon68 4 года назад
Nice talk. It feels like watching a good movie :)
@wittyhumour29
@wittyhumour29 Год назад
Great introduction to Distributed Storage, Computation, & Messaging.
@DevoxxPoland
@DevoxxPoland Год назад
Glad you liked it
@hrishikeshkaulwar8120
@hrishikeshkaulwar8120 4 года назад
Can you share the link to the 4-hour lecture about distributed systems you mentioned in the start, please?
@_rshiva
@_rshiva 5 лет назад
one hell of insight full talk on distributed system
@rockinray6197
@rockinray6197 3 года назад
I was inspired by this and another talk about system design (parking lot with premier parking spaces). I n your honor I am adding an external drive, for the hidden- read/write copy of a groupware system with an asynchronous don't ask don't tell, storage management unit. The best i ever had... The best i ever had ......
@yousefkhanbabaei4850
@yousefkhanbabaei4850 2 года назад
Presentation was great and explanation was clear. Thank you!
@DevoxxPoland
@DevoxxPoland 2 года назад
Glad you enjoyed it!
@akshitg
@akshitg 5 лет назад
It was a very good lecture. Thanks for the talk
@arifrazakh
@arifrazakh 6 лет назад
Thanx sir very helpful..
@huntrz
@huntrz 2 года назад
the original lesson is on Oreilly and its amazing
@coding3438
@coding3438 Год назад
Can we have the link to the 3-4 hr long video Tim talked about?
@pavansrinivas4388
@pavansrinivas4388 6 лет назад
Great presentation
@selvalooks
@selvalooks 3 года назад
Thanks , its a great session !!!
@adarshsunilkumar7095
@adarshsunilkumar7095 4 года назад
great video, awesome explanation
@johannsebastianbach3411
@johannsebastianbach3411 3 года назад
As a full stack developer who does stand up on the side, gotta say that was one tough crowd :D
@tanveerhasan2382
@tanveerhasan2382 2 года назад
Sad
@calvincruzada1016
@calvincruzada1016 4 года назад
Excellent speaker holy moly.
@rameshdahiya4615
@rameshdahiya4615 5 лет назад
Thats a great insight on distributed systems. One thing at 42:00 Tim mentioned about consistent hashing, where as in example of topic partitioning he used modules operation, which doesn't derive consistent hashing.
@alirezaghanbarzadeh1679
@alirezaghanbarzadeh1679 4 года назад
Tim is amazing
@sifiso5055
@sifiso5055 4 года назад
Such a powerful video
@bocckoka
@bocckoka 4 года назад
he has good explanations
@btm1
@btm1 2 года назад
great presentation, thank you!
@DevoxxPoland
@DevoxxPoland 2 года назад
Glad it was helpful!
@ramkumarnj7617
@ramkumarnj7617 6 лет назад
very inspiring!
@HienNguyenTechIO
@HienNguyenTechIO 3 года назад
Very good presentation
@theritesh973
@theritesh973 11 месяцев назад
Great presentation👏
@mvlad7402
@mvlad7402 4 года назад
great content!
@DavenH
@DavenH 3 года назад
Awesome speaker. Wish I could deliver talks in this manner.
@DevoxxPoland
@DevoxxPoland Год назад
Love him as well
@tommysuriel
@tommysuriel 2 года назад
Best explanation of Cassandra and consistent Hashing in all of RU-vid
@DevoxxPoland
@DevoxxPoland 2 года назад
Thank you
@zss123456789
@zss123456789 4 года назад
4:29 I thought my laptop was being possessed by Satan for a second.
@skyFullOfStars
@skyFullOfStars 5 лет назад
45:37 "They say the best code is the code you never write and the worst code would be the code you write two or more times" 👏
@snarkyboojum
@snarkyboojum 4 года назад
Akshay AS except good code is usually rewritten until it’s great, so this isn’t quite true.
@dariuszruminski8549
@dariuszruminski8549 4 года назад
"zed's dead" - the audience didn't get this. Hope so I did :)
@hidayaturrahman7897
@hidayaturrahman7897 4 года назад
Really appreciated very nice
@sashwatp
@sashwatp 4 года назад
Can someone point me to the link for the 4 hr video, he referenced to?
@jonathanlowe8755
@jonathanlowe8755 4 года назад
Also interested.
@lalwho
@lalwho 4 года назад
Anyone else noticed: "Kakfa" in the heading of the slide :O..
@franklemanschik4862
@franklemanschik4862 4 года назад
ya thats awsome
@aleksar6755
@aleksar6755 3 года назад
Amazing
@raghavendrakrishnamurthy4041
@raghavendrakrishnamurthy4041 2 года назад
Great lecture!
@DevoxxPoland
@DevoxxPoland 2 года назад
Thank you!
@Kydomusic
@Kydomusic 3 года назад
nice talk thank you!
@AbhishekSingh-op2tr
@AbhishekSingh-op2tr 4 года назад
He is also Hooli's CEO.
@philodev874
@philodev874 4 года назад
This is correct
@adityagoel123able
@adityagoel123able 3 года назад
awesome talk.
@MrChandrasekar1
@MrChandrasekar1 3 года назад
very well explained core concepts and problems about distributed systems, thanks Tim
@DevoxxPoland
@DevoxxPoland 3 года назад
Glad you enjoyed it!
@SiddharthKulkarniN
@SiddharthKulkarniN 6 лет назад
Nice talk.
@vishnusingh4118
@vishnusingh4118 4 года назад
10:03 picks up bottle. 10:08 opens it to drink water (presumably) 10:24 shuts and keeps it back without drinking
@philosophyofpolitics4504
@philosophyofpolitics4504 4 года назад
Haha that's swag
@ironhide9955
@ironhide9955 4 года назад
23:28
@stdiosus
@stdiosus 4 года назад
Super cool presentation. I am also not a fan of football, but I like Cervantes, so my favorite football club is Real Madrid.
@prakritidevverma
@prakritidevverma 3 года назад
Its really a good talk...
@spicytuna08
@spicytuna08 5 лет назад
i didn't know about all these pain involved with distributed system.
@sun-ship
@sun-ship 2 месяца назад
Very clear
@mantistoboggan537
@mantistoboggan537 5 лет назад
Is "read replication" synonymous with multiversion concurrency control? Meaning, you have different versions of data items for each transaction that are distinguished by time stamp, and therefore avoiding conflicts?
@heh2k
@heh2k 2 года назад
No, it means a given version has X identical redundant copies.
@heh2k
@heh2k 2 года назад
and they're usually kept on separate servers, racks, or data centers.
@bendakai1
@bendakai1 4 года назад
Instant like for over simplified CAP theorem at 20:00
@drdzdd
@drdzdd 4 года назад
great talk
@maslina10
@maslina10 4 года назад
Question on Topic Partitioning (at 41:00): together with each message, can we not include the timestamp when it was produced? Wouldn't it provide the global ordering?
@harishkumarrayasam
@harishkumarrayasam 3 года назад
Very nice explanation
@DevoxxPoland
@DevoxxPoland 3 года назад
Thanks for liking
@smithcodes1243
@smithcodes1243 2 года назад
Tim's a beauty.
@DevoxxPoland
@DevoxxPoland 2 года назад
Thanks
@ironhide9955
@ironhide9955 4 года назад
23:00 about cap theorem.. did he confuse himself?
@reespozzi4334
@reespozzi4334 3 года назад
He almost made it seem like by not having availability, you would also lose consistency, but what he means is, if the node just doesn't respond, it's still consistent because it's not giving out bad/inconsistent data. In a big distributed system, this data could be retrieved from elsewhere while tolerating the consistency.
@kahnfatman
@kahnfatman Год назад
All this Hadoop/Spark thingy are so abstract that I have no clue what is what anymore. 🤣😂
@imranariffin2688
@imranariffin2688 5 лет назад
6:41 "In a relational database, reads are usually than writes" I don't understand this. I thought reads are generally more expensive since you might have joins? While when writing you typically add some rows to a single table and that's it. Can somebody help explain it to me?
@imranariffin2688
@imranariffin2688 5 лет назад
Or I guess it's because in a distributed system you have to synchronize the writes to other machines?
@melter2973
@melter2973 5 лет назад
I think he meant more reads than writes in terms of volume.
@snarkyboojum
@snarkyboojum 4 года назад
Because OLTP databases do a great job of caching and using indexes to optimise read. Even the storage characteristics and disk layout is usually optimised for read traffic.
@btm1
@btm1 2 года назад
He meant there are usually more reads than writes, this is why the first step is to have some replicas to use for the reads
@robotempire
@robotempire 2 года назад
Love this video as I prepare for sys design interview
@DevoxxPoland
@DevoxxPoland 2 года назад
Glad it helped you.
@IbnIbrahem
@IbnIbrahem 4 года назад
One of few people where you can run the video at 2x speed and still understand what he is saying.
@tedwatts5021
@tedwatts5021 3 года назад
That's not a good thing
@pradeepsanchana
@pradeepsanchana 6 лет назад
Nice talk..
@shivajireddy5959
@shivajireddy5959 4 года назад
You can skip to 2:47 if you want.
@philosophyofpolitics4504
@philosophyofpolitics4504 4 года назад
Dude... F*** you...
@Amittai_Aviram
@Amittai_Aviram 3 года назад
Misspelled Kafka ("kakfa") on the slide at 34:10.
@Saurabh2816
@Saurabh2816 Год назад
17:00 that order though
@ishanksharma2785
@ishanksharma2785 3 года назад
What if I tell you that you read 'kakfa' as 'kafka' 33:07
@Tridib_Tinkel
@Tridib_Tinkel 4 года назад
33:05 kakfa
@bocckoka
@bocckoka 4 года назад
apache sparkling water?
@TrulyLordOfNothing
@TrulyLordOfNothing 3 года назад
The focus of this video is Distributed Systems when writes and reads getting slower on Databases. What about application server getting too many requests? Why is that not covered as part of a problem that DS solves?
@paul66766
@paul66766 Год назад
Because you scale the application server horizontally and load balance across the servers/processes
@kishorechekuru3904
@kishorechekuru3904 2 года назад
that z thing is funny, especially in Poland :)
@DevoxxPoland
@DevoxxPoland 2 года назад
:)
@kevintran6102
@kevintran6102 4 года назад
Why still water over sparkling water?
@hellelo.5840
@hellelo.5840 4 года назад
This is Jeff Winger fron Community tv show LOL
@BharCode09
@BharCode09 4 года назад
"I draw examples from a coffee shop just to be cute". Ha ha.. Of course there is a dire need to be cute in this otherwise one hell of a hard core tech talk.
@zhehou844
@zhehou844 Месяц назад
This is good, but of course, very briefly.
@tyrotoxin
@tyrotoxin 4 года назад
Good entry-level talk, but also would be great to give credits to Leslie Lamport, touch upon CRDTs (Conflict-Free Replication Data Types), mention consensus solutions like RAFT and Paxos, explain SQL vs NoSQL vs NewSQL, say PACELC (extended CAP), add an overview of consistency models (what is strong serializability?), and talk about leader election. I know, too much, but that's the essence of distributed computing!
@karthikraghunathan3363
@karthikraghunathan3363 4 года назад
shameless plug at 5:46
@reg4026
@reg4026 3 года назад
Anyone noticed that Tim looks like Benji Dunn?
@Roshen_Nair
@Roshen_Nair 3 года назад
Continue watching: 12:42
@ragingpahadi
@ragingpahadi 3 года назад
Gavin Belson ! :p
@kiranvanam
@kiranvanam 2 года назад
If you are in front of the mic, always go with the still water :P
@DevoxxPoland
@DevoxxPoland 2 года назад
It is one of the Top10 Speakers' pro tips 😂
@kiranvanam
@kiranvanam 2 года назад
@@DevoxxPoland It should be the most important tip :P
@subvind
@subvind 5 лет назад
33:03 kafka is not spelled correctly at the top there
@darsh_shukla
@darsh_shukla Год назад
I am here for the second time!
@DevoxxPoland
@DevoxxPoland Год назад
Awesome
Далее
System Design Interview - Distributed Cache
34:34
Просмотров 350 тыс.
Would you help?!😳
00:32
Просмотров 4,5 млн
Беда приходит внезапно 😂
00:25
Просмотров 612 тыс.
Scaling Instagram Infrastructure
51:12
Просмотров 277 тыс.
Cache Systems Every Developer Should Know
5:48
Просмотров 457 тыс.
How to Crack Any System Design Interview
8:19
Просмотров 329 тыс.
What is an API Explained in 1 minute #shorts
0:46
Просмотров 183 тыс.
Так ли Хорош Founders Edition RTX 4080 ?
13:00
Подключил AirPods к Xbox
0:45
Просмотров 26 тыс.