Тёмный

Kafka vs. RabbitMQ vs. Messaging Middleware vs. Pulsar 

ByteByteGo
Подписаться 857 тыс.
Просмотров 67 тыс.
50% 1

Get a Free System Design PDF with 158 pages by subscribing to our weekly newsletter: bit.ly/bytebytegoytTopic
Animation tools: Adobe Illustrator and After Effects.
Checkout our bestselling System Design Interview books:
Volume 1: amzn.to/3Ou7gkd
Volume 2: amzn.to/3HqGozy
The digital version of System Design Interview books: bit.ly/3mlDSk9
ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

Наука

Опубликовано:

 

18 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 77   
@chetankhandave1072
@chetankhandave1072 11 дней назад
Very good information, but it can much better if you explain how Stream processing works in Kafka , RabbitMQ, Pulsar. Polling and pushing in each techniques is very important to know.
@jayrigger7508
@jayrigger7508 8 дней назад
sounds like a good thing for you to work on and post yourself on own channel
@alexw1306
@alexw1306 7 дней назад
@@jayrigger7508 why so arrogant? He literally suggested a potential improvement and you come by and say "Just do it yourself".
@miran248
@miran248 11 дней назад
Worth mentioning is also (jetstream) nats, trivial to scale, has routing, partitioning, queueing, pub sub; it also has key value store, object store. Imagine if kafka and redis had a baby.
@rogsiel
@rogsiel 10 дней назад
Wow, didn't know of it. Specially the object store seems cool
@miran248
@miran248 10 дней назад
@@rogsiel While i haven't used their object store yet, i am using the key value store to persist actor's internal state, that way i don't need to rebuild it (event sourcing pattern) before processing the requests. The only issue i have with nats is the lack of backup / recovery options, seems like replication + a recovery cluster is the preferred way.
@rogsiel
@rogsiel 10 дней назад
oh that's cool . Will definitely look into it. Having pub/sub and object store together is interesting. I'm already doing the exact same thing for backups and persistent data.
@nikitamyazin6586
@nikitamyazin6586 8 дней назад
Nats doesn’t have partitioning, and apparently never will. You can emulate it with channels, but you won’t get rebalancing, for example. So it’s more like a cousin to Kafka
@miran248
@miran248 7 дней назад
@@nikitamyazin6586 Are you talking about jetstream topics or old nats streaming server (stan)? You can have multiple consumers on the same topic and as long as they belong to the same group they will all act as one. You can also partition topics, based on some (hashed) key and split incoming traffic across multiple workers, so that the same topic always reaches the same worker, which is very useful with actors. I'm sure you've seen this and we're just thinking of different kinds of partitioning. docs DOT nats DOT io/nats-concepts/subject_mapping
@MobileComputing
@MobileComputing 10 дней назад
Cool, some names of MQ tools were mentioned. Where is the "vs" in "Kafka vs. RabbitMQ vs. Messaging Middleware vs. Pulsar"?
@JonathanDieu
@JonathanDieu 11 дней назад
Thank you for continuing to create such helpful resources! 🐐
@CalifornianViking
@CalifornianViking 10 дней назад
@ByteByteGo - Thanks for another good video. A word of caution. While message queues are impressive, they are often misapplied. I have seen message queues make systems slower and less reliable while consuming a lot of resources that could have been used to speed up other parts of the system. It would be great if you could create a video that explains when (and when not) to use a message queue.
@br.3250
@br.3250 10 дней назад
Do you know anything about that, I'd certainly be useful
@ament4069
@ament4069 10 дней назад
Each diagram seems so informative Thank you
@NielsBasjes
@NielsBasjes 8 дней назад
Love your videos. You mentioned exactly once semantics as a feature of Kafka. I have found that another game changer is the capability of building systems that also maintain a guarantee of message order per key (usually a session id) which makes all of it (often in combination with Apache Flink) suitable for a whole new class of applications.
@francisdecena6744
@francisdecena6744 11 дней назад
wow, within 4min we already get and understand the high level of each message queueing from old to latest. Thank you
@szsz2277
@szsz2277 7 дней назад
This is great information! Thanks for the video. Can you do a video explaining and reviewing some of the top Platforms as a Service options? Eg. Heroku, Render, Digital Ocean, Vercel, Fly, etc. When to use them and which ones are better for which job? Thank you.
@raj_kundalia
@raj_kundalia 7 дней назад
Thank you for doing this!
@madhujai_shiksha
@madhujai_shiksha День назад
Its good know abt latest tech trends and tools but challenging part to learn where to use them in overall system. Breaking a system into different apps is most challenging thing in real world which can only be learn by experience
@ManticoreRoko
@ManticoreRoko 11 дней назад
Why are you forget Redpanda(and Redpanda ecosystem)?? Redpanda is most powerful streaming solution today working C++ and GO under hood + Kafka Api. Please talk about Redpanda too
@angryktulhu
@angryktulhu 10 дней назад
No 😂
@wind1309
@wind1309 10 дней назад
vendor lock in ecosystems get outta here
@alamba78
@alamba78 4 дня назад
How do you create the animations? After Effects or built-in animation with Power Point?
@graymcd
@graymcd 9 дней назад
Don't forget about Microsoft Message Queue (MSMQ), it's still there.
@Flako-dd
@Flako-dd 6 дней назад
I looked into Pulsar recently, looks really powerful. Anybody got real-world experience already?
@dquangminh1991
@dquangminh1991 5 дней назад
can i ask what tool to created animated diagrams like that ?
@ShortsItalyVibes
@ShortsItalyVibes 8 дней назад
How do you make these slides? What is the tool name?
@ChrisWard74
@ChrisWard74 10 дней назад
Which you had included product from Microsoft in this comparison.
@sanapramesh
@sanapramesh 3 дня назад
Should the arrow from driver management to notification be labeled as "NOTIFY DRIVER"?
@hentie5371
@hentie5371 10 дней назад
What is XXX would be better title. There is no 'vs.' in the whole video. If I just throw this video's content to my tech design spec as explanation of why I picked Kafka over RabbitMQ or another way around, I will probably have to look for another job again. When we talk about 'vs.' we should go from advantages, disadvantages, use case (this was mentioned). No advantage or disadvantage for one over another has been mentioned throughout the video.
@RahulSingh-pd1cr
@RahulSingh-pd1cr День назад
Which tool has been used for this graph can anyone tell me
@codesafariDev
@codesafariDev 11 дней назад
Never used IBM MQ, but would you still say that each RabbitMq, Kafka and Pulsar can be the best choice, depending on the use-case? Maybe it's just me, but the video sounds a little bit like "IBM MQ was made obsolete by RabbitMq; RabbitMq was made obsolete by Kafka; Kafka was made obsolete by Pulsar".
@Gladius000
@Gladius000 11 дней назад
They were not made obsolete, they just solve different problems. Kafka and RabbitMQ are very different and you wouldn't use them interchangeably. Huge streaming volume = Kafka Complex pub sub = RabbitMQ A new solution arises as the new problem becomes significant enough and is not solved well enough with existing tech.
@spouter
@spouter 11 дней назад
We would need implementation too for all the tools you have explained. Please make videos on those too.
@devalshah69
@devalshah69 10 дней назад
anyone have used ZeroMQ?
@GlebWritesCode
@GlebWritesCode День назад
Ibm mq supports hardware failures - not so sure. We ran it at a fairy large company - once a new service without proper disposal code took down MQ node, no one could publish or consume a message
@MelroyvandenBerg
@MelroyvandenBerg 10 дней назад
I don't like the cloud focuses solutions. Like the latest you showed. I want to run a message queue system on prem.
@manofacertainrage856
@manofacertainrage856 8 дней назад
I've spent a few years with a RabbitMQ backed system on-prem. Granted, on-prem, on a VM on desktop/laptop, and on-prem in a VM in a llocal data center are all about the same thing these days. Failure modes and recovery aren't always obvious (especially if the VM is frozen and moved), but it's at least a decent solution and might be a great one depending on your circumstances.
@benzazalaid6623
@benzazalaid6623 7 дней назад
hin and goog luk, please what s the sofwre wich you make your presentation
@PeriMCS
@PeriMCS 10 дней назад
I see Kafka is often used as message queue which it is not.
@qm3ster
@qm3ster 9 дней назад
Persistent sharded logs as the source of truth 🥵
@zx1986
@zx1986 5 дней назад
how about NATS?
@ihsanpro9406
@ihsanpro9406 10 дней назад
How do you exclude NATS from here ? Come on man !
@Zmey5656
@Zmey5656 10 дней назад
I use only Kafka. May be I nee to try something new.
@SkEiTaDEV
@SkEiTaDEV 9 дней назад
theres an incredibly nasty high pitch noise until 0:12
@Fahad-et3sc
@Fahad-et3sc 10 дней назад
one day i will understand all this lol
@shinobi77
@shinobi77 11 дней назад
How about Redis Pub/Sub?
@5353055
@5353055 11 дней назад
how about rocketMQ?
@suvankarpaul8659
@suvankarpaul8659 11 дней назад
🫡
@JohnSmith-op7ls
@JohnSmith-op7ls 11 дней назад
Programming content creators: Want to know how companies you’ll never work for do things the companies you will work for don’t need to do?
@oskarszwajkowski
@oskarszwajkowski 11 дней назад
Or giving you freshest framework/tool so you can rewrite your application again for no reason at all 😅
@JohnSmith-op7ls
@JohnSmith-op7ls 11 дней назад
@@oskarszwajkowski Trend casing, when you need an excuse to not do real work
@matonolo
@matonolo 11 дней назад
U are just mad because u cant handle more advance concepts than programming.
@quinnherden
@quinnherden 11 дней назад
​@@matonolo "More advanced concepts than programming".. what?
@JohnnySacc
@JohnnySacc 11 дней назад
Event-driven microservice architecture is important to know if you want to work in backend. Not sure why you're acting like this is impractical knowledge.
@samjackgreen
@samjackgreen 7 дней назад
From this video, I don't understand how there was an "evolution". It seems you are just naming arbitrary virtues of each messaging system... Very hard to follow. Cheers.
@ianjohnson2433
@ianjohnson2433 11 дней назад
Bro i think you are well knowledgeable but to help,why not indicate by doing than just explaining?I have never seen you code or apply these concepts.
@alexalexin9491
@alexalexin9491 11 дней назад
Oh please, you must've beaten all records of unintelligibility in this video. I struggled to understand the simplest words you sais instead of getting the main ideas of the video. Can you please work on your prounciation a little, PLEASE?
@mtsmithtube
@mtsmithtube 8 дней назад
There's a transcript option
Далее
Top 12 Tips For API Security
9:47
Просмотров 75 тыс.
skibidi toilet multiverse 039 (part 1)
05:29
Просмотров 5 млн
What is Data Pipeline? | Why Is It So Popular?
5:25
Просмотров 84 тыс.
API Gateway Explained Quickly
4:23
Просмотров 10 тыс.
RabbitMQ vs Kafka - ¿Cuál escoger?
27:03
Просмотров 31 тыс.
Top 9 Most Popular API Protocols
3:54
Просмотров 70 тыс.
System Design: Why is Kafka fast?
5:02
Просмотров 1 млн
10 Coding Principles Explained in 5 Minutes
5:44
Просмотров 125 тыс.
Consistent Hashing | Algorithms You Should Know #1
8:04
Top 5 Redis Use Cases
6:28
Просмотров 167 тыс.
Телефон в воде 🤯
0:28
Просмотров 1,2 млн