Тёмный

Apache Kafka Architecture 

Anton Putra
Подписаться 45 тыс.
Просмотров 14 тыс.
50% 1

🔴 - To support my channel, I’d like to offer Mentorship/On-the-Job Support/Consulting - me@antonputra.com
▬▬▬▬▬ Experience & Location 💼 ▬▬▬▬▬
► I’m a Senior Software Engineer at Juniper Networks (12+ years of experience)
► Located in San Francisco Bay Area, CA (US citizen)
▬▬▬▬▬▬ Connect with me 👋 ▬▬▬▬▬▬
► LinkedIn: / anton-putra
► Twitter/X: / antonvputra
► GitHub: github.com/antonputra
► Email: me@antonputra.com
▬▬▬▬▬▬ Related videos 👨‍🏫 ▬▬▬▬▬▬
👉 [Playlist] Kubernetes Tutorials: • Kubernetes Tutorials
👉 [Playlist] Terraform Tutorials: • Terraform Tutorials fo...
👉 [Playlist] Network Tutorials: • Network Tutorials
👉 [Playlist] Apache Kafka Tutorials: • Apache Kafka Tutorials
👉 [Playlist] Performance Benchmarks: • Performance Benchmarks
👉 [Playlist] Database Tutorials: • Database Tutorials
▬▬▬▬▬▬▬ Timestamps ⏰ ▬▬▬▬▬▬▬
0:00 Intro
0:40 Apache Kafka Event (Message)
2:56 Apache Kafka Topic
4:22 Apache Kafka Partitions
6:52 Apache Kafka Producers
7:48 Apache Kafka Consumers
8:38 Apache Kafka Cluster Architecture
9:38 Apache Kafka Broker
10:23 Apache Kafka Controller
▬▬▬▬▬▬▬ Source Code 📚 ▬▬▬▬▬▬▬
► GitHub: github.com/antonputra/tutoria...
#kafka #kubernetes #devops

Наука

Опубликовано:

 

1 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 33   
@AntonPutra
@AntonPutra 3 месяца назад
🔴 - To support my channel, I’d like to offer Mentorship/On-the-Job Support/Consulting - me@antonputra.com
@user-vl4sg2vj8b
@user-vl4sg2vj8b 7 дней назад
best primer on Kafka. kudos
@AntonPutra
@AntonPutra 7 дней назад
thanks!
@ravipanchal2259
@ravipanchal2259 Месяц назад
Your content is awesome. Hats off to your visualization and explanation .
@AntonPutra
@AntonPutra Месяц назад
@GabrielPozo
@GabrielPozo 3 месяца назад
Thanks for this high-quality explanation!!!
@AntonPutra
@AntonPutra 3 месяца назад
thanks trying to improve
@agun21st
@agun21st 3 месяца назад
Wow, Anton sir, this breakdown of Apache Kafka's architecture is incredibly insightful! Understanding how topics, partitions, and brokers work together is key to leveraging Kafka effectively in real-world applications. Thanks for this great overview!
@AntonPutra
@AntonPutra 3 месяца назад
thanks!
@pieter5466
@pieter5466 2 месяца назад
Great Kafka video, very clear and great diagrams.
@AntonPutra
@AntonPutra 2 месяца назад
Thanks!
@boyanbalev4428
@boyanbalev4428 3 месяца назад
One unorthodox questions do you think creating those videos help you getting deeper understanding of these technologies. I write articles and I found that it actually benefits as much me as helping others. Great work.
@AntonPutra
@AntonPutra 3 месяца назад
thanks, of course it does
@zacclifton5479
@zacclifton5479 3 месяца назад
Well done! I would recommend doing Pulsar next
@AntonPutra
@AntonPutra 3 месяца назад
thanks! i'll take a look
@dmitriydiachenko5648
@dmitriydiachenko5648 2 месяца назад
perfect explanation, ty
@csmithDevCove
@csmithDevCove 3 месяца назад
this guy ^ always bringing useful information. Well done @AntonPutra.
@AntonPutra
@AntonPutra 3 месяца назад
thank you!
@drivetrainerYT
@drivetrainerYT Месяц назад
Can't help subscribing ;) thanks!
@AntonPutra
@AntonPutra Месяц назад
🙏
@shokhrukhbekyursunjonov6203
@shokhrukhbekyursunjonov6203 14 дней назад
Good day Anton, thank you so much for user-friendly content! Could you please make a tutorial video on properly deploying secure (SASL/SCRAM) Confluent based full Fafka stack (2024 edition)? For several weeks I am attempting to deploy full kafka stack (zoo+kafka+schema-registry+kafka-connect+rest-proxy+ksqldb+conduktor-console) using SASL/SCRAM_SHA_256 method, but having errors in additional components such as registry, proxy connect and ksqldb during SASL SCRAM authorization... (docker compose solution). I am sure it would be really helpful to the kafka devops community here... Sincerely, Shokhrukh Yursunjonov
@AntonPutra
@AntonPutra 14 дней назад
Sure, I can do it. A couple of questions: Is it Kubernetes-based? Also, why not use Kafka without ZooKeeper (KRaft)? Do you have any legacy applications that require ZooKeeper?
@shokhrukhbekyursunjonov6203
@shokhrukhbekyursunjonov6203 14 дней назад
@@AntonPutra it is docker stack based (cause I am given one server to deploy kafka and I am writing compose file to deploy all in one server). Ah, I almost forgot about KRaft, good idea, I might try to use this mode, I heard that it is more intelligent and faster! According to my info (what devs said to me) apps are not legacy (mostly .net containerized apps), thus I can try using single/double broker KRaft mode, thank you. But I am afraid to have the same issues configurning SASL/SCRAM auth in it
@AntonPutra
@AntonPutra 14 дней назад
@@shokhrukhbekyursunjonov6203 yes it's faster since kafka does not need to keep offsets in zookeeper and it's scales better without zk. I'll get to it maybe after EKS playlist will see.
@blender_wiki
@blender_wiki 3 месяца назад
How you menage message locking in Kafka in case of a consumer task is time consuming?
@suvajitchakrabarty
@suvajitchakrabarty 3 месяца назад
In 4:55 should the partition in kafka broker 3 be partition 6, 7, 8 instead of 3, 4, 5, since you mentioned a partition always belongs to one broker.
@AntonPutra
@AntonPutra 3 месяца назад
yeah, copy paste mistake :) it should be 6, 7, 8
@suvajitchakrabarty
@suvajitchakrabarty 3 месяца назад
Thanks for the clarification@@AntonPutra
@rahulsingh-iq4gd
@rahulsingh-iq4gd 3 месяца назад
Hello sir can you make video on kubernetes helm chart please
@AntonPutra
@AntonPutra 3 месяца назад
ok
@RD-fb6ei
@RD-fb6ei 3 месяца назад
So the upper bound on the number of consumers for a topic is the number of partitions? That’s quite limiting compared to something like Apache Pulsar or NATS Jetstream where you can horizontally scale the consumers as much as you want without worrying about the partitioning scheme of the server.
@AntonPutra
@AntonPutra 3 месяца назад
No, you can have as many consumers as you want, not limited by partitions. Depends on your app, in some cases, to scale you need to increase both partitions and consumers.
@suvajitchakrabarty
@suvajitchakrabarty 3 месяца назад
@RD-fb6ei However in those applications when you scale the consumers, I believe you lose the guarantee of events arriving in order.
Далее
Apache Kafka Explained (Comprehensive Overview)
19:17
Просмотров 207 тыс.
can you repeat it? #tatyanadiablo ##shorts
00:11
Просмотров 949 тыс.
ЭТО ВООБЩЕ НЕ БОЛЬНО !
00:15
Просмотров 368 тыс.
САМЫЕ ТУПЫЕ МАЖОРЫ С ПАТРИКОВ
33:19
Apache Kafka Crash Course | What is Kafka?
1:17:04
Просмотров 368 тыс.
Kubernetes Architecture
9:41
Просмотров 13 тыс.
What is Kafka and How does it work?
15:04
Просмотров 138 тыс.
Istio & Service Mesh - simply explained in 15 mins
16:09
Power up all cell phones.
0:17
Просмотров 49 млн
Топ-3 суперкрутых ПК из CompShop
1:00
Полезные программы для Windows
0:56