Тёмный

Kafka Delivery Semantics | At-Least-Once, At-Most-Once & Exactly-Once 

Code with Irtiza
Подписаться 13 тыс.
Просмотров 6 тыс.
50% 1

Опубликовано:

 

1 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 22   
@gmmkeshav
@gmmkeshav Год назад
What is the advantage of keeping three types At-most once, at-least once, and exactly once cant we have exactly once only?
@nSiLEtan
@nSiLEtan 11 месяцев назад
It's to optimize performance, sometimes you can give up accuracy in favor of higher throughput. Exactly once has the lowest throughput of all 3 options, so you should only choose it if you need your data to be super accurate.
@irtizahafiz
@irtizahafiz 10 месяцев назад
++ to everything said here. Thank you!
@gmmkeshav
@gmmkeshav 10 месяцев назад
And how do we do cost estimation?@@irtizahafiz
@ssjamble
@ssjamble 3 месяца назад
IT would certainly be helpful to also understand in which scenarios each of these would be used. For example, at-least once maybe in a payment service (idempotency handled appropriately), at-most once (comments for a post) etc..
@JardaniJovonovich192
@JardaniJovonovich192 2 года назад
Any real-world examples of when one would use 'Atmost once'?
@irtizahafiz
@irtizahafiz 2 года назад
It totally depends on the application tbh. Off the top of my head, I can't think of any. "At-least-once" is the most common one in my opinion.
@muddassirbari
@muddassirbari Год назад
maybe when you're consuming access logs for real-time analysis, when the delivery of all the message is not obligatory.
@Maxhsynv
@Maxhsynv 9 месяцев назад
Say you're collecting the location coordinates of some objects moving on the map in each second (e.g. taxi cars on Uber, airplanes flying from one location to another). So you can choose "At-most-once" because it's okay to loose some coordinate data in between some seconds and also you need a high throughput in such scenarios.
@ayushsolanki4248
@ayushsolanki4248 Год назад
message can be delivered more than once, but we have idempotency due to which we don't have to accept duplicate message. It gives once processing. You are giving misinformation
@irtizahafiz
@irtizahafiz 11 месяцев назад
I think the point is that you have to ensure idempotency to guarantee "exactly-once". Or, you can use Kafka Transactional API, you can read about www.baeldung.com/kafka-exactly-once
@mahmudultushar7660
@mahmudultushar7660 2 года назад
Hey thanks for the regular uploading. It would be great if you can make videos on job scheduler, and live coding platforms like hacker rank.
@irtizahafiz
@irtizahafiz 2 года назад
Hi! I added this to my content backlog. Can't promise anything soon though. Thank you for watching! : )
@sharatchandra9198
@sharatchandra9198 8 месяцев назад
Excellent video
@dm4945
@dm4945 2 года назад
Awesome video man. Keep up the good work. Lots of love and support. ♥️
@irtizahafiz
@irtizahafiz Год назад
Thank you! Will do! Appreciate it.
@basheedahmed1662
@basheedahmed1662 2 года назад
What is the default delivery method in Kafka if there is any ?
@irtizahafiz
@irtizahafiz 2 года назад
I believe it's "at-least-once". But you can easily configure it to whatever you like.
@dansinn
@dansinn 2 года назад
Good
@ayeshasiddiki916
@ayeshasiddiki916 2 года назад
So helpful
@corsidenMSU
@corsidenMSU 5 месяцев назад
Very clear, thank you!
@irtizahafiz
@irtizahafiz 5 месяцев назад
Great to hear!
Далее
Stream Processing 101 | Basics
10:17
Просмотров 10 тыс.
Find Nearby Friends | System Design
27:11
Просмотров 4,9 тыс.
Apache Kafka in 6 minutes
6:48
Просмотров 1 млн
Design YouTube | System Design
40:20
Просмотров 6 тыс.
Design A Scalable Notification System | System Design
28:23