Apache Kafka® Producer Example using SpringBoot 3.x | Java Techie

Подписаться 167 тыс.

Просмотров 50 тыс.

50% 1

In this tutorial, we will be creating a simple Kafka Producer using Spring Boot 3.0 and will understand below key points
👉 Default topic create by Spring Boot
👉 How to handle the results asynchronously in kafka producer
👉 How to create topic programatically
👉 How messages will be distributed to multiple partition
👉 Offset Explorer to visualise kafka events
#JavaTechie #SpringBoot #Kafka
Spring boot microservice Premium course lunched with 70% off 🚀 🚀
Hurry-up & Register today itself!
COURSE LINK : javatechie5246.ongraphy.com/
PROMO CODE : JAVATECHIE50
GitHub:
github.com/Java-Techie-jt/kaf...
Blogs:
/ javatechie
Facebook:
/ javatechie
Join this channel to get access to perks:
ru-vid.comjoin
guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community ,
you are free to use source code from above mentioned GitHub account

Наука

Опубликовано:

6 июл 2023

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 87

@pottendlanagma7263 13 дней назад

very clear and concise explanation. Keep Rock!

@MrOpolo91 10 месяцев назад

Great series! Thanks for your very detailed and clear explanations... Keep it going!

@umeshsharma2883 6 месяцев назад

Very creative and helpful video anyone can understand. I went through many articles and videos, and I was very confused, and my thought was Kafka is very big and very vast. But by watching this video I am full cleared on Kafka concepts.

@nomadicmayank6120 9 месяцев назад

Hi Basant, thank you for sharing kafka series. I apricate your efforts

@deveshagarwal660 3 месяца назад

Really helpful, detailed and amazing video. Keep up the good work brother.

@gopisambasivarao5282 10 месяцев назад

Great tutorial on Kafka. Appreciate your efforts, Basant.

@ChandlerBing11 10 месяцев назад

Java Techie, we miss you so much!!!

@pulkitkaushik4539 11 месяцев назад

Hi Basant, Your videos helped immensely during the interview prep time and it helped to get a decent job as Senior Software Engineer... many thnaks to you !!

@Javatechie 11 месяцев назад

Glad to hear this buddy 🥰. Thank you so much keep learning

@FeliksBekeshov 4 месяца назад

send to Basant, at least some percent of your salary bro , he is doing it for free! )

@Javatechie 4 месяца назад

hey buddy, I get you're joking, but I truly enjoyed the appreciation from you guys, which means more to me than money.

@GunelMammadova93 2 месяца назад

Thank you for your videos! They are super helpful

@bakdaulet_13 2 месяца назад

Amazing tutorial, thank you bro!

@amarnatha1614 10 месяцев назад

Very nice explanation, Thank you sir.

@tanishmanas1011 3 месяца назад

Great.....God Bless you !!!!

@sergiogb 10 месяцев назад

Great video, thanks!

@sharmarahul17 5 месяцев назад

Excellent video!

@user-vj7fu5hz4n 4 месяца назад

This is awesome !!!

@mubarakahmed9060 11 месяцев назад

Great knowledge sharing. Hope we can see multithreading consumer tutorial

@Javatechie 11 месяцев назад

Yes i will cover that with consumer group don't worry

@user-vj7fu5hz4n 4 месяца назад

This is awesome

@pitumalkani 4 месяца назад

Hello @Java Techie, thank you for the amazing content , it is quite easy to understand. I have few queries, 1. What is the importance of replicationFactor? 2. How the kafka setup ensures delivery of message in case when consumer application is down? 3. Is it possible to create the topics from docker-compose.yml files?

@akshaykumarr7541 10 месяцев назад

Please post a video for setting up the consumer for the same. Amazing video

@Javatechie 10 месяцев назад

Sure buddy that will be my next video.

@carlpei6570 8 месяцев назад

👍 thanks

@cloud_Engineer 6 месяцев назад

How it will behave when multiple instance of application are launched?? It will create different topics or adhere to same topic??

@PradeepKumar-sx6ms 9 месяцев назад

Event Streaming with huge data reading and writing

@anilmanuka2052 10 месяцев назад

How to listen the Kafka consume with some intervel time when producer send the data to the kafla server

@rohitmanohar2733 9 месяцев назад

Loved ur video, sir can u please make a video of inter service communication in spring Microserverices with real time example using kafka

@Javatechie 9 месяцев назад

Buddy i have done the same in the cqrs design pattern please check that

@Vikusoun1 10 месяцев назад

Hi Basant Thank you for Kaka tutorial. Learned a lot from you in the fast. I have few queries 1. How can we create multiple topics programmatically? With @Bean we can create only topic at a time 2.. If topic already exist, it throws exception. How can we skip topic creation if topic already exist. 3. Does it creates new thread for each message send?

@Javatechie 10 месяцев назад

First and Two questions are quite interesting i will check and update you but regarding the 3rd one it won't execute by a separate thread message will concurrently be distributed to multiple partitions but to get those messages you need to implement multi threading in the consumer part . You can even use the Executor service in the producer itself

@ramanav3139 2 месяца назад

can you please explain Kafka clustering topic using spring boot if possible

@SurajKumarSingh93 5 месяцев назад

Thanks for this nice video, I have configured offset exproler but for me instead of actual message it showing hascode of message

@Javatechie 5 месяцев назад

Okay just click on topic and change the type to string instead of byte

@ravi.m4954 10 месяцев назад

Hi Basant, thanks for knowledge sharing.can you post video on replication factor other than one and how it will behave and in this case duplicate messages will be received by consumer or not

@Javatechie 10 месяцев назад

I will do that buddy

@raghu101982 8 месяцев назад

please share the link of the 1st video. Thanks

@devaamujuri5998 10 месяцев назад

Hi This is not related to this video but in General I Want to know is that Mac Air laptop will supports our all Java tools? or we need Mac pro ?? I want to shifting from windows to Mac. I need AI ,ML tool Supper as Well. pls suggest

@Javatechie 10 месяцев назад

No i am using a Mac desktop with custom congratulations 16 GB . You can use a Mac pro laptop with the latest configuration to play with ai

@rnages1921 8 месяцев назад

I owe you a drink.

@kishore87jetty 4 месяца назад

Have a quick question: if you are capturing the result into an object after sending, isn't that mean the thread will wait for result to come and it is still hampering the performance of the app ?

@Javatechie 4 месяца назад

It will just capture metadata of your records nothing else so I don't think it will impact anything on performance

@Suryanarayan094 4 месяца назад

20:09 In my scenario my data stored only partition 2. No data stored in partition 0 & 1. Why ?? @javatechie

@Javatechie 4 месяца назад

Try 2 or 3 times again it will store messages to different partition. Please check in video i mentioned why okay

@Suryanarayan094 4 месяца назад

@@Javatechie Thanks Sir. I got it.

@rajenderprasad1193 10 месяцев назад

Hi Basant. I have a question. We have already used KafkaTemplate and it is creating the topic if topic is not already created. Why do we need to again use NewTopic bean and pass the topic name in KafkaTemplate instance. Pls explain. Thanks

@Javatechie 10 месяцев назад

Rajendra correct Kafka will create the topic but with default configuration like 1 partition and replication factor so if you want to customize it then you need to create topic by your own either using terminal or programmatically

@rajenderprasad1193 10 месяцев назад

@@Javatechie oh okay. Thank you 🙏🏻

@saurabhsuradkar1626 4 месяца назад

How do you set idempotence= true for producer?

@knageswari6020 4 месяца назад

Hi Basant can you please tell me how can we integrate Kafka instead of active mq with spring boot

@Javatechie 4 месяца назад

This is a Kafka integration example only right? What are you looking for?

@smtad229lad Месяц назад

Do you have offset Explorer license to use it for the educational purpose? It is not free to use for educational purpose as mentioned on its website. Just brining to your notice.

@Javatechie Месяц назад

It's open source and free

@smtad229lad Месяц назад

@@Javatechie This is what is mentioned on its website Offset Explorer is free for personal use only. Any non-personal use, including commercial, educational and non-profit work is not permitted without purchasing a license. Non-personal use is allowed for evaluation purposes for 30 days following the download of Offset Explorer, after which you must purchase a valid license or remove the software

@Javatechie Месяц назад

Not sure then, there might be some changes but it's installed on my machine from past 2 years and software didn't force me for any licence

@akasheditz6754 10 месяцев назад

Sir if you don't mind please mention the link of microservice playlist taught by you...

@Javatechie 10 месяцев назад

Please go through it Microservice: ru-vid.com/group/PLVz2XdJiJQxxWhFkucZBoMxeYE6qTgEF8

@anketpatel2312 10 месяцев назад

Hello Sir,, Here Topic 'java-techie-demo-3' will be created only If it is not exist already. Right?

@Javatechie 10 месяцев назад

Yes correct 👍

@kishore87jetty 4 месяца назад

Also looks like the messages in kafka are getting encrypted by default, I dont see actual message in offset Explorer. Is ther a way to get plain message in kafka topic

@Javatechie 4 месяца назад

No in offset you need to change the data type to json or plain text in topic itself

@AshishRohillax 10 месяцев назад

Hi Basant, How do you get yml intellisense on intellij ?

@Javatechie 10 месяцев назад

I believe it's by default available in the community edition but not sure whether I add any plugin or not. Can you check the plugin name spring boot assistant

@jaripatidevendra6172 10 месяцев назад

Can you make video on spring boot jdbc template Mapsqlparametersource with stringutils and string builder using sql queries please

@Javatechie 10 месяцев назад

Okay i will do that

@sunnysingh7854 4 месяца назад

Hello everyone, I am constantly gettinig the below given error: Required type: CompletableFuture Provided: ListenableFuture everytime I try declaring future variable

@Javatechie 4 месяца назад

The return type is incorrect just use your ide to get the correct return type brother

@sunnysingh7854 4 месяца назад

@@Javatechie hello brother, I tried but I'm not getting the option to use completable future in java 11. I am using Intellij

@Javatechie 4 месяца назад

@sunnysingh7854 please share your code in GitHub.com

@tayfunslife 10 месяцев назад

How can we send events in to same partition rather than round robin. Because there is order in partition but no order among partition how we provide order by sending same partition.

@Javatechie 10 месяцев назад

Yes I will cover that

@user-lv5ck6zz9o 9 месяцев назад

sir i have issue to download Offset Explorer for Ubuntu system can provide .sh file

@Javatechie 9 месяцев назад

No it's a simple DMG file for me I just need to install it

@rishiraj2548 10 месяцев назад

🙏👍

@lokeshswamy4440 11 месяцев назад

The next part is expected soon..maybe today 😅.. thanks

@Javatechie 11 месяцев назад

I will try to do it soon

@astar4782 10 месяцев назад

Hi ..you have missed a crucial point as to how to distribute the messages among partitions using Kafka custom Partitioner

@Javatechie 10 месяцев назад

I will do that buddy along with read and write part

@user-io4mf6rr9i 3 месяца назад

how to start Zookeeper and kafka on windows

@vladstarichenko4937 10 месяцев назад

I was confused by the fact that not all messages were sent to the topic, when I'm trying to see the data only 100 messages are in presence. The reason is that you need to specify the number of messages you wanna see, hope this helps beginners not search for errors

@Javatechie 10 месяцев назад

No it should send all the messages. Check the total message count in each partition

@vladstarichenko4937 10 месяцев назад

@@Javatechie Everything is working well, as I said I couldn't see all the messages as there was a limit for messages that can be shown (in offset explorer)

@Javatechie 10 месяцев назад

@@vladstarichenko4937 it's a free tool buddy if I will send 1000 message still it will show max 100 message in app so better to check in each partition level message count