Тёмный

What is Apache Kafka & Apache Kafka Publisher Example using SpringBoot | Java Techie 

Java Techie
Подписаться 183 тыс.
Просмотров 97 тыс.
50% 1

Опубликовано:

 

27 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 101   
@TheJerrytaurus
@TheJerrytaurus 5 лет назад
Basant sir, can you also cover the Sync and Async send options with Future and Callbacks? Your way of explanation is very easy to grasp. Keep up the good work.
@Javatechie
@Javatechie 5 лет назад
Thanks Jerald .sure will try it
@kannadhasanchinnaiya4784
@kannadhasanchinnaiya4784 Год назад
@@Javatechie Is it done, if so, please share the link
@abhijitprusty
@abhijitprusty 3 года назад
You should start being a instructor on udemy and other platforms, you will rock :)
@Javatechie
@Javatechie 3 года назад
Thanks buddy 😁
@Sharanya139
@Sharanya139 3 года назад
Awesome resources on apache Kafka for beginners
@mahalingamsunthar7602
@mahalingamsunthar7602 5 лет назад
Respected My dear friend .Thanks for your spring boot video tutorials.
@md.ashrafulkarimrokon7540
@md.ashrafulkarimrokon7540 4 года назад
Expecting video for spring cloud config server(Producer) >> apache kafka >> any spring boot application as consumer
@raghavendraakula5169
@raghavendraakula5169 4 года назад
Hi, It is very useful session, got a clear idea on Kafka and it's usage. Thanks a lot.
@krishnasuripaka2480
@krishnasuripaka2480 2 года назад
Hello Bro Excellent Info about kapka...
@ankitgiri6874
@ankitgiri6874 2 года назад
Thanks for the videos, :)
@DHA508
@DHA508 3 года назад
Thank you,great introduction
@SohailKhan-gu2du
@SohailKhan-gu2du 3 года назад
Hey man.... U r very knowledgeable.. Can u create some. Complex apps... Using spring boot.. Kafka.. Multi threading n all.... Like handling huge traffics of request... Apart from this simple crud apps
@Javatechie
@Javatechie 3 года назад
Checkout my saga choreography implementation. You will find real Kafka implementation
@SohailKhan-gu2du
@SohailKhan-gu2du 3 года назад
@@Javatechie thanks man for replying ♥️.. Appreciate it a lot... I'm a junior Java developer and want to advance further down this line
@prageethjayasinghe709
@prageethjayasinghe709 3 года назад
Simple and easily understandable. Thanks.
@srinivasamovva2735
@srinivasamovva2735 Год назад
You are so cute Bro...We all greatful to you
@amanabhishek8998
@amanabhishek8998 3 года назад
Thanks for this vide helps to understand. Can u make a video on real time application as u already done the project video on microservices. Where exactly we use this kafka in microservices. In the interview this question is asked again and again.
@Javatechie
@Javatechie 3 года назад
Usually when upstream want to connect any down stream without blocking api response we must need to implement Kafka messaging system
@amanabhishek8998
@amanabhishek8998 3 года назад
@@Javatechie understood but i would request if u include one video in spring cloud project , it helps to explain in the interview, when we are explaining the architecture in the interview. Hope u understand
@manishdadheech8440
@manishdadheech8440 3 года назад
Hi Basant nice video. Can you please tell Here 1st time while producing string object we didn't configure Kafka producer factory. that time how did spring application connected with Kafka broker.
@Javatechie
@Javatechie 3 года назад
For string if you check in configuration I added StringDesrializer
@md.ashrafulkarimrokon7540
@md.ashrafulkarimrokon7540 4 года назад
Thanks . Really comprehensive tutorial.
@sudheerkumar-tp1mg
@sudheerkumar-tp1mg Год назад
Basant sir Kafka industry standards implementation using Kafka template or binders please suggest
@foodgallery5819
@foodgallery5819 Год назад
Thank you :)
@mintybreez
@mintybreez 4 года назад
Really helpful, thankyou
@rajjaiswal2050
@rajjaiswal2050 3 года назад
Really very thankful to you ,this is the exact that i searched on you tube .I have one query here how I picked status of based on orderid in topic ,suppose i publish orderid 101,order id 102 so after payment service task done and publish ,now order need to status of orderid 101 so how it filter .
@Javatechie
@Javatechie 3 года назад
Raj can you please check my saga choreography implementation video . that is what your exact answer
@rajjaiswal2050
@rajjaiswal2050 3 года назад
@@Javatechie Thanks bhai ,reply me its first time for me and exciting that you reply me.
@veerrajumandavilli9114
@veerrajumandavilli9114 2 года назад
Kafka Template was created from the first API and what is the use of Kafka producer factory. I didn't see where it was used? Can you please explain
@Javatechie
@Javatechie 2 года назад
This is a factory class to set up your producer class buddy
@veerrajumandavilli9114
@veerrajumandavilli9114 2 года назад
@@Javatechie Understood.. Thank you
@sriaya1743
@sriaya1743 6 лет назад
Hi besant, nice video but just want to know one thing like what is avro role in Kafka can you please use avro serialization/de-serialization in next tutorial. Thanks
@Javatechie
@Javatechie 6 лет назад
Avro am not aware on it .will check nd let u know
@sriaya1743
@sriaya1743 6 лет назад
Thanks basant
@prateekashtikar8631
@prateekashtikar8631 3 года назад
Could you please create tutorial on reactive kafka?
@Javatechie
@Javatechie 3 года назад
Okay sure I will
@debagchi1
@debagchi1 5 лет назад
Good one
@rajasekharrsm3244
@rajasekharrsm3244 2 года назад
where are we configuring the kafka server details for spring boot, how the spring boot application knows the details of the kafka server. if i want to connect with the kafka server that is not running on my local, where should i configure them?
@Javatechie
@Javatechie 2 года назад
Created one config class and inside @Bean we configured all required props
@ranjandas7891
@ranjandas7891 3 года назад
@Java Techie This Video content not showing, Plz fix this issue .I want to learn kafka from your video only.
@Javatechie
@Javatechie 3 года назад
What error you are getting . I can view this content
@ranjandas7891
@ranjandas7891 3 года назад
@@Javatechie Now I am able to see video content.Thanks for your support Sir. We are preferring your videos only. Upload gradle related projects also. Wish u Happy and safe Diwali Sir 🎉🎉 🎉
@raghavendraakula5169
@raghavendraakula5169 4 года назад
Hi Besant, is there any session covered with Spring Batch along with Apache Kafka, could you please suggest.
@Javatechie
@Javatechie 4 года назад
No not yet , can you mentioned your scenario so that I can give a try
@raghavendraakula5169
@raghavendraakula5169 3 года назад
Hi Besant, delayed in my response. The actual requirement is by using Spring Batch, read data from DB and prepare JSON object to it. And then write the data into another DB. This implementation needs to be in a Scheduler approach. Could you please suggest the approach.
@vidyaramteke9657
@vidyaramteke9657 3 года назад
Hi sir, I tried kafka producer code, but I don't see my msg getting printed on consumer console... do I need to write consumer code also to get them printed, my code has no exception where as isdone method returns me false does that mean my msg is not produced ?
@Javatechie
@Javatechie 3 года назад
You can directly check in kafka console command without consumer
@simashpokharel6044
@simashpokharel6044 3 года назад
Hi Basant , I really like all your video. Is there a UI dashboard for apache kafka like we have one for rabbit MQ ? if there is then how do i access it ?
@Javatechie
@Javatechie 3 года назад
Hi Simash , Please use below tool www.kafkatool.com/
@sanketh768
@sanketh768 2 года назад
Can we create topics via Kafka UI ? Like aws provides UI to manage queues
@Javatechie
@Javatechie 2 года назад
Yes there is something called lenses tool which will give you ui for Kafka
@sanketh768
@sanketh768 2 года назад
@@Javatechie could you please make a demo video on this tool
@Javatechie
@Javatechie 2 года назад
Sure will do.you can also use Kafka tools check i used it in saga video
@kundanranjan3737
@kundanranjan3737 5 лет назад
Hi when i am using thiszookeeper-server-start.bat C:\javajars\kafka\kafka-1.0.1-src\kafka-1.0.1-src\kafka-1.0.1-src\config\zookeeper.properties command getting issue like class path is empty please build the project first. plse help on this issue
@lssinha5147
@lssinha5147 4 года назад
Can you please upload video to Consuming Messages from a Specific/multiple partitions along with Message Filter for Listeners
@Javatechie
@Javatechie 4 года назад
Will try this 👌
@monalisakushwaha2517
@monalisakushwaha2517 4 года назад
Hi Sir, Can you tell me about this.On trying to up the zookeeper server, i am getting this message. C:\Users\ADMIN\Desktop\kafka-1.0.1-src\bin\windows>zookeeper-server-start.bat C:\Users\ADMIN\Desktop\kafka-1.0.1-src\config\zookeeper.properties Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll'
@Javatechie
@Javatechie 4 года назад
Did you download proper Kafka binary distribution
@monalisakushwaha2517
@monalisakushwaha2517 4 года назад
@@Javatechie i downloaded binary version now..Now I am to start the zookeeper server. But I am not able to start the Kafka server. When I am trying to start it, I am not getting any output. C:\Users\ADMIN\Desktop\kafka\bin\windows>kafka-server-start.bat C:\Users\ADMIN\Desktop\kafka\config\server.properties C:\Users\ADMIN\Desktop\kafka\bin\windows>
@Javatechie
@Javatechie 4 года назад
No it won't return any output You please try to create topic then publish message to topic and verify
@monalisakushwaha2517
@monalisakushwaha2517 4 года назад
@@Javatechie i mean to say that when i am trying to UP the KAFKA server. It is not getting UP. Nothing is displayed.
@Javatechie
@Javatechie 4 года назад
No error ?
@AbhaySingh-ds9et
@AbhaySingh-ds9et 2 года назад
Hi Sir, Can you please show the use of Kafka Manager as GUI so that we can track Kafka activities easily.
@Javatechie
@Javatechie 2 года назад
You can use offset Kafka explorer
@AbhaySingh-ds9et
@AbhaySingh-ds9et 2 года назад
@@Javatechie Any tutorials, link if you can provide will be helpful Sir
@photo_lab4095
@photo_lab4095 3 года назад
Please make a video on kafka stream
@rexsam3134
@rexsam3134 3 года назад
Kafka will loose messages if they are not delivered as compared to JMS JMS has redeliver functionality too If there are more than 1 topics how will you configure the same ?
@devchouhan2436
@devchouhan2436 2 года назад
sir whats the main difference between both of them rabbit mq and Kafka where we have to use among them
@rakeshroshan829
@rakeshroshan829 4 года назад
Hi Basant, is there any dashboard for kafka like rabbitmq ?
@Javatechie
@Javatechie 4 года назад
No I don't think so
@kumaresanperumal2581
@kumaresanperumal2581 2 года назад
hi bro, any real-time example for Kafka spring boot project
@prabhakarkumarnitj
@prabhakarkumarnitj Год назад
How come the producer knew on which port topic is hosted, in order to send the message to the topic ?
@Javatechie
@Javatechie Год назад
That's what we are creating bean
@prabhakarkumarnitj
@prabhakarkumarnitj Год назад
@@Javatechie but even before bean creation message was posted in topic and consumer was able to consume it
@Javatechie
@Javatechie Год назад
No add one sopln statement to check when Kafka template bean is getting initialised . Usually while starting application everything will be pre configured
@AmitKumar-jm5um
@AmitKumar-jm5um 6 лет назад
Thanks Basant...
@AmeyKulkarni-xh5nw
@AmeyKulkarni-xh5nw 3 месяца назад
Are there anuy solutions without zookeeper, like using docker?
@Javatechie
@Javatechie 3 месяца назад
Please refer this ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-EiMi11slVnY.html
@rakeshroshan829
@rakeshroshan829 4 года назад
Hi Basant, what is use of key in KafkaTemplet?
@deepakpareek3014
@deepakpareek3014 6 лет назад
sir, do you have idea that how we will do this kafka in Hadoop environment
@mrvaidya4991
@mrvaidya4991 6 лет назад
Hiii, im getting following error. This application has no explicit mapping for /error, so you are seeing this as a fallback. Tue Jul 31 22:04:17 IST 2018 There was an unexpected error (type=Internal Server Error, status=500). Can't serialize data [com.anusoft.spring.kafka.api.User@2b80adb0] for topic [test-topic]
@Javatechie
@Javatechie 6 лет назад
Hi Nitansh, could you please cross check once your config class ,you might specify wrong serializer and deserializer
@BapunParida
@BapunParida 2 года назад
what is the diference between Topic and all brokers ?
@Javatechie
@Javatechie 2 года назад
Brokers are nothing like a Kafka server where topic is the storage who will keep your message
@kaushikkumar5415
@kaushikkumar5415 Год назад
Hi, Kidly create the above tutorial for mac
@seshukammammettu6384
@seshukammammettu6384 2 года назад
we need to download binary not src. otherwise will get exceptions
@malektubaishat8
@malektubaishat8 2 года назад
can you please enable subtitle as I'm deaf I can't understand much
@titanxs
@titanxs 4 года назад
16:25 -> create topic
@arungore6578
@arungore6578 3 года назад
GEtting below error while running zookeeper- G:\Softwares\kafka-2.8.0\bin\windows>zookeeper-server-start.bat G:\Softwares\kafka-2.8.0\config\zookeeper.properties Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll'
@arungore6578
@arungore6578 3 года назад
Fixed the error .. i had downloaded kafka source zip... Thanks for the tutorial
@ayushgupta-pj5sq
@ayushgupta-pj5sq 2 года назад
if someone facing issues in starting his kafka server then please downgrade your kafka. i face the same issue and downgrade my version of kafka and the problem is resolved.
@حامدنیکبخت-ن5ع
@حامدنیکبخت-ن5ع 2 года назад
hi please add subtitle
@ravimane5508
@ravimane5508 Год назад
I am getting an error when I run - >kafka-console-consumer.bat --bootstrap-server localhost:9091 --topic infy error - java.lang.OutOfMemoryError: Java heap space. [Consumer clientId=console-consumer, groupId=console-consumer-53782] Error connecting to node DESKTOP-G555I86.lan:9092 (id: 0 rack: null) (org.apache.kafka.clients.NetworkClient) java.net.UnknownHostException: DESKTOP-G555I86.lan
@anandmohand1887
@anandmohand1887 2 года назад
Getting this Error while starting zookeeper Error: Could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain
@shaktimaan693
@shaktimaan693 Год назад
D:\kafka\kafka_2.13-3.1.0\bin\windows>zookeeper-server-start.bat D:\kafka\kafka_2.13-3.1.0\config\server.properties [2023-01-15 19:30:27,993] INFO Reading configuration from: D:\kafka\kafka_2.13-3.1.0\config\server.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig) [2023-01-15 19:30:27,998] ERROR Invalid config, exiting abnormally (org.apache.zookeeper.server.quorum.QuorumPeerMain) org.apache.zookeeper.server.quorum.QuorumPeerConfig$ConfigException: Error processing D:\kafka\kafka_2.13-3.1.0\config\server.properties at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:198) at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:124) at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:90) Caused by: java.lang.IllegalArgumentException: dataDir is not set at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parseProperties(QuorumPeerConfig.java:444) at org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:194) ... 2 more Invalid config, exiting abnormally [2023-01-15 19:30:28,004] INFO ZooKeeper audit is disabled. (org.apache.zookeeper.audit.ZKAuditProvider) [2023-01-15 19:30:28,006] ERROR Exiting JVM with code 2 (org.apache.zookeeper.util.ServiceUtils)
Далее
Spring Tips: Spring Boot & Apache Kafka
42:59
Просмотров 25 тыс.
Microservices using SpringBoot 3.0 | Full Example [NEW]
1:25:38