Kafka Installation & Setup | Zookeeper Installation & Setup | Apache Kafka Tutorial in Hindi|Video 3

Подписаться 8 тыс.

Просмотров 96 тыс.

50% 1

This video goes through step by step process of How to setup Single Node Kafka Cluster and Single Node Zookeeper Cluster(Standalone Zookeeper) on your local machine, along with validation process.
Find below the commands to install NetCat utility tool(For OSes supporting 'yum')
yum install -y net-tools
yum install -y nc
Find below the link to previous video.
• What is Kafka | Messag...
Find below the link to Kafka tutorial series Playlist.
• Apache Kafka Tutorial ...
Find below the official documentation of Apache kafka -
kafka.apache.o...
I graduated from IIT BHU Varanasi and currently work as a Software engineer with a MNC company.
MIC :- amzn.to/34Z12rr
TRIPOD :- amzn.to/3FxFI91
LIGHT STAND :- amzn.to/322VXNr
Green Curtain :- amzn.to/3KdKbB6
Connect with me on LinkedIn.
/ brijeshgupta96
Connect with me on FaceBook.
/ brijesh.iitbhu
Connect with me on Instagram.
/ brijeshgupta__

Опубликовано:

15 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 135

@jasper5016 2 года назад

Brother you are fantastic. You simplified the difficult topic like Kafka. Lots of respect. If you can get other stuff like Docker or Kubernetes, it would be greatly appreciated.

@Rajnish089 4 года назад

Guptaji mai fan ho gya aapka details explanation ka.. awesome bhai.. keep on posting viedos

@BrijeshGupta 4 года назад

Thank you so much 😊

@naruto5437 8 месяцев назад

only videos that helped me with kafka ....appreciate top quality content and efforts you put in

@curtdudeanmol9393 3 года назад

quite underrated , you deserve more

@BrijeshGupta 3 года назад

Thanks for this 😊😊😊😊

@rensraks2007 2 года назад

Best Kakfa tutorials on youtube - Thanks Brijesh. You make these topics looks very simple.

@BrijeshGupta 2 года назад

Glad you liked it 😊

@garimachaudhary9248 2 года назад

Excellent and awssome job, Great video on Kafka

@jivanmainali1742 4 года назад

for window user just type ./zkServer.cmd inside of zookeeper folder/bin.No need to add start at the end to test port 2181 simply do: telnet localhost 2181 but make sure your telnet is enabled default which you can do by going to control panel ->program ->turn windows features on & off and search for telnet client and tick checkbox .

@ashibindal6644 3 года назад

Thank you jivan for this info , adding on to it if you want to change port of zookeeper because my 8080 was already in use and its creating error. Just add another line in zoo.config "admin.serverPort=8081" . And you are good to go. To check already running ports in windows , prese Ctrl+R ->type "resmon.exe" -> Nertwork -> Listening Ports

@rkshbhgt 3 года назад

I had enabled telnet as you suggested but in CMD screen after telnet commands I am not seeing anything as response.

@jivanmainali1742 3 года назад

@@rkshbhgt yes telnet behave this way

@rishikesharora8681 3 года назад

@@jivanmainali1742 then how would we get to know, whether zookeeper is running or not?

@venuinbox 2 года назад

Brijesh, Thanks a million. I am from MQ/IIB background and now I got a job in Kafka - just in time I found your channel. This is what I need to quickly show how things are done . Your explanation is very clear and to the point. Can you suggest if there is a similar course or channel for Kafka on Confluence could . My job needs Kafka on Confluence.

@badarali3714 2 года назад

Thanks for such amazing Playlist. Keep it up. Love from Latvia.

@pawankumar-ez9mf 3 года назад

You are awesome bro, This is the besr tutorial that i have ever seen, the way you explain thing even the smallest details its really great

@BrijeshGupta 3 года назад

Glad it helped you Pawan. 😊

@ron6107 4 года назад

Bhai plz cover the topic of microservices in a playlist where you explain how to do a comple lifecycle in cloud like writing code in Java using Spring Cloud and deploy it on AWS/Azure, then how Swagger and Jenkins are used with it. This will be an instant superhit. Fronend k to bahut videos hain par backend mein kuch khaas nahin hai. Great work, keep it up brother.

@BrijeshGupta 4 года назад

Sure brother. I have planned that too. I'll try to upload them at the earliest. Thanks a lot for the suggestions 😊😊😊😊

@DeveshKumar-tj2rs 7 месяцев назад

You are really good teacher best wishes for your future.

@arundhakad1575 3 года назад

Thank you so much sir. You just cleared my concepts.❤️ I am new to these things and found them like hell. Now understood each concept from your ppts Hats off to you

@BrijeshGupta 3 года назад

Glad to hear that. All the best for your future learnings Arun 😊

@satishkumargupta5007 3 года назад

Nice video brother..... It's very usefull for apache kafka

@BrijeshGupta 3 года назад

heyy, thanks brother

@pushpendrakumarrawat5424 3 года назад

Awesome series on @pache kafka

@BrijeshGupta 3 года назад

Thanks a ton 😊

@ramum4684 3 года назад

Such effective content bro but u made it in Hindi. But I don't know hindi bro. Pls made hereafter in English bro Thank you

@BrijeshGupta 3 года назад

I m trying to put as much english keywords as possible, I wanted to make it a Hindi tutorial series. Will try my best to mould it towards english. thanks for appreciation brother 😊😊

@fahadnoor2579 Год назад

Hi Brijesh, Thank you for an awesome series on Kafka. I cannot able to start zookeeper on windows 11. If possible can you please add steps to start zoo keeper for windows as well? It will be helpful for other windows users well. Thanks a lot in advance.

@smrutiranjannayak9449 10 месяцев назад

you are great

@BrijeshGupta 9 месяцев назад

Thanks

@sudhirbhingarkar8438 3 года назад

Excellent work. Thanks a lot

@BrijeshGupta 3 года назад

Glad you liked it

@prashantkatiyar4858 3 года назад

i am promoting your channel bro ... it is really outstanding ... could not ask more :)

@BrijeshGupta 3 года назад

Much appreciated!, It'll be great help brother. 😊😊😊

@ajinkyagadkariajju Год назад

Hi Brijesh, thank you for sharing such amazing content. If possible please make videos on kubernetes and docker.

@anupamdungdung9417 7 месяцев назад

Thanks for the in-depth tutorial!

@minimo6805 3 года назад

Very informative video .I will try to complete the series within a week...... Next target is microservices.... Please share micriservices link.. Thank you sir 🙏

@saveplanet3977 4 года назад

Superb explanation, really good

@BrijeshGupta 4 года назад

Thank you 🙂

@manojrout6537 28 дней назад

nice explanation

@rameshakustagi5189 Год назад

Very good video series, very useful. Please upload code to Git and share

@krishnamurty2501 Год назад

Great description

@gauravgupta1203 4 года назад

Great video! Really helpful

@nitishbhardwaj2053 4 года назад

You are awesome bhai

@BrijeshGupta 4 года назад

Thanks brother 😊😊

@jalandharbehera2456 Год назад

Please make video that how to add additional property to execute this command so please 🙏🙏

@user-mg6dm9lr1w 13 дней назад

Shandar

@learnings.academy 3 года назад

Excellent work Boss

@BrijeshGupta 3 года назад

Many many thanks 😊

@vikashkumarchaurasia1299 3 года назад

thanks for excellent content !! could u please also make some tutorial on Apache Flink. waiting for next tutorial series on Flink . please make it sir

@KapilDeoAWS Год назад

Hi Brijesh, Thanks for your videos with such informative way. I was trying to install kafka 3.5.1 but as there was no info about zookeeper version, I referred to kafka's previious v 3.5.0 release notes and they mentioned about the zookeeper vApache ZooKeeper 3.6.4 which itself is ended up in 30 dec 2022. So could you please help me to know the version of zookeeper if it is really needed for installing kafka latest version Thanks

@asad5921 4 года назад

bhai aap k videos bahut nice hain. Great work. Hum kya kafka Windows mein bhi install and run kar sakte hain kya?

@BrijeshGupta 4 года назад

Thanks Junaid bhai. Yes we can install kafka on windows as well.

@akshaynandurkar8821 Год назад

thank you sir for awesome videos..

@smitamokashe3300 Год назад

Excellent , can you please share steps for windows for ZK and kafka installation

@rahulg8002 3 года назад

Short and sweet 👍

@aiswaryaprasad2028 3 года назад

Great video

@BrijeshGupta 3 года назад

Thanks!

@rdgaikwad26 4 года назад

bhai video banana band mat karna thoda time lagega viewers badhamne me par, but consistency or persistency agar maintain ki to jarur viewers badege.

@BrijeshGupta 4 года назад

Thank bhai. really appreciate. 😊😊😊

@JARAME_ 2 года назад

Bro is ur Kafka playlist enough to get a job with 2y experience? If not please please provide a resource. Ur reply can help to build my career

@BrijeshGupta 2 года назад

Hi Brother, This playlist is more than enough to get you started on using kafka for your projects. It will definitely be helpful in the interviews.

@Amolinfo 4 года назад

excellent

@user-hn4wm6ud7x Год назад

Great Video. THanks

@parthshah6343 Год назад

Hi Brijesh, Nice explanation, had one doubt. You gave the broker id as 1. But a kafka cluster can have many brokers. How can we have multiple brokers inside the kafka cluster and how can we assign unique broker id to each broker?

@BrijeshGupta Год назад

You can give incremental ids to each broker.

@shivallivashisht1524 4 года назад

Too good thanks

@BrijeshGupta 3 года назад

😊

@Howaboutwhy Месяц назад

Hi Brijesh, i have a doubt. when i run " bin/kafka-server-start.sh config/server.properties " It says "Classpath is empty. Please build the project first" . Please help me out. zookeeper is running fine. issue with kafka.

@guptaashok121 2 года назад

Which command line tool, you are using for demo, could you pleaseprovide that information as well. If there is any separate video on that pls let me know.

@BrijeshGupta 2 года назад

I am using Bash terminal of Macbook

@learnings.academy 3 года назад

Love From Pakistan

@BrijeshGupta 3 года назад

Grateful that my content is viewed in neighbouring countries also 😊😊😊

@VinodKumar-gv7cm Год назад

Great job

@osamaazharazhar5167 2 года назад

============================================ 0:09 Contents 0:41 What N Why (past Lecture Summary) 1:35 How ? (Implementation) 2:47 Kafka Installation guide 4:00 ZooKeeper downloading guide 5:35 Zookeeper Setup 6:30 Create zoo.cfg file 8:39 Run zkServer 10:20 Validate that Zookeeper has started or not 12:00 - 12:20 Stopping/starting Zookeeper command 13:00 start/stop Kafka Server 13:12 Need to edit "server.properties" 15:55 execute kafka server "bin/kafka-server-start.sh config/server.properties" 16:24 validate on zookeper if kafka Server has started successfully - > 16:35 How to stop broker ? (STOP kafka) 18:35 to check wheres the kafka log resides (logs --> server.log) =============================================

@gautamprusty5336 2 года назад

Hi . I have installed and setup zookeeper and Kafka. Why it is occupying more RAM space even it is less massage. Can you please suggest?

@ankitgupta6697 3 года назад

Hi brijesh, When I am using brokerid = 1 kafka server is stopped after executing few lines. Can you tell me why so. While in your case its working perfectly. I have done some mistake?

@jalandharbehera2456 Год назад

Could we download Kafka and zookeeper on the same server or different different servers....so please tell sir 🙏

@pj-nz6nm Год назад

Hey i am a python user don't know java can i follow these lectures?

@BrijeshGupta Год назад

Yes you can. Very minimal usage of java in the whole playlist

@priyanshijain2693 Год назад

I am not able to run Kafka server on windows 10 getting wmic is not recognised as internal or external command, please help

@mdtaufiquereja3114 4 года назад

super bro

@BrijeshGupta 4 года назад

Thank you so much 😊

@KrishnaKumar-om5hv Год назад

Bro how can I run sh command in windows to install kafka ? And what yellow coloured cmd you're using ?

@thumarmitesh6559 4 года назад

Thank you ☺️

@BrijeshGupta 3 года назад

You’re welcome 😊

@deepuShivansh2612 2 года назад

Is it a full course in your playlist sir

@ravimohansingh8520 2 года назад

How to expose them outside the k8

@abdulhameed9092 Год назад

when I'm starting Kafka server it returns error : Error: Could not find or load main class kafka.Kafka

@shivallivashisht1524 4 года назад

Thanks

@BrijeshGupta 3 года назад

Welcome

@shivakant4698 2 года назад

Please tellus place where should install zookeeper and kafka.

@shubhamchouksey9904 3 года назад

What are the configurations to be changed to connect to remote Kafka server

@BrijeshGupta 3 года назад

in your clients, just change bootstrap server and if kafka server is using and security protocol then u need to configure that as well

@meharajfareedy6031 Год назад

Hi Brijesh - I am getting following error org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 1 larger than available brokers: 0. How to solve it?

@janvijays4-yrb.tech.comput988 4 года назад

👏👏👏

@SK-up9ew 2 года назад

Bro..Archives ka kya mtlb ?

@vik5999 4 года назад

Hi Brijesh, Do you provide trainings? i am looking for some help for my project and would be happy to discuss it. Thanks.

@fxinvestmenttm3416 4 года назад

I can help. U can reach out to me @7036416840

@padmesh5036 2 года назад

problem in running kafka server its showing Classpath is empty. Please build the project first e.g. by running './gradlew jar -PscalaVersion=2.12.10'. ????

@mastifulltime6299 2 года назад

How to enable ACL (Access control list) for all nodes in zookeeper?

@BrijeshGupta 2 года назад

you can use the below link data-flair.training/blogs/zookeeper-acl/

@pawankumar-ez9mf 3 года назад

Beside kafka do you have any other tutorials series?

@BrijeshGupta 3 года назад

I am planning to resume Docker series

@pawankumar-ez9mf 3 года назад

@@BrijeshGupta that will be great, waiting for your next tutorial series

@rohansharma8731 3 года назад

Op❤️❤️❤️

@BrijeshGupta 3 года назад

GOAT 😄

@ashokaj4110 3 года назад

My zookeeper is up and running properly but when i start kafka i am getting error: could not find or load main class kafka.kafka some one please help me with it. At first i was executing using windows, but i could not follow 3 node cluster zoo keeper set up with windows, now i have vm with ubuntu in it, installed java zookeeper and kafka, after all these efforts i am getting the above said error. Some one please help me i have apache-zookeeper-3.5.7 and kafka 2.13-2.5.0

@vishalgupta957 Год назад

Where can i find these commands for windows like for netcat and all, anyone ??

@jivanmainali1742 4 года назад

sir can we set environment variable to access zookeeper from anywhere in terminal

@BrijeshGupta 4 года назад

You can run zookeeper as a service. By doing that, You can manage zookeeper from anywhere in the terminal.

@harshitabamb8657 3 года назад

Kafka installation comes with an inbuilt zookeeper, then why there is a need to install it seperately?

@BrijeshGupta 3 года назад

According to Kafka Documentation - inbuilt zookeeper provided by kafka should only be used for the local testing purpose, definitely not for production purpose

@neerajverma9226 3 года назад

Kafka is similar to Aws Kinesis or different?

@piyushmishra889 2 года назад

is kafka codebase written in Scala?

@BrijeshGupta 2 года назад

Java and scala

@jivanmainali1742 4 года назад

for windows you can test port : test-netconnection -port 2181

@rajdeepsinghborana2409 4 года назад

Sir help me how can I install Hadoop setup Cloudera HDP on windows 8.1

@kausthubchar3166 3 года назад

When I run the below command to start kafka server: bin/kafka-server-start.sh config/server.properties I get an error saying: Classpath is empty. Please build the project first e.g. by running './gradlew jar -PscalaVersion=2.12.10' I tried running the above command but it says "bash: ./gradlew: No such file or directory". I tried searchinh in goolge also but to no issue. Any suggestions on this what might be the issue?

@krsnabnsl Год назад

Getting same error, I don't know, how to solve

@rushikeshphalke6894 3 года назад

Can you give Kafka Broker how much?

@rahulpanjwani1887 4 года назад

bro nc is not recognised as a command on windows. can u help??

@BrijeshGupta 4 года назад

Rahul please try this for windows, To test port 2181 simply run the command: "telnet localhost 2181" And make sure your telnet is enabled default which you can do by going to control panel ->program ->turn windows features on & off and search for telnet client and tick checkbox. Thanks to @Jivan Mainali for this information. I hope this helps.😊😊😊

@hemanshusingh5383 3 года назад

brO! hELP ME OUT! i am not able to run zookeeper in windows . Trying to run windows cmd file only . :(

@pankajverma3096 3 года назад

kafka_2.13-2.7.0 is not using zookeeper anymore

@nagarajumuthyala5798 2 года назад

Please add captions in English

@yashsahu424 3 года назад

Bhai HomeBrew se kar lete :P

@BrijeshGupta 3 года назад

I didn't want anyone to use any additional software package

@mjj3tube Год назад

Bro - I am seeing this issue when i try to run the windows command file ,could you please help-2023-01-26 16:47:52,400 [myid:localhost:2181] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1244] - Socket error occurred: localhost/0:0:0:0:0:0:0:1:2181: Connection refused: no further information

@anirudhjaiswal1280 2 года назад

Kafka is not getting strated it gives -> [2021-11-12 18:38:37,910] ERROR Shutdown broker because none of the specified log dirs from E:\tmp\kafka-logs can be created or validated (kafka.log.LogManager) zookeeper version: 3.5.8 kafka version 3.0.0 with scala 2.13

@BrijeshGupta 2 года назад

This is because the permission to create directories is not there. You can change the log dirs location and try