Hello, this series is just a diamond on RU-vid and I feel very sorry for the lack of views. But still hope that you keep the motivation on conducting. I have a question that is the kafka cluster docker file in the kafka cluster video still work for this streaming? Let make this question more beginer is that if I want a cluster like 1 master and 2 worker notebook node for analysis for a very much input data, how can I change the docker file to handler this. Hope hearing from you soon!
Hello, Thank you so much for your kind words. You can do your part by sharing the content with your network over LinkedIn. In order to work with Kafka cluster you can use this docker compose file to set up a kafka cluster in your docker env (github.com/subhamkharwal/docker-images/tree/master/kafka-cluster). Once done you can create a docker network bridge to connect your kafka-cluster to pyspark jupyter notebook container for use. Checkout this link: www.tutorialworks.com/container-networking/ Let me know if you still face issue.
