Тёмный

Real-Time Kafka & Spark Streaming Project Demo (Beginner Friendly) 

INFOLEAD
Подписаться 656
Просмотров 3,6 тыс.
50% 1

Опубликовано:

 

27 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 13   
@rodolpheghazal7819
@rodolpheghazal7819 10 месяцев назад
Great content! Keep it up
@JeffersonG-r1e
@JeffersonG-r1e 6 месяцев назад
Thank you very much. Please do more end-to-end data pipeline project demos.
@DeyvidCabral
@DeyvidCabral 3 месяца назад
very good video, gives a good ideia about an use cases of kafka.
@zakariaelaaliji7747
@zakariaelaaliji7747 8 месяцев назад
please what is the version of kafka you have used ?
@roberthuaytacortez8902
@roberthuaytacortez8902 8 месяцев назад
Hi, no show registers in the consumer
@XELTRA1
@XELTRA1 5 месяцев назад
How do you change localhost:9092 to kafka:9092??
@shojibflamon
@shojibflamon 2 месяца назад
Its kafka:9092 for docker container.
@hoanghaang6807
@hoanghaang6807 6 месяцев назад
hello. this is a greate content. However when I reproduce I encounter this bug When I click on and auth jupyter notebook in docker, I not seeing any notebook file, it is empty If I manual upload the code file, when I run it will have error : org.apache.spark.sql.AnalysisException: Failed to find data source: kafka. Please deploy the application as per the deployment section of "Structured Streaming + Kafka Integration Guide".; The code is exec.ipynb from your drive folder. Please help me if can, I am very appreciate
@KrishnanVSBIT
@KrishnanVSBIT 6 месяцев назад
i am facing the same problem is there any solution you found
@quanghieuvu1012
@quanghieuvu1012 10 дней назад
@@KrishnanVSBIT did you solve the problem?
@krishnan828
@krishnan828 9 дней назад
​@@quanghieuvu1012Nope buddy but I suggest u dockerize it and run a docker container instead of doing it locally
@terryyang5254
@terryyang5254 5 дней назад
the same problem, I asked chatgpt and renewed the first part of the code and was able to reproduce:os.environ['PYSPARK_SUBMIT_ARGS'] = \ '--packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.4.5 pyspark-shell'
Далее
Kafka Stream Processing with Python - A Walkthrough
15:06
Kafka + Spark Streaming + Hive -- example
57:34
Просмотров 21 тыс.
Думайте сами блин
18:15
Просмотров 661 тыс.
ДУБАЙСКАЯ ШОКОЛАДКА 🍫
00:55
Просмотров 2,4 млн
This project got me my first AI Engineer job
18:17
Просмотров 3,4 тыс.
Apache Spark Architecture - EXPLAINED!
1:15:10
Просмотров 5 тыс.
When to Use Kafka or RabbitMQ | System Design
8:16
Просмотров 111 тыс.
Думайте сами блин
18:15
Просмотров 661 тыс.