11 Spark Streaming Triggers - Once, Processing Time & Continuous | Tune Kafka Streaming Performance 

By far, the best spark streaming lecture.👍 Thank you so much

Hi and thanks I have a question: What is the best practice in distributed mode for Spark? Is it good that the number of kafka partitions and spark executors are equal?

I have a doubt. IF I have my processing time as 5hours, is cluster still alive until 5hours or will be terminated and started again after 5hrs

Thank you very much I installed the environment using Python 3.11. When I use from kafka import KafkaProducer, why does this error appear? ile ~/anaconda3/lib/python3.12/site-packages/kafka/codec.py:9 6 import struct 8 from kafka.vendor import six ----> 9 from kafka.vendor.six.moves import range 11 _XERIAL_V1_HEADER = (-126, b'S', b'N', b'A', b'P', b'P', b'Y', 0, 1, 1) 12 _XERIAL_V1_FORMAT = 'bccccccBii' ModuleNotFoundError: No module named 'kafka.vendor.six.moves'