Hi and thanks I have a question: What is the best practice in distributed mode for Spark? Is it good that the number of kafka partitions and spark executors are equal?
Thank you very much I installed the environment using Python 3.11. When I use from kafka import KafkaProducer, why does this error appear? ile ~/anaconda3/lib/python3.12/site-packages/kafka/codec.py:9 6 import struct 8 from kafka.vendor import six ----> 9 from kafka.vendor.six.moves import range 11 _XERIAL_V1_HEADER = (-126, b'S', b'N', b'A', b'P', b'P', b'Y', 0, 1, 1) 12 _XERIAL_V1_FORMAT = 'bccccccBii' ModuleNotFoundError: No module named 'kafka.vendor.six.moves'