Тёмный
No video :(

Introduction to Schema Registry in Kafka | Part 1 

Knowledge Amplifier
Подписаться 27 тыс.
Просмотров 9 тыс.
50% 1

Schema Registry is a simple concept but it's really powerful in enforcing data governance within your Kafka architecture.
This video explains fundamental concepts related to Kafka Schema Registry.
Install Conduktor Desktop on Mac OS X, Windows or Linux--
www.conduktor.io/download/
Check this playlist for more Data Engineering related videos:
• Demystifying Data Engi...
Apache Kafka form scratch
• Apache Kafka for Pytho...
Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation--
doc.clickup.com/37466271/d/h/...
🙏🙏🙏🙏🙏🙏🙏🙏
YOU JUST NEED TO DO
3 THINGS to support my channel
LIKE
SHARE
&
SUBSCRIBE
TO MY RU-vid CHANNEL

Опубликовано:

 

28 окт 2022

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 34   
@ADayinMyBrain
@ADayinMyBrain 15 дней назад
This is exactly what i have been looking to know about Avro SR, Excellent, Thanks.
@KnowledgeAmplifier1
@KnowledgeAmplifier1 15 дней назад
Glad to hear this @ADayinMyBrain! Happy Learning
@manojt7012
@manojt7012 Год назад
To be honest. I have been searching for a clear explanation on this Schema registry topic in many video. But your explanation was the best of best!
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Год назад
Glad to know the video is helpful to you Manoj T! You can check these 3 videos for Schema Registry hands-on -- Introduction to Schema Registry in Kafka | Part 2 ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-46aZ6dqvswk.html Using Glue schema registry for Apache Kafka Producer with Python ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-2qKWs5_g8hU.html Integration of AWS Glue Schema Registry & Kafka Consumer using Python ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-q7XFcfE_TJ0.html Happy Learning
@jeetkp6186
@jeetkp6186 4 месяца назад
Best video out there !! I have been searching about the topic a lot , fortunately got this video , so good and easy to grasp the way you explained w diagram and explanation.
@KnowledgeAmplifier1
@KnowledgeAmplifier1 4 месяца назад
Glad to hear the video is helpful to you @jeetkp6186! Happy Learning
@SHINEUPTILLAST
@SHINEUPTILLAST Год назад
Man, the way you elucidate the topic is pretty amazing. You cleared all my concerns related to this topic. Thanks
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Год назад
Glad to hear that Naman Jain! Happy Learning
@SHINEUPTILLAST
@SHINEUPTILLAST Год назад
@@KnowledgeAmplifier1 I have one doubt in JSONSerializer the serialisation context we use whats the purpose of using that.
@venuvr
@venuvr Месяц назад
Thanks a lot for the video
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Месяц назад
You are welcome
@dineshkarunanithi2286
@dineshkarunanithi2286 Год назад
Really great explanation and keep up the good work. This really helps.
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Год назад
Thank you so much for your kind words! I'm glad that my explanation was helpful for you, Dinesh Karunanithi. Stay Tuned
@praveensb4880
@praveensb4880 7 месяцев назад
Thank you for this video.
@KnowledgeAmplifier1
@KnowledgeAmplifier1 7 месяцев назад
You're welcome praveen sb, Happy Learning !
@rabindrajaiswal5329
@rabindrajaiswal5329 11 месяцев назад
Great, finally understood schema registry in very simple way Thank hou so much ❤
@KnowledgeAmplifier1
@KnowledgeAmplifier1 10 месяцев назад
Glad to hear that
@sagar7958
@sagar7958 Год назад
Thank you. You teach well. Best of luck :)
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Год назад
You are welcome Sagar Goswami! Happy Learning
@anilsangula
@anilsangula 6 месяцев назад
Hi, May I know schema registry can we implement using windows as well. where can we get files, schema-registry-run-class and schema-registry-start files for windows.
@snehikpodder1018
@snehikpodder1018 Год назад
Really great explanation. Could you please make some video around subject name schema strategy when we have to support multiple schemas under one topic using python code examples?
@babakdorani5914
@babakdorani5914 Год назад
Thanks for this video
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Год назад
You are welcome babak dorani! Happy Learning
@rahulkakade1579
@rahulkakade1579 Год назад
Sir I'm going to create one poc using lamda,redshift ,glue ,s3 so I want to generate huge ammount of data for batch as well as streaming can you please make video how we can generate huge ammount of data
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Год назад
Hello Rahul kakade15, noted in backlog , in the meantime , you can try with Amazon Customer Reviews Dataset (s3.amazonaws.com/amazon-reviews-pds/readme.html) or you can generate fake date from this website -- www.mockaroo.com/
@rahulkakade1579
@rahulkakade1579 Год назад
@@KnowledgeAmplifier1 thanka you so much
@SpiritOfIndiaaa
@SpiritOfIndiaaa 10 месяцев назад
#KnowledgeAmplifier thanks a lot bro. any vid on CONDUCTOR ?
@KnowledgeAmplifier1
@KnowledgeAmplifier1 10 месяцев назад
Hello SpiritOfIndia, I don't have any dedicated video on CONDUCTOR as of now , you can refer this channel -- www.youtube.com/@getconduktor/videos
@ohuuthai1678
@ohuuthai1678 2 месяца назад
Where will that topic be saved on the computer?
@sanjaybedwal2385
@sanjaybedwal2385 Год назад
Nice video . One question though .. If schema validation is already happening at producer level . What are the chances or in which scenario does the schema validation can fail at consumer side ?
@KnowledgeAmplifier1
@KnowledgeAmplifier1 Год назад
Ideally it's not possible until and unless someone change the schema & the compatibility type in schema registry manually post the message published in kafka topic 🙂In consumer side schema registry is used for deserialization ...
@sanjaybedwal2385
@sanjaybedwal2385 Год назад
Sure thanks 🙏
@andreybraslavskiy522
@andreybraslavskiy522 5 месяцев назад
It is not well explained. Always should be an example of failure. This video makes it hard to imagine when consumers can fail to parse the message. Following the video, it says that the consumer get an ID of the schema from the message itself. So how is it possible that the message will not match the schema if the message will not be published with this ID in case of mismatch in the first place?
@piraneshsakthivel7662
@piraneshsakthivel7662 3 месяца назад
yes I have the same question.
Далее
Introduction to Schema Registry in Kafka | Part 2
26:18
Apache Kafka 101: Schema Registry (2023)
6:45
Просмотров 82 тыс.
Data Modeling in the Modern Data Stack
10:14
Просмотров 97 тыс.
Kafka Confluent Schema Registry
15:13
Просмотров 24 тыс.
Learn Protocol Buffers Quickly: 30-Minute Golang Guide
32:48
Using Glue schema registry for Apache Kafka with Python
25:07