In this video I talk about Apache Pulsar with Matteo Merli, CTO at StreamNative. This episode will provide you good insight about how Apache Pulsar works and more importantly differs with the most popular Pub/Sub and streaming platform Apache Kafka. Things like, what enables possibility of 1 million topics? Why is rebalancing not required? How does decoupled storage and compute architecture works? How it uses the concept of Subscriptions to avoid retaining data unnecessarily?
And much more...
Chapters:
00:00 Introduction and Guest Introduction
00:08 Understanding Apache Pulsar and its Origin
01:22 The Problem Apache Pulsar was Designed to Solve
02:35 The Evolution of Apache Pulsar
05:15 Understanding Basic Concepts of Apache Pulsar
09:27 Deep Dive into Apache Pulsar's Architecture
21:16 Understanding the Flow of Data in Apache Pulsar
28:54 Understanding Subscriptions in Apache Pulsar
31:57 Understanding End-to-End Latency and Subscription Creation
32:32 Broker's Role and Handling Metadata
33:05 Memory Management and Consumer Handling
34:07 Message Processing and Flow Control
34:32 Message Storage and Retrieval
36:00 Comparing Pulsar with Kafka
43:52 Understanding Multi-Tenancy in Pulsar
49:17 Exploring Tiered Storage and Future Developments
Important links:
StreamNative: streamnative.io/
Apache Pulsar: pulsar.apache.org/
Matteo Merli: / merlimat
===============================================================================
For discount on the below courses:
Appsync: appsyncmasterclass.com/?affil...
Testing serverless: testserverlessapps.com/?affil...
Production-Ready Serverless: productionreadyserverless.com...
Use the button, Add Discount and enter "geeknarrator" discount code to get 20% discount.
===============================================================================
Follow me on Linkedin and Twitter: / kaivalyaapte and / thegeeknarrator
If you like this episode, please hit the like button and share it with your network.
Also please subscribe if you haven't yet.
Database internals series: • Write-ahead-logging
Popular playlists:
Realtime streaming systems: • Realtime Streaming Sys...
Software Engineering: • Software Engineering
Distributed systems and databases: • Distributed Systems an...
Modern databases: • Modern Databases
Stay Curios! Keep Learning!
28 июн 2024
