The ReplaceField Single Message Transform has three modes of operation on fields of data passing through Kafka Connect, either in a Source connector or Sink connector.
* Include only the fields specified in the list (`whitelist`)
* Include all fields except the ones specified (`blacklist`)
* Rename field(s) (`renames`)
---
👾 Demo code and details: github.com/confluentinc/demo-...
🗒️ SMT reference: docs.confluent.io/platform/cu...
Learn more about Kafka Connect here:
🏃♂️ Quick: • Kafka Connect in 60 se...
🚶 More detail: rmoff.dev/kafka-connect-zero-...
---
⏱️ Time codes:
00:00:00 Introduction to the ReplaceField transformation
00:02:21 KIP-629: Use racially neutral terms in our codebase
00:02:35 Excluding fields from messages passing through Kafka Connect
00:02:53 Mask vs Exclude
00:03:47 Include only listed fields of a message as it passes through Kafka Connect
00:04:22 Should you use Transforms in the source, or the sink?
00:05:57 Using the include / whitelist configuration
00:08:46 Renaming fields in a message with ReplaceField
00:11:16 Recap
---
☁️ Confluent Cloud: confluent.cloud/signup?...
💾Download Confluent Platform: www.confluent.io/download/?ut...
📺 Kafka Connect connector deep-dives: • Kafka Connect
✍️Kafka Connect documentation: docs.confluent.io/current/con...
🧩Confluent Hub: www.confluent.io/hub/?...
3 авг 2024
