This video demonstrates how to use Red Hat Integration's Debezium connectors to monitor a MySQL database. As the data in the database changes, you will see the resulting event streams reflected in Red Hat OpenShift Streams for Apache Kafka.
Red Hat OpenShift Service Registry is a fully hosted and managed service that provides an API and schema registry for microservices. OpenShift Service Registry makes it easy for development teams to publish, discover, and reuse APIs and schemas.
Debezium schema serialization
The default behavior is that the JSON converter includes the record’s message schema, making each record very verbose. Alternatively, you can serialize the record keys and values using Apache Avro. To use Apache Avro serialization, you must deploy a schema registry that manages Avro message schemas and their versions.
OpenShift Service Registry provides an Avro converter that you can specify in Debezium connector configurations. This converter maps Kafka Connect schemas to Avro schemas. The converter then uses the Avro schemas to serialize the record keys and values into Avro’s compact binary form.
Get the code here: github.com/hguerrero/debezium-examples/tree/main/debezium-openshift-registry-avro
Contents of this video:
00:00 - Intro
00:16 - Login into Red Hat OpenShift Cloud Services
00:34 - Create a new Kafka instance
01:10 - Create a Service Registry instance
02:30 - Configure Kafka access
03:54 - Create topics
04:46 - Start docker-compose
05:25 - Check connectivity with kcctl
06:05 - Configure connector
06:53 - Deploy the connector
07:30 - Check the registry
07:54 - Use kcat to retrieve the topic records
09:30 - Get the compatibility API for kcat deserialization
09:50 - Use kcat to deserialize the records
10:30 - Use jq for pretty print of json
11:09 - Final remarks