Questions tagged [debezium]
Debezium is an open source distributed platform to stream database changes. Use this tag for questions related to using, configuring or troubleshooting Debezium.
debezium
1,136
questions
0
votes
0
answers
6
views
Writing debezium CDC events from Kafka Connect to Iceberg
We want to ingest Debezium CDC events into Iceberg Tables on Azure Blob. We aim to do so using Kafka Connect Iceberg Sink Connector, and a Snowflake Catalog for Iceberg.
Questions that have surfaced -
...
- 3
-1
votes
0
answers
35
views
Why does debezium add a null bytes (\u0000) at the beginning of the message?
As in the question why does debezium add a null bytes (\u0000) at the beginning of the output message.
How can I remove null bytes (\u0000) from the beginning of the message?
- 784
0
votes
0
answers
9
views
Failed to find any class that implements Connector and which name matches io.debezium.connector.postgresql.PostgresConnector
getting below error while trying to connect debezium with kafka
.\bin\windows\connect-standalone.bat config/connect-standalone.properties config/postgres.properties
INFO Kafka Connect started (org....
1
vote
1
answer
24
views
Can debezium/Kafka connect ignore or resize too large messages?
We're using debezium via AWS MSK serverless and MSK Connect to monitor the binlog of RDS Aurora MySQL.
For 99% of our data this all works fine, but very occasionally debezium fails with:
[Worker-...
- 196
0
votes
0
answers
20
views
Debezium Cassandra Connector not working in Docker container
I am trying to use the Debezium Cassandra connector in a Docker container using the debezium/connect image. However, the Cassandra connector is not showing up in the list of available connectors.
I ...
0
votes
0
answers
41
views
Debezium for Postgresql (Read-only)
I am currently researching methods to set up Debezium for PostgreSQL read replicas. My goal is to reduce the load on the primary database, which is crucial for my project. Unfortunately, I've noticed ...
- 1
0
votes
0
answers
24
views
How can I use Debezium Server to monitor a PosgresSQL db and save the changes to a json file?
I have a docker compose with a postgres, debezium server, and wanted to find a way to locally store the changes in a json file. Have been searching, but didn't find any promising directions.
I ...
- 13
0
votes
0
answers
41
views
Mariadb docker container connection using debezium Failed
So I'm trying to create a mariadb docker container connection using debezium
At first the connection was running well but I tried checking the status again after two minutes and I got an error. This ...
- 11
0
votes
0
answers
21
views
Debezium stops after inserted or update data into the table when using decoderbufs
The initial synchronization worked as expected, but when I insert or update data into the table, the connection with postgres closes.The connector is still marked as active and running.This issue only ...
0
votes
0
answers
11
views
Debezium captures table but does not stream change after it starts having data
I have a debezium connector that captures a table A with 0 items, but once that table starts having some items, the connector does not create topic, stream changes etc.
I am having snapshot.mode=...
0
votes
0
answers
16
views
Debezium with custom Driver for mysql 5.1
I'm new to debezium CDC and I tested using debezium-server to stream data from mysql 5.5 to pubsub sink. I know the version of mysql is very old and not officially supported based on debezium ...
- 11
0
votes
1
answer
19
views
Debezium server job performance issue
I am running debezium server (without Kafka) on linux server and it is having performance issue. There is lag of around 12-14hrs from reading data from Oracle to source to sending it to Azure Eventhub....
0
votes
0
answers
12
views
Kafka Connector use the same topic between debezium source and sink postgres
I have two kafka connector : debezium source and sink postgres. I would like to add a record on bdd kc-source, the record would be on db kc-sink, it is use the same topic.
kafka connector sink ...
0
votes
1
answer
63
views
How Debezium SQL Server works under the hood [closed]
I've been looking on how the connector of Debezium for SQL Server works under the hood, but I'm not sure I've understood it correctly.
In the docs, in the section about the snapshots (see https://...
- 4,231
0
votes
1
answer
45
views
debezium standalone server with http sink
we are running Debezium standalone server to capture the changes from postgresql database, and when a change is capture, we want it to send to a http endpoint. It works perfectly fine, however I can't ...
- 535