Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.Original topic: 请问现在TiKV的Java Client支持读取 kv 数据变更日志的操作吗
|
username: TiDBer_8xv3YpMO
Does the current TiKV Java Client support reading kv data change logs?
Sure, thank you. I would like to ask if there is any way to get the data change logs from TiDB using Java?
If you use the standard SQL method for operations, then from version 5.X onwards, you can use TiCDC.
TiCDC has a rich set of downstream integrations and can also be customized.
TiCDC does not support full data replication, only incremental… which means it captures data in real-time.
The company said that Kafka cannot be used, so there is no other way to obtain it except through TiCDC, right?
Kafka consumption data currently only provides incremental logs from TiCDC and TiDB-binlog. You can freely choose the interface: TiCDC OpenAPI v1 | PingCAP 文档中心
Is it necessary to go through Kafka to pull TiDB change logs?
The downstream data sources connected by TiDB CDC are relatively few. I wonder if it is possible to directly obtain TiDB’s changelog logs and synchronize data to more downstream data sources by analyzing the logs. Is there any other way to get the changelog without using Kafka?
Currently, TiCDC seems to support only three types: synchronization to MySQL, Kafka, and S3 (not recommended for production by the official documentation). Flink-CDC supports TiDB and many other databases, but it is based on Debezium, which is also based on Kafka-connector.
If it doesn’t work, you might consider synchronizing to a MySQL database and then using MySQL’s change logs?
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.
|
username: 
|
username: 
|
username: 
|
username: