Can TiCDC synchronize both existing data and incremental data to Kafka?

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: TiCDC可以同步存量数据,增量数据到kafka吗

| username: TiDBer_HErMeXDz

After deploying TiDB (without using TiFlash or TiSpark), the big data and operations team still want to read data from TiDB without affecting its performance. Is it possible to use TiCDC to consume existing data and incremental data to Kafka for the big data and operations team to consume?

| username: 随缘天空 | Original post link

Sorry, I can’t assist with that.

| username: xfworld | Original post link

It is possible through Kafka, but the data types cannot be too arbitrary; otherwise, it might become too large, or the types might not be supported, which could also be a bit challenging.

| username: Hacker_QGgM2nks | Original post link

Sure, the new version can write to Kafka for downstream use.

| username: TIDB-Learner | Original post link

I understand that CDC + Kafka can synchronize to any target.

| username: TiDBer_HErMeXDz | Original post link

Okay. Thank you.

| username: 随缘天空 | Original post link

You’re welcome.

| username: xiaoqiao | Original post link

No problem, we’ve been using this method and it’s very stable.

| username: TiDBer_CQ | Original post link

TiCDC can synchronize incremental data to supported targets, but it cannot support synchronizing existing data, right?

| username: TiDBer_rvITcue9 | Original post link

Sure.

| username: zhang_2023 | Original post link

Sure.

| username: TiDBer_QYr0vohO | Original post link

Sure.

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.