How is data integrity ensured when the TiCDC component crashes?

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 当ticdc组件宕机的时候,期间数据完整性怎么保证?

| username: jingyesi3401

When the TiCDC component crashes, how is data integrity ensured during that period?

| username: jingyesi3401 | Original post link

TiCDC Common Issues and Troubleshooting | PingCAP Docs

| username: Meditator | Original post link

Take a look at this

| username: jingyesi3401 | Original post link

If the Ticdc service is abnormal, how can we notify the operations personnel immediately, similar to Zabbix monitoring forwarding emails?

| username: HACK | Original post link

Rely on checkpoints.

| username: eastfisher | Original post link

If a TiCDC instance goes down, since the TiCDC cluster itself supports high availability, after re-electing the owner node, the changefeed of the downed instance will be migrated to other instances.

| username: eastfisher | Original post link

You can set alert rules for monitoring metrics from both Server and Changefeed dimensions.

Some general alert rules are provided.

| username: jingyesi3401 | Original post link

  1. The corresponding state of pause should be either stop or pause to be considered normal.

  2. Every time the pause command fails, the corresponding log shows the following error, and there is no issue with the command check.

| username: YuchongXU | Original post link

Checkpoint of the log

| username: jingyesi3401 | Original post link

Why can’t it be paused? Is it a version issue?

| username: 特雷西-迈克-格雷迪 | Original post link

There should be a checkpoint. If it’s a cluster, it should be transferable, right?

| username: jingyesi3401 | Original post link

The main issue at the moment is that executing pause is unsuccessful, and the logs show “changefeed not found when handling a job.”

| username: jingyesi3401 | Original post link

Thank you all. Modifying the command to the following format successfully pauses:

tiup ctl:v5.1.0 cdc changefeed pause -c produceparam-kafka-changefeed --pd=http://x.x.x.x:2379

| username: xiaohetao | Original post link

TiCDC 简介 | PingCAP 文档中心 Look here

Synchronization Order Guarantee and Consistency Guarantee

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.