FlinkTiCDC Full Table Read Causes Checkpoint Timeout and Task Failure

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: FlinkTiCDC 全量读取大表导致checkpoint超时任务失败

| username: TiDBer_GtY4TZQh

Using the official FlinkTicdc code to read full and incremental data, with the full table being approximately 200GB, the following issues occurred:

  1. Checkpoint timeout and task failure during the full data reading phase.
  2. TaskManager memory usage is enormous.
    Is there a solution for this?
2
| username: Billmay表妹 | Original post link

Each issue can be listed separately and described according to the following template:
【TiDB Usage Environment】Production / Testing / PoC
【TiDB Version】
【Issue Phenomenon and Impact】
【Reproduction Path】What operations were performed that led to the issue
【Resource Configuration】

Provide as much effective background information as possible in the description. Many issues may have different suggestions depending on the scenario and business context. If it’s not clearly explained, it will be difficult for others to help.

The issue description above is not specific enough to locate the problem. Please describe it in detail and then post it again.

3
| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.