Ticdcw unable to push data to Kafka

This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: ticdcw无法推送数据到kafka

| username: TiDBer_iHLREcVG

[TiDB Usage Environment] Production Environment
[TiDB Version] Version 6.1.2
[Encountered Problem: Phenomenon and Impact]
The ticdc configured task cannot push data to the specified Kafka. Checking the ticdc log, the following error was found:

From the log, it seems to be a PD issue. Displaying the cluster shows it is normal:

Checking the PD log, it seems there are only some warnings and no exceptions:

Does anyone know how to handle this?

| username: 裤衩儿飞上天 | Original post link

The issue might be with the PD node.

  1. Check if your PD leader is frequently switching.
  2. Check the relevant PD monitoring.
  3. The logs indicate that PD’s load is too high due to disk issues, and even the heartbeats are failing to send.
| username: TiDBer_iHLREcVG | Original post link

Well, after checking, it seems to be a disk issue. The read/write speed of this mechanical hard drive is too poor. Additionally, having PD, KV, and server all installed together is causing the entire database to lag significantly.

| username: 裤衩儿飞上天 | Original post link

It is still very necessary to use SSDs in production. Even if the budget is tight, at least a regular SSD should be used for the database. Mechanical drives impact performance too much.

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.