CDC Data Latency and Error Issues

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: cdc 数据延迟及报错问题

| username: 爱白话的晓辉

[TiDB Usage Environment] Online (Research)
[TiDB Version] v5.4.0
[Encountered Problem] CDC outputs data to Kafka, writing data to Kafka is delayed, and CDC lag keeps increasing.
[Reproduction Path] After adjusting the three parameters max-message-bytes=1073741824, replica.fetch.max.bytes=1073741824, and fetch.message.max.bytes=1073741824, the delay is still extremely large.
Monitoring Interface

image
image1239×267 33.9 KB

Check the logs for the following errors
image
image1380×998 295 KB

2
| username: jansu-dev | Original post link

Could you please collect a clinic report to help diagnose the root cause of the issue? The current information is insufficient to determine what is causing the lag (whether it’s a Kafka issue or a CDC issue). Here is the guide on how to use clinic: PingCAP Clinic 快速上手指南 | PingCAP 文档中心