TiCDC Memory Optimization

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: ticdc内存优化

| username: zxgaa

[TiDB Usage Environment] Production Environment
[TiDB Version] v6.1.0
[Reproduction Path]
[Encountered Problem: Problem Phenomenon and Impact]
In the production environment, two TiCDC nodes are deployed in the cluster. The memory usage of the primary node keeps increasing, while the memory usage of the other node is minimal.
Is it possible to limit the maximum memory usage of TiCDC through configuration?
Is it possible to balance the resource usage between the two TiCDC nodes through configuration?
[Resource Configuration]

image
image726×253 9.18 KB

[Attachments: Screenshots/Logs/Monitoring]
image
image1380×596 43.1 KB

2
| username: weixiaobing | Original post link

Is there a delay in the synchronization task?

3
| username: zxgaa | Original post link

Yesterday, there were failures in the synchronization tasks. After restarting, a few were delayed, but everything returned to normal this morning. However, the memory usage of the primary node continues to increase, while the memory of the other node remains stable.

4
| username: zxgaa | Original post link

The CPU usage of the primary node is also very high.

5
| username: sdojjy | Original post link

Can you export the complete Grafana monitoring data?

6
| username: zxgaa | Original post link

After adjusting the worker-number parameter of sink-uri and the worker-num parameter of mounter, the memory usage has decreased.

7
| username: redgame | Original post link

This is doable.

8
| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.