A high resource usage issue occurred within a worker when using DM

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: dm在使用的时候出现了一个worker内占用过高问题

| username: Jjjjayson_zeng

[TiDB Usage Environment] Production Environment
[TiDB Version] DM Version 5.4.0
[Reproduction Path]
[Encountered Problem: Phenomenon and Impact]
A worker’s memory usage suddenly spiked
[Resource Configuration]
One worker 8c 32G
[Attachments: Screenshots/Logs/Monitoring]

A single port on one machine is occupying 80%

| username: Jjjjayson_zeng | Original post link

How to determine the cause of this situation, is there a good way to avoid high memory usage, and can the new version avoid this problem?

| username: xfworld | Original post link

I suggest you upgrade the version. 5.4.1 and 5.4.3 have fixed many bugs.

Regarding the memory spike issue, it might be related to the last two problems fixed in 5.4.3…

| username: Jjjjayson_zeng | Original post link

Hello, after upgrading to 5.4.2, there are still CPU and memory issues. Can I determine what is causing the impact through logs or some other method?

| username: Jjjjayson_zeng | Original post link

For example, is it possible that an error in a certain task caused this problem?

| username: xfworld | Original post link

Don’t you read the documentation? The version number, I didn’t recommend 5.4.2 for a reason…

| username: Jjjjayson_zeng | Original post link

Already upgraded to 5.4.3, but the issue still exists.


Moreover, a single worker is occupying 60% of the memory.

| username: xfworld | Original post link

Is there monitoring for DM? If so, you can check the relevant metrics.