A large number of schema-trackerXXXXX folders are generated by the worker in DM 5.4.2

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: dm 5.4.2中的worker产生schema-trackerXXXXX文件夹很多

| username: Jjjjayson_zeng

【TiDB Usage Environment】Testing
【TiDB Version】dm 5.4.2
【Reproduction Path】Operations performed that led to the issue
【Encountered Issue: Issue Phenomenon and Impact】
【Resource Configuration】
【Attachments: Screenshots/Logs/Monitoring】

| username: Jjjjayson_zeng | Original post link

Can it be prevented from generating or handled?

| username: tidb狂热爱好者 | Original post link

These files can be deleted after execution.

| username: Jjjjayson_zeng | Original post link

What needs to be executed? Does it have to be deleted manually?

| username: Jjjjayson_zeng | Original post link

How to check if it has finished executing? The previous version didn’t have this issue.

| username: jansu-dev | Original post link

Could you please:

  1. Provide the full paths of these files so I can confirm them.
  2. Although I am familiar with DM, it seems that the storage changes in schema-tracker might be related to this optimization.
  3. What was the previous version of DM?
| username: Jjjjayson_zeng | Original post link

Sorry, I was a bit busy earlier. The path that appears is under the data folder corresponding to the worker folder below.


It was version 2.x before.

| username: xingzhenxiang | Original post link

I checked mine, and they are all empty.

| username: Jjjjayson_zeng | Original post link

Which version are you using?

| username: jansu-dev | Original post link

  1. This optimization caused it.
  1. Because mockStore uses /tmp as the default storage space, schemaTracker uses mockStore to trace schema version information. However, when the space is insufficient, it can cause issues such as process crashes --》 Worker will quit without friendly message when no space in /tmp · Issue #4107 · pingcap/tiflow (github.com)

  2. It’s unlikely that it won’t generate.

  3. Handling should be fine, but it’s recommended to restart to avoid unknown issues. Stop the process, delete the data, and then restart the process (personally, I think this is safer).

BTW: Recently, due to various reasons, my replies have been quite late :joy:, sorry!

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.