Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.
Original topic: sync_diff_inspector数据对比异常退出
【TiDB Usage Environment】Poc
【TiDB Version】5.2.1
【Encountered Problem: Phenomenon and Impact】
sync_diff_inspector always exits automatically halfway through the data comparison between the primary and standby clusters.
【Attachments: Screenshots/Logs/Monitoring】
It feels like it’s caused by insufficient memory.
I observed that the memory is sufficient.
Use a higher version of sync-diff, the lower version may have bugs.
Is this table very large? How long did it take to report the error?
Changed to the latest version, still getting errors. The exit time is quite random, sometimes at 4%, sometimes at over 20%.
How long does it take for sync_diff_inspector to report an error during this comparison?
Check if there are any abnormal logs in the corresponding TiDB server of the upstream and downstream clusters.
Additionally, you can enable the tool’s debug logs to print more information for troubleshooting.
Take a look at the configuration file.
I suspect that the issue might be caused by differences in table structures or incompatible data types. Could it be that the case sensitivity of the fields was overlooked? Check the case sensitivity of the fields in both upstream and downstream, and manually compare them first.
Check the logs of 37.17pd.
The structure appears to be consistent.
There are no ERROR logs in pd.
Execute it once more. Please send the PD logs for the corresponding time.