Using DMv2.0 to synchronize data from MySQL to TiDB (v4.0.8), due to the large amount of upstream changes, the downstream TiDB experiences significant delays. How can the synchronization speed be improved?
The configuration file for the task has the following parameters, which can be appropriately increased based on the hardware:
syncers:
global:
worker-count: 16
batch: 100
Are you using incremental or full + incremental? If the data volume is relatively large, it’s better to use dumpling + lightning for full and DM for incremental. DM can handle up to 30~50 GiB/h at most.