Full Data + Incremental Data Migration in DM

This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: DM数据全量+增量数据迁移

| username: 每天当牛马

Using DM cluster to migrate data from MySQL to TiDB. The current migration mode configured is full + incremental. How can I confirm if the full data synchronization is complete? Also, what is the synchronization order, does it first synchronize the full data and then the incremental data?

| username: tidb菜鸟一只 | Original post link

There is corresponding monitoring in Grafana.

| username: 江湖故人 | Original post link

You can see the progress status with query-status.

| username: Inkjade | Original post link

First, perform full synchronization, then incremental synchronization.

  1. The first method is to monitor the status of the synchronization task through Grafana.
  2. The second method is to observe the specific execution status through dmctl.

tiup dmctl --master-addr xxxx:8261 query-status

| username: 每天当牛马 | Original post link

How to deal with this? The relevant version of the package is also available.

| username: 这里介绍不了我 | Original post link

How is the configuration file written?

| username: 每天当牛马 | Original post link

The image is not visible. Please provide the text you need translated.

| username: 每天当牛马 | Original post link

Do I need to specify the version in the configuration file, and how do I modify it?

| username: 这里介绍不了我 | Original post link

DM Cluster Hardware and Software Requirements | PingCAP Documentation Center

| username: 每天当牛马 | Original post link

It was deployed according to the official website’s method.

| username: 这里介绍不了我 | Original post link

Check the version documentation for DM. Is your v6.5.0 correct?

| username: 每天当牛马 | Original post link

I downloaded version 5.3.0. Can I directly run tiup dm deploy dm-test v5.3.0 ./topology.yaml --user tidb -p like this? I see that the monitoring package downloaded is version 4.3.

| username: zhang_2023 | Original post link

It must be full first, then incremental.

| username: changpeng75 | Original post link

Is it possible that Prometheus and Grafana were not downloaded completely? Check if they can be extracted. If not, delete and re-download them.

| username: 小龙虾爱大龙虾 | Original post link

tiup mirror show

| username: seiang | Original post link

After creating the DM synchronization, you can use the following command to check the migration task status and migration phase: tiup dmctl --master-addr xxxx:8261 query-status xxx

Migration phases: dump (full export) + load (full import) + sync (incremental synchronization)

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.