Error Occurs Continuously When Migrating Using Lightning Tool

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 使用Lightning工具进行迁移,一直报错

| username: TiDBer_LnuMS5mt

[TiDB Usage Environment] Testing/
[TiDB Version]
[Reproduction Path]
Using the DM tool to migrate MySQL data online to TiDB
[Encountered Issue: Problem Description and Impact]


This error keeps appearing when migrating some tables.

| username: h5n1 | Original post link

Are the TiDB components deployed together? Check with tiup cluster display. What are the characteristics of the tables that have this error compared to the successful ones when migrating some tables? Also, share the configuration file used for the import.

| username: 啦啦啦啦啦 | Original post link

When checking, it was found that the sorted-kv-dir and data-source-dir in the lightning configuration file were using the same disk.

| username: TiDB_C罗 | Original post link

Running Lightning cannot access PD, possibly because TiDB is using a proxy and only exposing TiDB nodes.

| username: TiDB_C罗 | Original post link

It may reduce performance, but this is not a big issue.

| username: WalterWj | Original post link

It seems that 2379 is not accessible.

| username: TiDB_C罗 | Original post link

I don’t understand why it accesses the PD node, Dumpling also accesses it.

| username: WalterWj | Original post link

Isn’t this Lightning? The local mode needs to obtain TiKV node information through PD.

| username: 像风一样的男子 | Original post link

Lightning physical import must connect to PD. In your case, PD cannot be connected. Logical import only needs to connect to port 4000 but is less efficient.

| username: xfworld | Original post link

Access PD to get all TiKV nodes, then retrieve metadata information to configure the necessary format for writing SST…

If this condition is not met, it is recommended to use other methods…

| username: redgame | Original post link

How can it be reproduced?

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.