Exception During Physical Import with Lightning

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: lightning物理导入时异常

| username: o小水o

[TiDB Usage Environment] Production Environment
[TiDB Version] 7.5.1
[Encountered Problem: Problem Phenomenon and Impact]
When using dumpling for logical export and importing with lightning in another cluster, configured for physical import, the issue shown in the image below was encountered.
At that time, there was no TICDC publishing any tables to the target database I wanted to import. I had to switch to tidb mode to import the data.

tiup dumpling -h 172.18.131.254 -P 4000 -F 100MB \
 --compress gzip \
 --database service \
 -o "s3://dqc/?endpoint=http://xxx.xxx.xxx.xx:9000&access-key=&secret-access-key=" 2>&1 | tee dumpling_stdout.log

[Attachment: Screenshot]

| username: 小龙虾爱大龙虾 | Original post link

:grinning: Just add parameters to ignore the pre-check and it will be fine.

| username: TiDBer_rvITcue9 | Original post link

Add parameters to ignore pre-checks.

| username: 小于同学 | Original post link

Ignore pre-checks

| username: lemonade010 | Original post link

There is CDC, right?

| username: YuchongXU | Original post link

Ignore the check

| username: 濱崎悟空 | Original post link

Ignore the check

| username: vincentLi | Original post link

The physical mode cannot be used casually. First, tables imported in physical mode cannot be detected by CDC. Second, the official documentation recommends not using physical mode in a production environment.

| username: vincentLi | Original post link

Physical Import Mode | PingCAP Documentation Center

| username: Jellybean | Original post link

Is the cluster into which you are importing data an empty cluster? The error message suggests that the cluster already has CDC deployed, causing the Lightning pre-check to fail. Please first confirm the status of the cluster.

| username: ziptoam | Original post link

First, try stopping the CDC and see if it helps.

| username: okenJiang | Original post link

Just turn off this configuration TiDB Lightning 配置参数 | PingCAP 文档中心

| username: Hacker_zuGnSsfP | Original post link

Ignoring the preliminary checks can solve this problem.

| username: 水到渠成 | Original post link

What does Lightning physical import mean? Isn’t it only logical import?