TiDB Cluster v6.4.0 Backup Failure

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: tidb集群v6.4.0备份失败

| username: TiDBer_vJpITQ5J

[TiDB Usage Environment] Production Environment
Using dumpling tool for backup shows an error
./dumpling -h 10.200.78.103 -P 4003 -u root -p ‘password’ --filetype sql -t 32 -F 256m -o /opt/data/
Release version: v6.4.0
Git commit hash: cf36a9ce2fe1039db3cf3444d51930b887df18a1
Git branch: heads/refs/tags/v6.4.0
Build timestamp: 2022-11-13 05:17:51Z
Go version: go version go1.19.2 linux/amd64

[2023/04/20 17:52:35.923 +08:00] [INFO] [versions.go:54] [“Welcome to dumpling”] [“Release Version”=v6.4.0] [“Git Commit Hash”=cf36a9ce2fe1039db3cf3444d51930b887df18a1] [“Git Branch”=heads/refs/tags/v6.4.0] [“Build timestamp”=“2022-11-13 05:17:51”] [“Go Version”=“go version go1.19.2 linux/amd64”]
[2023/04/20 17:52:35.928 +08:00] [INFO] [version.go:398] [“detect server version”] [type=TiDB] [version=6.4.0]
[2023/04/20 17:52:35.943 +08:00] [INFO] [global.go:34] [“[pd] create pd client with endpoints”] [pd-address=“[10.200.78.102:2379,10.200.78.101:2379]”]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] update member urls”] [old-urls=“[http://10.200.78.102:2379,http://10.200.78.101:2379]”] [new-urls=“[http://10.200.78.101:2379,http://10.200.78.102:2379]”]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] switch leader”] [new-leader=http://10.200.78.102:2379] [old-leader=]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] init cluster id”] [cluster-id=7173715422814811436]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] tso dispatcher created”] [dc-location=global]
[2023/04/20 17:52:35.953 +08:00] [INFO] [dump.go:1488] [“generate dumpling gc safePoint id”] [id=dumpling_1681984355953297887]
[2023/04/20 17:52:35.969 +08:00] [INFO] [dump.go:131] [“begin to run Dump”] [conf=“{"s3":{"endpoint":"","region":"","storage-class":"","sse":"","sse-kms-key-id":"","acl":"","access-key":"","secret-access-key":"","provider":"","force-path-style":true,"use-accelerate-endpoint":false,"role-arn":"","external-id":"","object-lock-enabled":false},"gcs":{"endpoint":"","storage-class":"","predefined-acl":"","credentials-file":""},"azblob":{"endpoint":"","account-name":"","account-key":"","access-tier":""},"AllowCleartextPasswords":false,"SortByPk":true,"NoViews":true,"NoSequences":true,"NoHeader":false,"NoSchemas":false,"NoData":false,"CompleteInsert":false,"TransactionalConsistency":true,"EscapeBackslash":true,"DumpEmptyDatabase":true,"PosAfterConnect":false,"CompressType":0,"Host":"10.200.78.103","Port":4003,"Threads":32,"User":"root","Security":{"CAPath":"","CertPath":"","KeyPath":""},"LogLevel":"info","LogFile":"","LogFormat":"text","OutputDirPath":"/opt/data/","StatusAddr":":8281","Snapshot":"440922107003011073","Consistency":"snapshot","CsvNullValue":"\\N","SQL":"","CsvSeparator":",","CsvDelimiter":"\"","Databases":,"Where":"","FileType":"sql","ServerInfo":{"ServerType":3,"ServerVersion":"6.4.0","HasTiKV":true},"Rows":0,"ReadTimeout":900000000000,"TiDBMemQuotaQuery":0,"FileSize":268435456,"StatementSize":1000000,"SessionParams":{"tidb_snapshot":"440922107003011073"},"Tables":{},"CollationCompatible":"loose"}”]
[2023/04/20 17:52:36.973 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=gen_table]
[2023/04/20 17:52:36.974 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=gen_table]
[2023/04/20 17:52:36.978 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=gen_table] [chunkIdx=0]
[2023/04/20 17:52:36.988 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=gen_table_column]
[2023/04/20 17:52:36.988 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=gen_table_column]
[2023/04/20 17:52:36.993 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=gen_table_column] [chunkIdx=0]
[2023/04/20 17:52:37.104 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=sys_oss]
[2023/04/20 17:52:37.104 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=sys_oss]
[2023/04/20 17:52:37.107 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=sys_oss] [chunkIdx=0]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:741] [“get estimated rows count”] [database=hsq-system] [table=undo_log] [estimateCount=10000]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:747] [“fallback to sequential dump due to estimate count < rows. This won’t influence the whole dump process”] [“estimate count”=10000] [conf.rows=200000] [database=hsq-system] [table=undo_log]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=undo_log]
[2023/04/20 17:52:37.218 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=undo_log] [chunkIdx=0]
[2023/04/20 17:52:37.277 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=gen_table]
[2023/04/20 17:52:37.277 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=gen_table]
[2023/04/20 17:52:37.281 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=gen_table] [chunkIdx=0]
[2023/04/20 17:52:37.287 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=gen_table_column]
[2023/04/20 17:52:37.287 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=gen_table_column]
[2023/04/20 17:52:37.290 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=gen_table_column] [chunkIdx=0]
[2023/04/20 17:52:37.298 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_blog_info]
[2023/04/20 17:52:37.298 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_blog_info]
[2023/04/20 17:52:37.306 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_blog_info] [chunkIdx=0]
[2023/04/20 17:52:37.333 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_fans_info]
[2023/04/20 17:52:37.333 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_fans_info]
[2023/04/20 17:52:37.338 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_fans_info] [chunkIdx=0]
[2023/04/20 17:52:37.359 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_media_info]
[2023/04/20 17:52:37.359 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_media_info]
[2023/04/20 17:52:37.362 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_media_info] [chunkIdx=0]
[2023/04/20 17:52:37.428 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok_data_audit] [table=super_operate_log]
[2023/04/20 17:52:37.429 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok_data_audit] [table=super_operate_log]
[2023/04/20 17:52:37.431 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok_data_audit] [table=super_operate_log] [chunkIdx=0]
[2023/04/20 17:52:37.541 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_account_proxy_flow_record]
[2023/04/20 17:52:37.541 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_account_proxy_flow_record]
[2023/04/20 17:52:37.544 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_account_proxy_flow_record] [chunkIdx=0]
[2023/04/20 17:52:37.604 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_apps]
[2023/04/20 17:52:37.604 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_apps]
[2023/04/20 17:52:37.608 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_apps] [chunkIdx=0]
[2023/04/20 17:52:37.629 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_comment_task_detail]
[2023/04/20 17:52:37.629 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_comment_task_detail]
[2023/04/20 17:52:37.631 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_comment_task_detail] [chunkIdx=0]
[2023/04/20 17:52:37.665 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_device]
[2023/04/20 17:52:37.665 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_device]
[2023/04/20 17:52:37.667 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_device] [chunkIdx=0]
[2023/04/20 17:52:37.674 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_handle_queue]
[2023/04/20 17:52:37.674 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_handle_queue]
[2023/04/20 17:52:37.681 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_handle_queue] [chunkIdx=0]
[2023/04/20 17:52:37.691 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_label]
[2023/04/20 17:52:37.691 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_label]
[2023/04/20 17:52:37.693 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_label] [chunkIdx=0]
[2023/04/20 17:52:37.935 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_problem]
[2023/04/20 17:52:37.935 +08:00

| username: xfworld | Original post link

Where did it report an error?

[2023/04/20 17:25:02.575 +08:00] [INFO] [main.go:81] [“dump data successfully, dumpling will exit now”]

I just saw this, everything has been executed…

| username: tidb菜鸟一只 | Original post link

Why do I see it as successful? Am I blind?
[2023/04/20 17:25:02.575 +08:00] [INFO] [main.go:81] [“dump data successfully, dumpling will exit now”]

| username: TiDBer_vJpITQ5J | Original post link

./dumpling -h 10.200.78.103 -P 4003 -u root -p ‘password’ --filetype sql -t 32 -F 256m -o /opt/data/
Release version: v6.4.0
Git commit hash: cf36a9ce2fe1039db3cf3444d51930b887df18a1
Git branch: heads/refs/tags/v6.4.0
Build timestamp: 2022-11-13 05:17:51Z
Go version: go version go1.19.2 linux/amd64

[2023/04/20 17:52:35.923 +08:00] [INFO] [versions.go:54] [“Welcome to dumpling”] [“Release Version”=v6.4.0] [“Git Commit Hash”=cf36a9ce2fe1039db3cf3444d51930b887df18a1] [“Git Branch”=heads/refs/tags/v6.4.0] [“Build timestamp”=“2022-11-13 05:17:51”] [“Go Version”=“go version go1.19.2 linux/amd64”]
[2023/04/20 17:52:35.928 +08:00] [INFO] [version.go:398] [“detect server version”] [type=TiDB] [version=6.4.0]
[2023/04/20 17:52:35.943 +08:00] [INFO] [global.go:34] [“[pd] create pd client with endpoints”] [pd-address=“[10.200.78.102:2379,10.200.78.101:2379]”]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] update member urls”] [old-urls=“[http://10.200.78.102:2379,http://10.200.78.101:2379]”] [new-urls=“[http://10.200.78.101:2379,http://10.200.78.102:2379]”]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] switch leader”] [new-leader=http://10.200.78.102:2379] [old-leader=]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] init cluster id”] [cluster-id=7173715422814811436]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] tso dispatcher created”] [dc-location=global]
[2023/04/20 17:52:35.953 +08:00] [INFO] [dump.go:1488] [“generate dumpling gc safePoint id”] [id=dumpling_1681984355953297887]
[2023/04/20 17:52:35.969 +08:00] [INFO] [dump.go:131] [“begin to run Dump”] [conf=“{"s3":{"endpoint":"","region":"","storage-class":"","sse":"","sse-kms-key-id":"","acl":"","access-key":"","secret-access-key":"","provider":"","force-path-style":true,"use-accelerate-endpoint":false,"role-arn":"","external-id":"","object-lock-enabled":false},"gcs":{"endpoint":"","storage-class":"","predefined-acl":"","credentials-file":""},"azblob":{"endpoint":"","account-name":"","account-key":"","access-tier":""},"AllowCleartextPasswords":false,"SortByPk":true,"NoViews":true,"NoSequences":true,"NoHeader":false,"NoSchemas":false,"NoData":false,"CompleteInsert":false,"TransactionalConsistency":true,"EscapeBackslash":true,"DumpEmptyDatabase":true,"PosAfterConnect":false,"CompressType":0,"Host":"10.200.78.103","Port":4003,"Threads":32,"User":"root","Security":{"CAPath":"","CertPath":"","KeyPath":""},"LogLevel":"info","LogFile":"","LogFormat":"text","OutputDirPath":"/opt/data/","StatusAddr":":8281","Snapshot":"440922107003011073","Consistency":"snapshot","CsvNullValue":"\\N","SQL":"","CsvSeparator":",","CsvDelimiter":"\"","Databases":,"Where":"","FileType":"sql","ServerInfo":{"ServerType":3,"ServerVersion":"6.4.0","HasTiKV":true},"Rows":0,"ReadTimeout":900000000000,"TiDBMemQuotaQuery":0,"FileSize":268435456,"StatementSize":1000000,"SessionParams":{"tidb_snapshot":"440922107003011073"},"Tables":{},"CollationCompatible":"loose"}”]
[2023/04/20 17:52:36.973 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=gen_table]
[2023/04/20 17:52:36.974 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=gen_table]
[2023/04/20 17:52:36.978 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=gen_table] [chunkIdx=0]
[2023/04/20 17:52:36.988 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=gen_table_column]
[2023/04/20 17:52:36.988 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=gen_table_column]
[2023/04/20 17:52:36.993 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=gen_table_column] [chunkIdx=0]
[2023/04/20 17:52:37.104 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=sys_oss]
[2023/04/20 17:52:37.104 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=sys_oss]
[2023/04/20 17:52:37.107 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=sys_oss] [chunkIdx=0]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:741] [“get estimated rows count”] [database=hsq-system] [table=undo_log] [estimateCount=10000]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:747] [“fallback to sequential dump due to estimate count < rows. This won’t influence the whole dump process”] [“estimate count”=10000] [conf.rows=200000] [database=hsq-system] [table=undo_log]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=undo_log]
[2023/04/20 17:52:37.218 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=undo_log] [chunkIdx=0]
[2023/04/20 17:52:37.277 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=gen_table]
[2023/04/20 17:52:37.277 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=gen_table]
[2023/04/20 17:52:37.281 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=gen_table] [chunkIdx=0]
[2023/04/20 17:52:37.287 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=gen_table_column]
[2023/04/20 17:52:37.287 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=gen_table_column]
[2023/04/20 17:52:37.290 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=gen_table_column] [chunkIdx=0]
[2023/04/20 17:52:37.298 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_blog_info]
[2023/04/20 17:52:37.298 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_blog_info]
[2023/04/20 17:52:37.306 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_blog_info] [chunkIdx=0]
[2023/04/20 17:52:37.333 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_fans_info]
[2023/04/20 17:52:37.333 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_fans_info]
[2023/04/20 17:52:37.338 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_fans_info] [chunkIdx=0]
[2023/04/20 17:52:37.359 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_media_info]
[2023/04/20 17:52:37.359 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_media_info]
[2023/04/20 17:52:37.362 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_media_info] [chunkIdx=0]
[2023/04/20 17:52:37.428 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok_data_audit] [table=super_operate_log]
[2023/04/20 17:52:37.429 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok_data_audit] [table=super_operate_log]
[2023/04/20 17:52:37.431 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok_data_audit] [table=super_operate_log] [chunkIdx=0]
[2023/04/20 17:52:37.541 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_account_proxy_flow_record]
[2023/04/20 17:52:37.541 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_account_proxy_flow_record]
[2023/04/20 17:52:37.544 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_account_proxy_flow_record] [chunkIdx=0]
[2023/04/20 17:52:37.604 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_apps]
[2023/04/20 17:52:37.604 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_apps]
[2023/04/20 17:52:37.608 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_apps] [chunkIdx=0]
[2023/04/20 17:52:37.629 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_comment_task_detail]
[2023/04/20 17:52:37.629 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_comment_task_detail]
[2023/04/20 17:52:37.631 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_comment_task_detail] [chunkIdx=0]
[2023/04/20 17:52:37.665 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_device]
[2023/04/20 17:52:37.665 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_device]
[2023/04/20 17:52:37.667 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_device] [chunkIdx=0]
[2023/04/20 17:52:37.674 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_handle_queue]
[2023/04/20 17:52:37.674 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_handle_queue]
[2023/04/20 17:52:37.681 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_handle_queue] [chunkIdx=0]
[2023/04/20 17:52:37.691 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_label]
[2023/04/20 17:52:37.691 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_label]
[2023/04/20 17:52:37.693 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_label] [chunkIdx=0]
[2023/04/20 17:52:37.935 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_problem]
[2023/04/20 17:52:37.935 +08:00] [INFO] [dump.go:698] ["didn’t build tidb concat sqls

| username: TiDBer_vJpITQ5J | Original post link

Please take a look at the latest one~

| username: xfworld | Original post link

Dump failed: Error 1105: other error for MPP stream: Receive cancel request from TiDB

The request was canceled… [error=“context canceled”]

| username: tidb菜鸟一只 | Original post link

Wasn’t it you who manually canceled it?

| username: TiDBer_vJpITQ5J | Original post link

I didn’t manually cancel it.

| username: tidb菜鸟一只 | Original post link

Then check if there is an issue with the [database=tiktok] [table=t_user] table? Try exporting it separately to see.

| username: 孤君888 | Original post link

Isn’t the dumpling tool used for exporting? Isn’t there a br tool for backups?

| username: xingzhenxiang | Original post link

dumping: export, lighting: import (logical), br (backup & restore): physical

| username: TiDBer_vJpITQ5J | Original post link

I tested a separate backup, and it seems that the data was backed up, but there was an error during restoration related to some syntax issue, for example with this django-mail library.

| username: xingzhenxiang | Original post link

Foreign keys, not supported.

| username: TiDBer_vJpITQ5J | Original post link

I am currently using dumping for export and lighting for import.

| username: TiDBer_vJpITQ5J | Original post link

So, does that mean all databases with foreign keys cannot be backed up and restored?

| username: xingzhenxiang | Original post link

Check the compatibility

| username: xingzhenxiang | Original post link

| username: TiDBer_vJpITQ5J | Original post link

If I back up from TiDB cluster 1 and restore to TiDB cluster 2, will there also be this compatibility issue?

| username: xingzhenxiang | Original post link

  1. This refers to the incompatibilities with MySQL.
  2. If it’s TiDB to TiDB, you need to check if there are differences between versions, but generally, there are none.
| username: TiDBer_vJpITQ5J | Original post link

I have currently deployed a TiDB cluster of the same version. I used dumping to export from TiDB cluster 1, then transferred the backup file to the server of TiDB cluster 2 and used lightning to import it. Initially, attempting a full export resulted in errors, so I tried exporting a single database. Although there were errors during the single database export as well, at least some SQL files were generated. However, when importing the SQL files, I encountered the following error:

./tidb-lightning -config lightning.toml
Verbose debug logs will be written to tidb-lightning.log

[mysql] 2023/04/21 10:01:18 connection.go:360: invalid connection
[mysql] 2023/04/21 10:01:18 connection.go:360: invalid connection
[mysql] 2023/04/21 10:01:18 connection.go:360: invalid connection
[mysql] 2023/04/21 10:01:18 connection.go:360: invalid connection
tidb lightning encountered error: [Lightning:Restore:ErrCreateSchema] create schema failed, table: `django-mail`.`auth_group_permissions`, stmt: restore table schema: run create schema job failed: Error 1064: You have an error in your SQL syntax; check the manual that corresponds to your TiDB version for the right syntax to use line 8 column 147 near "[FOREIGN KEY] INVALID */,
CONSTRAINT `auth_group_permissio_permission_id_84c5c92e_fk_auth_perm` FOREIGN KEY (`permission_id`) REFERENCES `django-mail`.`auth_permission` (`id`) /*T![FOREIGN KEY] INVALID */
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci;"

[root@yk-plugin04 tidb-community-toolkit-v6.4.0-linux-amd64]# vim lightning.toml