Backup Failure in v6.4.0

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: v6.4.0备份失败

| username: TiDBer_vJpITQ5J

[TiDB Usage Environment] Production Environment / Test / Poc

Using the dumpling tool for backup shows an error
./dumpling -h 10.200.78.103 -P 4003 -u root -p ‘password’ --filetype sql -t 32 -F 256m -o /opt/data/
Release version: v6.4.0
Git commit hash: cf36a9ce2fe1039db3cf3444d51930b887df18a1
Git branch: heads/refs/tags/v6.4.0
Build timestamp: 2022-11-13 05:17:51Z
Go version: go version go1.19.2 linux/amd64

[2023/04/20 17:52:35.923 +08:00] [INFO] [versions.go:54] [“Welcome to dumpling”] [“Release Version”=v6.4.0] [“Git Commit Hash”=cf36a9ce2fe1039db3cf3444d51930b887df18a1] [“Git Branch”=heads/refs/tags/v6.4.0] [“Build timestamp”=“2022-11-13 05:17:51”] [“Go Version”=“go version go1.19.2 linux/amd64”]
[2023/04/20 17:52:35.928 +08:00] [INFO] [version.go:398] [“detect server version”] [type=TiDB] [version=6.4.0]
[2023/04/20 17:52:35.943 +08:00] [INFO] [global.go:34] [“[pd] create pd client with endpoints”] [pd-address=“[10.200.78.102:2379,10.200.78.101:2379]”]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] update member urls”] [old-urls=“[http://10.200.78.102:2379,http://10.200.78.101:2379]”] [new-urls=“[http://10.200.78.101:2379,http://10.200.78.102:2379]”]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] switch leader”] [new-leader=http://10.200.78.102:2379] [old-leader=]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] init cluster id”] [cluster-id=7173715422814811436]
[2023/04/20 17:52:35.951 +08:00] [INFO] [global.go:34] [“[pd] tso dispatcher created”] [dc-location=global]
[2023/04/20 17:52:35.953 +08:00] [INFO] [dump.go:1488] [“generate dumpling gc safePoint id”] [id=dumpling_1681984355953297887]
[2023/04/20 17:52:35.969 +08:00] [INFO] [dump.go:131] [“begin to run Dump”] [conf=“{“s3”:{“endpoint”:”“,“region”:”“,“storage-class”:”“,“sse”:”“,“sse-kms-key-id”:”“,“acl”:”“,“access-key”:”“,“secret-access-key”:”“,“provider”:”“,“force-path-style”:true,“use-accelerate-endpoint”:false,“role-arn”:”“,“external-id”:”“,“object-lock-enabled”:false},“gcs”:{“endpoint”:”“,“storage-class”:”“,“predefined-acl”:”“,“credentials-file”:”“},“azblob”:{“endpoint”:”“,“account-name”:”“,“account-key”:”“,“access-tier”:”“},“AllowCleartextPasswords”:false,“SortByPk”:true,“NoViews”:true,“NoSequences”:true,“NoHeader”:false,“NoSchemas”:false,“NoData”:false,“CompleteInsert”:false,“TransactionalConsistency”:true,“EscapeBackslash”:true,“DumpEmptyDatabase”:true,“PosAfterConnect”:false,“CompressType”:0,“Host”:“10.200.78.103”,“Port”:4003,“Threads”:32,“User”:“root”,“Security”:{“CAPath”:”“,“CertPath”:”“,“KeyPath”:”“},“LogLevel”:“info”,“LogFile”:”“,“LogFormat”:“text”,“OutputDirPath”:”/opt/data/“,“StatusAddr”:”:8281",“Snapshot”:“440922107003011073”,“Consistency”:“snapshot”,“CsvNullValue”:“\N”,“SQL”:“”,“CsvSeparator”:“,”,“CsvDelimiter”:“"”,“Databases”:,“Where”:“”,“FileType”:“sql”,“ServerInfo”:{“ServerType”:3,“ServerVersion”:“6.4.0”,“HasTiKV”:true},“Rows”:0,“ReadTimeout”:900000000000,“TiDBMemQuotaQuery”:0,“FileSize”:268435456,“StatementSize”:1000000,“SessionParams”:{“tidb_snapshot”:“440922107003011073”},“Tables”:{},“CollationCompatible”:“loose”}"]
[2023/04/20 17:52:36.973 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=gen_table]
[2023/04/20 17:52:36.974 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=gen_table]
[2023/04/20 17:52:36.978 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=gen_table] [chunkIdx=0]
[2023/04/20 17:52:36.988 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=gen_table_column]
[2023/04/20 17:52:36.988 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=gen_table_column]
[2023/04/20 17:52:36.993 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=gen_table_column] [chunkIdx=0]
[2023/04/20 17:52:37.104 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=hsq-system] [table=sys_oss]
[2023/04/20 17:52:37.104 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=sys_oss]
[2023/04/20 17:52:37.107 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=sys_oss] [chunkIdx=0]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:741] [“get estimated rows count”] [database=hsq-system] [table=undo_log] [estimateCount=10000]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:747] [“fallback to sequential dump due to estimate count < rows. This won’t influence the whole dump process”] [“estimate count”=10000] [conf.rows=200000] [database=hsq-system] [table=undo_log]
[2023/04/20 17:52:37.215 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=hsq-system] [table=undo_log]
[2023/04/20 17:52:37.218 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=hsq-system] [table=undo_log] [chunkIdx=0]
[2023/04/20 17:52:37.277 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=gen_table]
[2023/04/20 17:52:37.277 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=gen_table]
[2023/04/20 17:52:37.281 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=gen_table] [chunkIdx=0]
[2023/04/20 17:52:37.287 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=gen_table_column]
[2023/04/20 17:52:37.287 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=gen_table_column]
[2023/04/20 17:52:37.290 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=gen_table_column] [chunkIdx=0]
[2023/04/20 17:52:37.298 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_blog_info]
[2023/04/20 17:52:37.298 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_blog_info]
[2023/04/20 17:52:37.306 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_blog_info] [chunkIdx=0]
[2023/04/20 17:52:37.333 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_fans_info]
[2023/04/20 17:52:37.333 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_fans_info]
[2023/04/20 17:52:37.338 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_fans_info] [chunkIdx=0]
[2023/04/20 17:52:37.359 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=ins-collect] [table=ins_media_info]
[2023/04/20 17:52:37.359 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=ins-collect] [table=ins_media_info]
[2023/04/20 17:52:37.362 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=ins-collect] [table=ins_media_info] [chunkIdx=0]
[2023/04/20 17:52:37.428 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok_data_audit] [table=super_operate_log]
[2023/04/20 17:52:37.429 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok_data_audit] [table=super_operate_log]
[2023/04/20 17:52:37.431 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok_data_audit] [table=super_operate_log] [chunkIdx=0]
[2023/04/20 17:52:37.541 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_account_proxy_flow_record]
[2023/04/20 17:52:37.541 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_account_proxy_flow_record]
[2023/04/20 17:52:37.544 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_account_proxy_flow_record] [chunkIdx=0]
[2023/04/20 17:52:37.604 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_apps]
[2023/04/20 17:52:37.604 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_apps]
[2023/04/20 17:52:37.608 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_apps] [chunkIdx=0]
[2023/04/20 17:52:37.629 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_comment_task_detail]
[2023/04/20 17:52:37.629 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_comment_task_detail]
[2023/04/20 17:52:37.631 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_comment_task_detail] [chunkIdx=0]
[2023/04/20 17:52:37.665 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_device]
[2023/04/20 17:52:37.665 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_device]
[2023/04/20 17:52:37.667 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_device] [chunkIdx=0]
[2023/04/20 17:52:37.674 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_handle_queue]
[2023/04/20 17:52:37.674 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_handle_queue]
[2023/04/20 17:52:37.681 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_handle_queue] [chunkIdx=0]
[2023/04/20 17:52:37.691 +08:00] [INFO] [dump.go:735] [“fallback to sequential dump due to no proper field. This won’t influence the whole dump process”] [database=tiktok] [table=t_label]
[2023/04/20 17:52:37.691 +08:00] [INFO] [dump.go:698] [“didn’t build tidb concat sqls, will select all from table now”] [database=tiktok] [table=t_label]
[2023/04/20 17:52:37.693 +08:00] [INFO] [writer.go:265] [“no data written in table chunk”] [database=tiktok] [table=t_label] [

| username: Billmay表妹 | Original post link

Based on the information you provided, the error message “fallback to sequential dump due to no proper field. This won’t influence the whole dump process” means that due to the absence of a suitable field, the backup process needs to fall back to sequential backup mode. This error will not affect the entire backup process, but it will slow down the backup speed.

I suggest you check whether the table to be backed up exists and whether you have sufficient permissions to perform the backup. Additionally, you can try using other backup tools, such as TiDB Lightning, to perform the backup. TiDB Lightning is an official high-speed data import tool provided by TiDB, which supports importing data from MySQL, TiDB, MariaDB, and other databases into TiDB.

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.