Using BR to Backup to Ceph Bucket, Only Three Keys, Restoring from Ceph Bucket to New Cluster, Process Hangs During Query

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 使用br备份到ceph桶,只有三个key,从ceph桶中恢复到新集群,查询时进程卡死

| username: Anthony99

[TiDB Usage Environment] Test Environment
[TiDB Version] v7.1.0
[Reproduction Path]

  1. Created two clusters

  2. Stored three values a=1, b=2, c=3 in the first cluster

  3. Used br to backup and restore to the new cluster, indicated success, and there are SST files in the S3 bucket

  1. When viewing TiKV data, it directly froze

[Encountered Problem: Problem Phenomenon and Impact]
The new TiKV cluster directly froze when viewing data!
Have any experts encountered similar issues? Please provide some troubleshooting suggestions, thank you.

The logs also show the import of SST;

There is an RPC error:

[Resource Configuration]
[Attachments: Screenshots/Logs/Monitoring]

The two TiKV clusters are as shown below:

| username: tidb狂热爱好者 | Original post link

Are you restoring this directly from S3?

| username: Anthony99 | Original post link

Yes, it was restored from an S3 bucket. Can’t it be executed this way?

| username: tidb狂热爱好者 | Original post link

Non-standard S3 is not supported. This is Ceph.

| username: xfworld | Original post link

Ceph also supports the S3 protocol…

| username: Anthony99 | Original post link

Thank you for the reply. The community people said that Ceph is not a standard S3 protocol, which I don’t quite understand. :joy: :joy:

| username: xfworld | Original post link

I feel the problem is on the client side. Is tcli this one? GitHub - oom-ai/oomplay

The official TiKV client doesn’t have this thing…

Reference link:

| username: buptzhoutian | Original post link

RawKV, right? Use tikv-br
The TiKV-BR tool supports backup and restore for products using RawKV.

| username: xfworld | Original post link

You’re using such a new version, and this hasn’t been updated for so long. Can it support it?

| username: Anthony99 | Original post link

It’s not using this one; it’s using another one GitHub - c4pt0r/tcli: The ultimate CLI tool for TiKV

| username: Anthony99 | Original post link

The mode of txn used for backup and recovery

| username: buptzhoutian | Original post link

I haven’t seen any official documentation on backup and recovery for txn mode, and I don’t understand what this experimental feature is about. :thinking:

| username: Anthony99 | Original post link

I’m a bit confused. The community says Ceph is not supported and recommends MinIO.

| username: dba-kit | Original post link

I see that RawKV should use the tikv-br tool, the command is tikv-br backup raw. From your screenshot, it looks like you are using br backup txn. Can you try importing and exporting with this tool?

| username: Anthony99 | Original post link


Using this tool, nothing was backed up.

| username: xfworld | Original post link

Raw and txn are completely different interfaces… According to the tool’s description, it should not support txn mode.

| username: xfworld | Original post link

You’d better use the officially recommended client… Avoid pitfalls every day…

| username: Anthony99 | Original post link

Thank you, txn is indeed the transaction API, and the officially recommended one also supports the interface.

| username: xfworld | Original post link

BR is not supported, don’t you understand yet… :rofl: :upside_down_face:

| username: Anthony99 | Original post link

I see you’ve been talking about issues with the tcli client, so why is it now about br not being supported? br has a txn option :sweat: :upside_down_face: