BR Multi-Process Backup

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: br多进程备份

| username: Running

Can multi-threaded backup be enabled to speed up the backup process? Currently, backing up over 100GB of data from a single instance to MinIO takes an hour.

2
| username: GreenGuan | Original post link
  1. Check if the br backup command has a ratelimit restriction.
  2. Minio also has a layer of write limitations; check if the resources are fully utilized.
  3. Then check the resource usage of the br backup machine.
3
| username: Running | Original post link

Is there a parameter to set the concurrency of BR?

4
| username: GreenGuan | Original post link

I only know about rate limiting, haven’t heard of controlling concurrency. From your description of the scenario, it feels like the bottleneck shouldn’t be in BR.

5
| username: HACK | Original post link

It seems like I haven’t seen this kind of parameter before.

6
| username: cs58_dba | Original post link
  • It is recommended to use a high-performance SSD network disk, mounted on the BR node and all TiKV nodes. A 10 Gigabit network card is recommended for the network disk; otherwise, bandwidth may become a performance bottleneck during backup and recovery.
7
| username: Raymond | Original post link

Parameter settings for br concurrency

  1. Check the setting of backup.num-threads
  2. Check the read and write performance of the disk
8
| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.