Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.
Original topic: TiKV 集群规模有限制吗,是否有上百PB生产部署的实践?
【TiDB Usage Environment】Production Environment
【TiDB Version】
【Reproduction Path】What operations were performed when the issue occurred
【Encountered Issues: Issue Phenomenon and Impact】
【Resource Configuration】
【Attachments: Screenshots/Logs/Monitoring】
Handling hundreds of PB with TiDB might be a bit difficult; TiDB generally supports up to 1PB at most, with a maximum of 512 nodes.
Hundreds of petabytes of databases are something that most companies can’t afford. What kind of company is this? Even having petabytes is quite rare.
The scenario involves metadata storage of hundreds of PB, and I want to see the scalability of TiKV.
According to the official website, it supports PB-level clusters:
TiDB adopts a compute-storage separation architecture, allowing independent scaling of compute and storage. It supports up to 512 compute nodes, with each node supporting up to 1000 concurrent connections, and the cluster capacity can reach PB levels.
Ordinary company. What is the maximum scale supported by a KV database?
100PB? That’s terrifying, isn’t it? I doubt it. We have less than 1TB…
@Billmay cousin @Kongdom moderators, do you know about this?
I remember NetEase’s hot and cold storage is close to 330TB.
Refer to:
TiDB Cluster Online NVME Disk Replacement Optimization Practice for Hundreds of TB
TiDB Hot and Cold Storage Separation Solution
专栏 - TiDB 冷热存储分离解决方案 | TiDB 社区 (The entire cluster is approximately 330TB)
Is there a single cluster with PB scale?
At present, it feels like having over a hundred terabytes is already affecting backups.
What limits the maximum support to 512 nodes?
What does backup refer to?
Can I ask the experts about this test data and theoretical values: TiDB 6.6.0 Release Notes | PingCAP 文档中心
Is this scale of data still suitable for using a database? Even if the cluster supports it, it would be quite difficult to query what you want, right?
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.