Is the SSD size for TiKV limited to no more than 2 TB?

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: TiKV 硬盘大小SSD 不超过 2 TB吗?

| username: TiDBer_iLonNMYE

[TiDB Usage Environment] Production Environment / Testing / Poc
[TiDB Version]
[Reproduction Path] What operations were performed when the issue occurred
[Encountered Issue: Issue Phenomenon and Impact]
[Resource Configuration]
[Attachments: Screenshots / Logs / Monitoring]

Studying the V6.5 manual, TiDB 软件和硬件环境建议配置 | PingCAP 文档中心
Deploying a standard cluster → Hardware and software environment requirements → Notes mention:

  • TiKV disk size configuration recommends PCI-E SSD not exceeding 2 TB, ordinary SSD not exceeding 1.5 TB.

So, assuming a 100TB cluster, you need 50 TiKV nodes, and with three replicas, you need 150 nodes? That’s quite large in scale. Can TiKV support larger SSDs? Thank you.

| username: 大鱼海棠 | Original post link

You can deploy multiple instances on a single machine.
For example, on a single machine with 1 regular SSD and 3 PCIe SSDs, you can deploy 1 TiDB server and 3 TiKV instances (each KV instance on a separate disk).
Other components can be deployed similarly.
Try to deploy PD on high-performance disks.

| username: tidb菜鸟一只 | Original post link

No, he only suggested the hard disk size, not the LVM size. Can’t you just attach several hard disks to one LVM? However, if the cluster size exceeds 100TB, you still need around 50 machines, otherwise, the CPU and memory won’t keep up, right? It’s not just about storing data, you also need to process it…

| username: TiDBer_iLonNMYE | Original post link

This is one way, but it will incur some additional maintenance and management costs.

| username: TiDBer_iLonNMYE | Original post link

In practice, can TiKV support more than two 2TB SSDs?

| username: 大鱼海棠 | Original post link

It is not recommended to have a single KV space that is too large. Generally, it is suggested to keep the number of regions per single KV below 50,000. Having too large a disk is also a waste. Having too many regions in a single KV can lead to performance issues. You can check the official website for region optimization to understand more.

| username: tidb菜鸟一只 | Original post link

Sure, but it’s also not recommended to have a single TiKV too large. Generally, having one TiKV with two 2TB SSDs is about right. Any more than that and the performance may not be optimal.

| username: TiDBer_iLonNMYE | Original post link

Got it, thanks to both of you.

| username: xingzhenxiang | Original post link

My usage has already exceeded
image

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.