TiFlash Down

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: tiflash down

| username: TiDBer_zZFAsV6w

Could you please take a look, all three TiFlash nodes are down?

2
| username: 裤衩儿飞上天 | Original post link

Is there an issue with the disk? Is it mounted properly? Are there any permission issues?

3
| username: TiDBer_zZFAsV6w | Original post link

The default value of tidb_gc_life_time is 10m, which means that the data deleted 10 minutes ago will be cleaned up. If you want to keep the data for a longer time, you can set a longer value, such as 24h.

4
| username: TiDBer_zZFAsV6w | Original post link

It looks like there are permissions.

5
| username: TiDBer_zZFAsV6w | Original post link

The image you provided is not accessible. Please provide the text you need translated.

6
| username: ShawnYan | Original post link

Are there any more logs?
What operations were performed just now, such as creating a TiFlash replica by database?

7
| username: ShawnYan | Original post link

Is the version 7.2.0? DMR version,
Is this a test environment?

8
| username: TiDBer_zZFAsV6w | Original post link

In the production environment, I just enabled flash synchronization. After reducing everything, expanding again, and re-enabling tiflash, it worked again. Strange.

9
| username: TiDBer_zZFAsV6w | Original post link

After rebuilding, another error was reported.

10
| username: wangccsy | Original post link

Can’t optimize the query? Row-to-column conversion query.

11
| username: ShawnYan | Original post link

After expanding TiFlash, data will not be automatically synchronized by default. Did the error occur after synchronizing by database? Try synchronizing table by table to see if it works.

12
| username: ShawnYan | Original post link

If it is a production environment, the official documentation has relevant statements, and it is recommended to use the LTS version.

13
| username: TiDBer_zZFAsV6w | Original post link

What is causing the current issue, is it easy to locate?

14
| username: Billmay表妹 | Original post link

It is recommended to test and upgrade to version 7.5.0~

Do not use the DMR version in the production environment~

Upgrade as soon as possible~

15
| username: TiDBer_zZFAsV6w | Original post link

Okay, we have identified a table, it might be a data issue, closing it resolved the problem.

16
| username: Billmay表妹 | Original post link

Sure~ If there’s a chance, upgrade it~
Version 7.2.0 doesn’t have minor versions, so bugs can’t be debugged in a timely manner. For safety reasons, upgrade to the LTS version.

17
| username: Jellybean | Original post link

The only LTS version greater than v7.2 is v7.5 :laughing:

18
| username: dba远航 | Original post link

It’s good to have located the problem.

19
| username: oceanzhang | Original post link

There are indeed many issues with TiDB. If you want to use it, you must be prepared to upgrade at any time, and the operations personnel must also have a certain level of expertise.

20
| username: oceanzhang | Original post link

It seems that we can temporarily launch TiDB on our side.