大量报错：tikv 和 tiflash 通信时检查 leader 失败

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: tikv 和tiflash通信 大量报错 check leader failed

| username: foxchan

[TiDB Usage Environment] Production
[TiDB Version] v5.3.1

[Issue and Impact]
tikv logs are flooded with ERROR messages

image
image1680×367 13.4 KB

These to_store are tiflash, what is the impact?

2
| username: songxuecheng | Original post link
  1. Check if there are any issues with TiFlash.
  2. Check if there are any network issues between PD and TiFlash.
3
| username: foxchan | Original post link

The network ping and telnet are both working, but accessing the local TiFlash from the local TiKV still reports an error.

image
image1661×137 8.46 KB

image
image693×235 2.7 KB

I would like to understand the detection mechanism and the principles of judgment.

4
| username: songxuecheng | Original post link
  1. Please send the complete topology.
  2. Confirm the status of TiFlash.
  3. For the local mixed deployment of TiKV and TiFlash, check the storage space and whether the local firewall is enabled.
  4. How are the placement rules configured?
5
| username: heming | Original post link

Upgrading to 5.4.2 seems to have resolved this issue.

6
| username: cs58_dba | Original post link

It is estimated that the new version has fixed it.

7
| username: heming | Original post link

We also have two clusters with version 5.3.1. We will schedule an upgrade soon to see how it goes.

8
| username: songxuecheng | Original post link

The source code is here.

9
| username: foxchan | Original post link

After upgrading to 5.4.2, the error disappeared.

10
| username: TiDBer_o0MXVuK4 | Original post link

Version 6.1.0 also has this issue.

11
| username: system | Original post link

This topic was automatically closed 1 minute after the last reply. No new replies are allowed.