Scaling Down a PD: TiUP Display No Longer Shows It, but It Continues to Alert as PD Down

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 缩容某pd ,tiup display 已看不到,但是一直告警该pd down。

| username: 林夕一指

[TiDB Usage Environment] Production Environment / Testing / PoC
[TiDB Version] V6.5.0
[Reproduction Path] What operations were performed that led to the issue
[Encountered Issue: Issue Phenomenon and Impact]
[Resource Configuration] Go to TiDB Dashboard - Cluster Info - Hosts and take a screenshot of this page
[Attachments: Screenshots/Logs/Monitoring]


| username: WalterWj | Original post link

Reload Prometheus

| username: 林夕一指 | Original post link

I’ll give it a try.

| username: tidb菜鸟一只 | Original post link

Can you still see this node in the member section of pdctl?

| username: 林夕一指 | Original post link

No, so it’s very strange.

| username: xingzhenxiang | Original post link

After a while, it disappears. I’ve encountered something similar before.

| username: tidb菜鸟一只 | Original post link

If it’s not in PD but only in the monitoring, then just reload Prometheus…

| username: 大飞哥online | Original post link

Or simply use tiup cluster reload tidbname to reload the cluster.

| username: Fly-bird | Original post link

Try restarting the monitoring or Grafana.

| username: Kongdom | Original post link

Under normal circumstances, you can reload the node or restart the cluster. However, production clusters generally do not have the conditions for a restart.

| username: ajin0514 | Original post link

If it’s not in PD, only in the monitoring, then just reload Prometheus.