After Scaling Up or Down the TiDB Cluster, the Dashboard Overview Only Displays Partial Node Information

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 扩容缩容Tidb集群后,dashboard概述只显示部分节点信息

| username: TiDBer_urucx2qA

[TiDB Usage Environment] Production Environment
[TiDB Version] V6.1.3
[Reproduction Path] Initially, both internal and external IPs were used during deployment. Later, all external IPs were changed to internal ones through scaling in and out. After this change, the dashboard started having issues (the cluster has 6 servers, and 3 of them had their IPs changed), only showing information for the nodes that were not modified.
[Encountered Problem: Symptoms and Impact]
[Resource Configuration]
[Attachments: Screenshots/Logs/Monitoring]

| username: Kongdom | Original post link

If it appears in tiup cluster display but not in the dashboard, you can try restarting the PD node, the one with the UI.

| username: TiDBer_urucx2qA | Original post link

Restarting the node didn’t help either. It seems to be because of this error.

| username: 小王同学Plus | Original post link

This error is because your node_exporter did not start successfully. You can manually start it and check the logs for any error messages.

May I ask, has this issue been resolved?

| username: Kongdom | Original post link

Refer to the reply from the expert above and post the logs under the error node to take a look.

| username: tracy0984 | Original post link

Is there no issue with the SSH configuration? The logs indicate that the command to start the node_exporter service via SSH did not succeed. Can you try executing it manually?

| username: TI表弟 | Original post link

Check if there is a system node_exporter on the node. It is highly likely that the port conflict is caused by the system’s built-in node_exporter. In that case, you need to change the port of the system node_exporter.

| username: TI表弟 | Original post link

Scaling in and then scaling out Prometheus will solve everything.

| username: Kongdom | Original post link

:+1::+1::+1:

| username: TI表弟 | Original post link

Buddy, has the problem been solved? Give me a best answer.