Error "etcdserver: duplicate key given in txn request" when scaling up or down TiDB components

translator_bot · June 22, 2024, 10:37pm

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 扩容或缩容TIDB组件时报etcdserver: duplicate key given in txn request错误

| username: TiDBer_hjacbdMD

【TiDB Usage Environment】Production Environment
【TiDB Version】v4.0.5
【Reproduction Path】Execute tiup cluster scale-in or tiup cluster scale-out
【Encountered Problem: Phenomenon and Impact】
Phenomenon: When executing tiup cluster scale-in or tiup cluster scale-out, an error “etcdserver: duplicate key given in txn request” is reported.
Impact: Unknown
【Attachments: Screenshots/Logs/Monitoring】

tiup-cluster-debug-2022-11-28-15-26-37.log (19.7 KB)

translator_bot · June 22, 2024, 10:37pm

| username: srstack | Original post link

How do you import version v4.0.5 into tiup?

translator_bot · June 22, 2024, 10:37pm

| username: buddyyuan | Original post link

You can first check if it is this issue:

github.com/pingcap/tiup

Tiup support delpoy multiple prometheus

opened 07:44AM - 01 Dec 20 UTC

closed 06:40AM - 08 Dec 20 UTC

niezefeng

status/TODO type/feature-request category/monitoring

## Feature Request **Is your feature request related to a problem? Please des…cribe:** I write 2 hosts under monitoring_servers in topology.yml. ``` monitoring_servers: - host: xxxxxx deploy_dir: xxxxxx data_dir: xxxx - host: xxxxx deploy_dir: /data1/tidb_cluster_404/prometheus-11090 data_dir: /data1/tidb_cluster_404/data/prometheus-11090 ``` Then I deploy the cluster successfully. When I try to start this cluster, an error occurs. ``` {"level":"warn","ts":"2020-12-01T14:50:19.102+0800","caller":"clientv3/retry_interceptor.go:61","msg":"retrying of unary invoker failed","target":"endpoint://client-5720b6f4-331e-4d00-bf6c-86be308132d6/172.16.4.87:2579","attempt":0,"error":"rpc error: code = InvalidArgument desc = etcdserver: duplicate key given in txn request"} Error: etcdserver: duplicate key given in txn request Verbose debug logs has been written to /home/tidb/tiup/anthony/logs/tiup-cluster-debug-2020-12-01-14-50-19.log. Error: run `/home/tidb/.tiup/components/cluster/v1.2.5/tiup-cluster` (wd:/home/tidb/.tiup/data/SHtnkRR) failed: exit status 1 ``` Verbose debug logs ``` 2020-12-01T14:50:19.102+0800 INFO Execute command finished {"code": 1, "error": "etcdserver: duplicate key given in txn request", "errorVerbose": "etcdserver: duplicate key given in txn request\ngithub.com/pingcap/errors.AddStack\n\tgithub.com/pingcap/errors@v0.11.5-0.20200820035142-66eb5bf1d1cd/errors.go:174\ngithub.com/pingcap/errors.Trace\n\tgithub.com/pingcap/errors@v0.11.5-0.20200820035142-66eb5bf1d1cd/juju_adaptor.go:15\ngithub.com/pingcap/tiup/pkg/cluster.(*Manager).StartCluster\n\tgithub.com/pingcap/tiup@/pkg/cluster/manager.go:170\ngithub.com/pingcap/tiup/components/cluster/command.newStartCmd.func1\n\tgithub.com/pingcap/tiup@/components/cluster/command/start.go:38\ngithub.com/spf13/cobra.(*Command).execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:842\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\tgithub.com/spf13/cobra@v1.0.0/command.go:950\ngithub.com/spf13/cobra.(*Command).Execute\n\tgithub.com/spf13/cobra@v1.0.0/command.go:887\ngithub.com/pingcap/tiup/components/cluster/command.Execute\n\tgithub.com/pingcap/tiup@/components/cluster/command/root.go:249\nmain.main\n\tgithub.com/pingcap/tiup@/components/cluster/main.go:23\nruntime.main\n\truntime/proc.go:203\nruntime.goexit\n\truntime/asm_amd64.s:1357"} ``` I can see 2 Prometheus is running: ![image](https://user-images.githubusercontent.com/37355882/100710885-6339de00-33eb-11eb-8405-361aed449e86.png) And I can manually add data source in the grafana and query the data. ![image](https://user-images.githubusercontent.com/37355882/100711035-a85e1000-33eb-11eb-8e90-665366d12332.png) TiDB dashboard has some issues, even the config in PD is right ![image](https://user-images.githubusercontent.com/37355882/100711118-caf02900-33eb-11eb-891f-2510d00b8dfb.png) **Describe the feature you'd like:** Tiup can fully support deploy multiple Prometheus and grafana without significant error.