Pump Check Data Synchronization Delay

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: pump 检查数据同步延迟

| username: xiaohetao

[TiDB Usage Environment] Production Environment
[TiDB Version] v4.0.6

The data synchronization uses the pump and drainer tools. Besides checking the running status of the synchronization tools, how can I check the data synchronization status and data synchronization delay?

| username: xiaohetao | Original post link

Is there a correlation between max_commit_ts in “show pump status; show drainer status;” and position in “show master status”?

| username: RenlySir | Original post link

You can check the latency in the Grafana monitoring. Please take a look.

| username: WalterWj | Original post link

You can check the latency situation in Grafana monitoring.

You can take a look at this: TiDB Binlog 集群监控 | PingCAP 文档中心.

I recommend upgrading to use CDC. The version is too old, and the code hasn’t been updated for a long time.

| username: TiDBer_C33 | Original post link

You can check the commitTS in the checkpoint table of the schema configured in your drainer to determine up to which point in time the drainer has synchronized.

| username: 像风一样的男子 | Original post link

You can view the TSO synchronized by Drainer in Grafana monitoring.

| username: Daniel-W | Original post link

If there is a downstream cluster, you can also check the checkpoint to determine the task progress TSO.

select * from tidb_binlog.checkpoint;
| username: zhang_2023 | Original post link

show pump status; show drainer status;

| username: buddyyuan | Original post link

Just look directly in Grafana, the chart mentioned above will do. On the left, check the drainer delay, and on the right, see the position where the pump is working.

| username: Soysauce520 | Original post link

No relation. SHOW MASTER STATUS is the latest TSO of the cluster itself. It has nothing to do with the previous two.

| username: TiDBer_ok0VXN1s | Original post link

Look at Grafana.

| username: TiDBer_rvITcue9 | Original post link

show pump status;
show drainer status;

| username: xiaohetao | Original post link

Okay, thank you.

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.