In the TiDB CDC monitoring Grafana template, the synchronization progress of each data table in the synchronization task explicitly shown in the official documentation is not visible

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: tidb cdc监控grafana的模板中看不到官方文档上显式的同步任务中各数据表的同步进度

| username: TiDBer_20QjYTLl

[TiDB Usage Environment] Production Environment / Testing / PoC
[TiDB Version] v6.5.0

Since we want to integrate TiDB monitoring into our existing Grafana, we did not use the official TiDB Grafana but instead integrated the relevant Grafana templates from the official tidb-community-toolkit package into our existing Grafana. We found that the TiDB CDC monitoring does not include the monitoring of the synchronization progress of each data table in the task mentioned on the official website (the third panel in the first row of the screenshot).

Below is a screenshot from the official website regarding changefeed monitoring:

Could you please tell me the reason?

| username: Daniel-W | Original post link

Do you not have a panel for Grafana changefeed or what does it look like?

| username: TiDBer_20QjYTLl | Original post link

There is a changefeed panel, but it is different from the one on the official website. The official website explicitly shows the synchronization progress of each table in the task, but I can’t see it here.

| username: 这里介绍不了我 | Original post link

The progress of each table?

| username: xfworld | Original post link

Is it the wrong version…

| username: TiDBer_20QjYTLl | Original post link

The version is correct. Could you post the JSON of the panel for each table’s progress? I’ll take a look.

| username: TiDBer_20QjYTLl | Original post link

Yes, take a look at the screenshot on the official website: TiCDC 重要监控指标详解 | PingCAP 文档中心

| username: 这里介绍不了我 | Original post link

Which specific panel are you referring to?

| username: Soysauce520 | Original post link

It should be a version issue. You can create your own graph based on the Prometheus metric ticdc_scheduler_capture_table. You have a count graph that uses the sum formula; removing the sum and breaking it down should work.

| username: Jiawei | Original post link

I agree with the previous comment. You can check the calculation formulas of the panels you think have issues. In theory, all metrics have been collected, but there might be problems during processing.

| username: TiDBer_20QjYTLl | Original post link

Could you please let me know which specific metric indicates the progress? I don’t see metrics for each data table in the results from http://xxxxx8300/metrics.

| username: Soysauce520 | Original post link

Open the Grafana address and enter this ticdc_scheduler_capture_table.

| username: redgame | Original post link

It is about custom monitoring of the synchronization progress of monitoring data tables, right?

| username: TiDBer_20QjYTLl | Original post link

Could you please elaborate, or paste the key code of the JSON template? How exactly is the custom monitoring done?

| username: TiDBer_20QjYTLl | Original post link

The one about changefeed.

| username: 这里介绍不了我 | Original post link

Check the variables on the dashboard to see if they can be displayed normally.

| username: gary | Original post link

Is it that all the monitoring is missing or just one monitoring item?

| username: TiDBer_5cwU0ltE | Original post link

They customized it. Although it’s also Grafana. Or maybe there’s a configuration issue, why not try changing it?

| username: danghuagood | Original post link

Mainly check the following two aspects:
The first is the data source issue. Have you added the TiDB monitoring data source in your own Grafana?
The second is the compatibility issue with versions. Different versions of Grafana may have slight differences, such as modifications to certain fields.

| username: TiDBer_aaO4sU46 | Original post link

My colleague said… could it be a browser issue?