Issue with TSO Identification in Pump

Translated
1

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: pump识别的TSO位点问题

| username: 大鱼海棠

【TiDB Usage Environment】Production\Test Environment\POC
【TiDB Version】

【Encountered Issues】Issue Consultation

  1. After enabling binlog in TiDB and deploying binlog synchronization, does the pump component recognize binlog data from the time point of pump deployment onwards, or can it recognize and transmit all unexpired TiDB binlog data to the drainer?
  2. Is pump gc the expiration time of TiDB binlog?
    【Reproduction Path】What operations were performed to encounter the issue
    【Issue Phenomenon and Impact】
    【Attachments】
  • Relevant logs, configuration files, Grafana monitoring (https://metricstool.pingcap.com/)
  • TiUP Cluster Display information
  • TiUP Cluster Edit config information
  • TiDB-Overview monitoring
  • Corresponding module Grafana monitoring (if any, such as BR, TiDB-binlog, TiCDC, etc.)
  • Corresponding module logs (including logs one hour before and after the issue)

If the question is related to performance optimization or fault troubleshooting, please download the script and run it. Please select all and copy-paste the terminal output results for upload.

2
| username: ddhe9527 | Original post link

By default, synchronization starts from the latest moment after the drainer goes online.

3
| username: 大鱼海棠 | Original post link

Assuming that before deploying pump, TiDB has already enabled binlog, and the recorded TSO at this time is 1.
After deploying pump, the recorded TSO at this time is 2.
Assuming that the binlogs at both points have not been cleaned up,
can the initial-commit-ts of drainer be set to 1?

4
| username: ddhe9527 | Original post link

You need to deploy Pump to enable binlog, otherwise an error will occur.

5
| username: 大鱼海棠 | Original post link

At that point, after the pump deployment is completed, record the TSO. If the binlog exists, the drainer can start synchronizing from this TSO, right?

6
| username: ddhe9527 | Original post link

By default, Drainer will obtain the latest TSO from PD and start replication from that point.

7
| username: system | Original post link

This topic will be automatically closed 60 days after the last reply. No new replies are allowed.