GC Time Settings

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: gc时间设置

| username: TiDBer_pkQ5q1l0

[TiDB Usage Environment] Production Environment
[TiDB Version]
Need to use TiCDC for data synchronization. The system’s default gc_lifetime is 10 minutes. About 1 billion data needs to be imported into another cluster using Lightning, and then synchronized. May I ask, what do you usually set tidb_gc_life_time to when doing TiCDC synchronization? I have set it to 8 hours now, is that too high?
[Resource Configuration]
[Attachment: Screenshot/Log/Monitoring]

| username: Liuhaoao | Original post link

You can evaluate how long the data synchronization takes, and then decide how much to adjust the GC based on the synchronization process duration.

| username: Raymond | Original post link

If TiCDC has unsynchronized data that hasn’t been synchronized to the same city, TiCDC will block the GC of the TiDB cluster.

| username: TiDBer_pkQ5q1l0 | Original post link

Data import also takes a long time. If you don’t adjust the GC in advance, the data might expire within 10 minutes, and the TSO used during export would become invalid, right?

| username: Ming | Original post link

What you’re referring to is the GC of the TiDB cluster itself, which is not the same configuration as TiCDC’s GC, right? You just need to ensure that the export time does not exceed the GC of the TiDB cluster itself, and then the time for export + Lightning + TiCDC does not exceed TiCDC’s GC, which seems to be 24 hours by default.

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.