There is still space in the pump, but binlog writing failed

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: pump 还有剩余空间,但是binlog 写入失败

| username: Raymond

Could anyone please explain why the binlog fails to write even though there is still some space left in the pump, but not much? Is it because the pump has a similar mechanism to TiKV, where it doesn’t allow data to be written when there is only a little space left?

| username: buddyyuan | Original post link

Check the logs. Additionally, if the pump space was ever full, it will continue to fail to write unless the pump is restarted.

| username: Raymond | Original post link

Pump has never been full before. From the monitoring and the tidb.log, it indicates that writing to Pump failed, and the error also says there is no space left. If it had been full before, it would only clear Pump files through GC, but it should not have reached the GC trigger time yet.

| username: buddyyuan | Original post link

Please upload the pump logs to check the error reason.

| username: Raymond | Original post link

Thank you, master. The logs are not very convenient to extract. Thank you, master.

| username: Raymond | Original post link

The official documentation has it written.

| username: Lucien-卢西恩 | Original post link

It could be a large transaction, so the estimated space is insufficient and cannot be written. You can estimate it using actual data and transaction size.

| username: Raymond | Original post link

It’s not a large transaction; it just has its own space protection mechanism.

| username: jansu-dev | Original post link

Since the write failed, there should be an error in the pump log, or is there a more detailed error in tidb.log? Can you post it?

| username: Raymond | Original post link

The tidb.log contains “write binlog pump failed”. The pump.log should also have it, but I haven’t checked it.

| username: jansu-dev | Original post link

pupm.log should indicate why the write failed.

| username: system | Original post link

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.