Using Lightning to Export to TiDB Error Message "msg":"retrying of unary invoker failed" Long Retry Time and Multiple Attempts Required to Complete

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 用lightning 导出到tidb 异常信息 “msg”:“retrying of unary invoker failed” 长时间重试多次才能完成

| username: TiDBer_卑微打工rer

[TiDB Usage Environment] Production Environment / Testing / PoC
[TiDB Version] v7.1.0
[Reproduction Path] What operations were performed when the issue occurred
[Encountered Issue: Issue Phenomenon and Impact] Importing parquet files from HDFS into TiDB, KV import has finished, but it keeps retrying without obvious errors, and eventually succeeds. Seeking guidance from experts…
[Resource Configuration]
[Attachments: Screenshots/Logs/Monitoring]

| username: Fly-bird | Original post link

Failed to query the database, it might be a connection issue.

| username: TiDBer_卑微打工rer | Original post link

If the local disk configuration is relatively low, will it cause this situation to occur?


warn in the log

| username: Fly-bird | Original post link

The minimum disk requirement is SSD. If the configuration is low, it will affect the write performance.

| username: 大飞哥online | Original post link

Yes, if the disk data cannot be processed in time, tasks will accumulate and eventually time out.

| username: xfworld | Original post link

Check the PD logs. It seems like it can’t handle it and just hangs.

| username: TiDBer_卑微打工rer | Original post link

The disk has always been full. I have already applied for a replacement. Let’s try it first.

| username: TiDBer_卑微打工rer | Original post link

I’ll take a look later, thanks.

| username: 大飞哥online | Original post link

Got it, improve the disk performance.