Batch Size of Lightning

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: lightning的批次大小

| username: h5n1

How much data is submitted as a batch during each logical import in Lightning? Can the number of values in each generated insert/replace SQL be controlled by the number of rows?

| username: knull | Original post link

I looked for it but couldn’t find it. It should be automatically adjusted, right?

| username: redgame | Original post link

No specific details provided.

| username: zhanggame1 | Original post link

The documentation doesn’t specify how much data should be submitted as a batch. I did a simple test and found that dumpling settings can allow a single SQL statement to submit multiple rows of data.

| username: 昵称想不起来了 | Original post link

I didn’t see any support for controlling the quantity in the configuration file. If you are worried about resource preemption and OOM, the official documentation mentions using the parameter region-concurrency for control.