During the data import process, TiDB nodes frequently go down automatically

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 在导入数据过程中,tidb节点老是自动down掉

| username: 朵拉大虾

[TiDB Usage Environment] Production Environment / Testing / Poc Testing Environment
[TiDB Version] 6.5.0
[Reproduction Path] What operations were performed to cause the issue: The system crashes every time during data import when a certain amount of data is reached.
[Encountered Issue: Phenomenon and Impact] The system crashes every time during data import when a certain amount of data is reached.
[Resource Configuration]
[Attachments: Screenshots/Logs/Monitoring]


| username: 朵拉大虾 | Original post link

The current status is like this.

| username: 啦啦啦啦啦 | Original post link

Check the logs to see if it is OOM (Out of Memory).

| username: 朵拉大虾 | Original post link

What is OOM, bro?

| username: 朵拉大虾 | Original post link

After a while, it automatically recovered, but it keeps going down automatically during my data import process.

| username: Holland | Original post link

Out of memory

| username: 朵拉大虾 | Original post link

The memory is sufficient.

| username: tidb狂热爱好者 | Original post link

Importing OOM means the SQL result set is too large.

| username: 朵拉大虾 | Original post link

So where should I look to determine if it’s an OOM issue?

| username: Jolyne | Original post link

Check for OOM

grep "Out of memory" /var/log/messages
egrep -i -r 'killed process' /var/log
| username: tidb菜鸟一只 | Original post link

3.2 OOM Issues

Refer to the steps inside to troubleshoot.

| username: 朵拉大虾 | Original post link

This is the log.

| username: 朵拉大虾 | Original post link

Okay, thank you.

| username: 朵拉大虾 | Original post link

Okay, thank you.

| username: 朵拉大虾 | Original post link

The image is not visible. Please provide the text you need translated.

| username: 朵拉大虾 | Original post link

Bro, is it this one?

| username: Jolyne | Original post link

Yes, the system killed your service.

| username: 朵拉大虾 | Original post link

So what should I do to prevent it from killing me?

| username: Jolyne | Original post link

You can check out this post: 专栏 - TiKV主要内存结构和OOM排查总结 | TiDB 社区

| username: 啦啦啦啦啦 | Original post link

How about trying to use Lightning to import data?