As the saying goes, "Often walking by the river, how can you not get your shoes wet?" As a DBA, share the disasters caused by your shaky hands

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 俗话说常在河边走,哪能不湿鞋。作为dba,来说说你手抖引发的血案

| username: 裤衩儿飞上天

At a client’s (dad’s) company, due to continuous overtime, I was in a daze. At noon, I was supposed to perform a backup and first checked the original backup. As a result, my hand slipped, and I deleted one of their backups. Fortunately, the impact was not significant, and I re-backed it up.

I was extremely anxious the entire afternoon and became even more dazed. That evening, I had to perform an operation to add a partition. I first checked the original partition, and somehow, I ended up dropping it…

And then there was nothing more :face_exhaling: :face_exhaling: :face_exhaling:

| username: Billmay表妹 | Original post link

Did it give you a cold sweat?

| username: 裤衩儿飞上天 | Original post link

I was completely dumbfounded at that moment…
Didn’t even have time to break into a cold sweat.

| username: tidb菜鸟一只 | Original post link

I once executed a shrink operation on an Oracle database, which triggered an Oracle bug and caused the database to be down for several hours.

| username: xingzhenxiang | Original post link

All highly risky operations are double-checked by two people, and no major issues have occurred so far.

| username: CuteRay | Original post link

It’s okay, but it’s about deleting the database and running away.

| username: TiDBer_jYQINSnf | Original post link

After rebuilding a specific TiKV pod, I intended to check the PVC status using ctl+r and planned to execute kubectl describe pvc xxx-pvc -n xxx. However, I mistakenly executed kubectl delete pvc xxx-pvc -n xxx, so I had to rebuild it again.

I wanted to delete a specific pod, tikv-1, to restart it. But when copying, I copied the wrong name and ended up with tidb-1, resulting in executing kubectl delete pod tidb-1 -n xxx. Originally, a TiKV restart would have been imperceptible to the business, but it ended up restarting a TiDB node, causing a temporary disconnection of business links. :man_shrugging:

| username: 孤君888 | Original post link

There was once an S-level production line failure when upgrading from MySQL 5.7 to MySQL 8 due to issues with character set collation. Everyone was stunned…

| username: waeng | Original post link

Executing commands on the production database as if it were a test database.

| username: 考试没答案 | Original post link

Entered the wrong cluster and deleted the wrong database.

| username: Running | Original post link

The WHERE condition did not match the appropriate data, resulting in a full table update.

| username: Raymond | Original post link

This shouldn’t be considered a slip of the hand; this kind of issue falls under unexpected failures.

| username: kkpeter | Original post link

This is what a professional DBA does.

| username: kkpeter | Original post link

This is due to inadequate testing and research.