[Ended] TiDB Community Wisdom Collection, Now Open for Submissions, New Mechanical Keyboard Awaits You!

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 【已结束】 TiDB 社区智慧合集,火热征集中,新款机械键盘等你拿!

| username: Billmay表妹

The “collection articles” on TiDB-related technical issues can make it easier and more comprehensive for TiDB community members to understand and solve a certain type of problem. The 【TiDB Community Wisdom Collection】 has already compiled over 10 issues and received some positive feedback. We hope it will be helpful to all TiDBers!

We also hope to invite TiDBers to use their professional and industry perspectives to organize existing community materials and produce collection articles to help other community members better understand and use TiDB!

You can find suitable content in [AskTUG Technical Q&A], [Official Documentation], [Videos], [PPTs], [Column Articles], etc., to form a [TiDB Community Wisdom Collection] post. Requirement: More than 20 materials~

Topic References

TiDB Community Wisdom Collection

  • 【TiDB Community Wisdom Collection】Disaster Recovery Solutions
  • 【TiDB Community Wisdom Collection】TiKV/PD/TiFlash/TiDB Startup Failures
  • 【TiDB Community Wisdom Collection】Dashboard Knowledge Base
  • 【TiDB Community Wisdom Collection】TiDB Knowledge Base
  • 【TiDB Community Wisdom Collection】TiFlash Knowledge Base
  • 【TiDB Community Wisdom Collection】TiDB Operator Knowledge Base
  • 【TiDB Community Wisdom Collection】TiDB Data Migration Knowledge Base
  • 【TiDB Community Wisdom Collection】TiDB Lightning Knowledge Base
  • 【TiDB Community Wisdom Collection】Dumpling Knowledge Base
  • 【TiDB Community Wisdom Collection】TiCDC Knowledge Base
  • 【TiDB Community Wisdom Collection】TiSpark Knowledge Base
  • 【TiDB Community Wisdom Collection】TiDB Binlog Knowledge Base
  • 【TiDB Community Wisdom Collection】PingCAP Clinic Knowledge Base
  • 【TiDB Community Wisdom Collection】sync-diff-inspector Knowledge Base
  • Other Knowledge Bases

Fault Cases & Solutions

  • 【Fault Cases & Solutions】Incremental & Full Data Synchronization Practices
  • 【Source Code Interpretation】TiCDC/TiKV/TiFlash/PD/TiSpark/TiDB Source Code Interpretation, Step-by-Step Guide
  • 【Fault Cases & Solutions】Query/Execution Result Inconsistencies
  • 【Fault Cases & Solutions】TiKV Multiple Replica Loss Issues
  • Other Faults & Solutions

Collection Posts Reference:

Community Wisdom Collection Section: Community Wisdom Collection

【TiDB Community Wisdom Collection】TiDB Related SQL Scripts Collection

【TiDB Community Wisdom Collection】Optimization & Tuning Practical Cases

【TiDB Community Wisdom Collection】TiUP Knowledge Base

【TiDB Community Wisdom Collection】Common Errors & Solutions in TiDB Database

【TiDB Community Wisdom Collection】Decoding TiDB Performance Mysteries: Unleash the Full Power of Your Database!

【TiDB Community Wisdom Collection】【Best Practices】TiDB Synchronization & Migration Practices (From MySQL/Oracle/PostgreSQL/MongoDB to TiDB)

【TiDB Community Wisdom Collection】【Best Practices】Same City/Two Cities/Multiple Centers Practice Solutions

【TiDB Community Wisdom Collection】【Practical Cases】When TiDB Meets K8s (Kubernetes)

【TiDB Community Wisdom Collection】2022 Community User Upgrade Guide & Column Upgrade Articles Collection

【TiDB Community Wisdom Collection】Disaster Recovery & Resilience Operation Guide

【TiDB Community Wisdom Collection】【Best Practices】Flink+ TiDB/TiCDC, Experience the Beauty of Real-time Data Warehouse

How to Participate:

Comment and reply in this post to participate in the event!

Requirement: More than 20 materials
Materials can come from: Columns, Q&A, Blogs, Documentation, external content, etc.

【Community Wisdom Collection】Simple Production Guide (Only Three Steps):

Step 1: Determine the theme direction of your collection, such as disaster recovery, tuning, migration, resource management, etc., or you can also divide it by components;

Step 2: Use the search function to find relevant, high-quality official documents, column articles, quality Q&A, etc., related to the theme.

Step 3: Organize and simply format it.

Of course, this is just the most basic collection production guide. We look forward to TiDBers using their creativity and professional perspectives to create more valuable 【Community Wisdom Collections】 to help other community members better understand and use TiDB!

Event Rewards:

  1. Produce 1 【TiDB Community Wisdom Collection】: Reward 200 points, 200 experience points

  2. 【TiDB Community Wisdom Collection】First Prize: Reward a 2023 Ti Industrial Style Mechanical Keyboard~ (The selection will be voted on in the community on December 18, 2023, stay tuned!)

Event Time:

2023.11.27-2023.12.16

We look forward to your participation! Let more TiDBers see your collection articles when needed!

| username: dba远航 | Original post link

I’m still a newbie, I’m just here to observe. Go for it, experts!

| username: Billmay表妹 | Original post link

[Failure Cases & Solutions] High IO/Memory/CPU

High IO/Memory/CPU - Column Articles

Contributor: @chendapao

Hidden ESC Pit: jbd2 Process IO Occupancy Extremely High, System Long-term IO Occupancy 100%

Contributor: @Ann_ann

Guide to Avoid Pitfalls: Locating the Issue of TiKV’s IO-Util Approaching 100% in Production Environment

Contributor: @18515065291

TiDB Monitoring Prometheus Disk Memory Issues

Contributor: @luzizhou

Investigating High Memory Usage on TiKV Nodes in TiDB Cluster

Locating and Investigating Memory Leaks: Heap Profiling Principle Analysis

Contributor: @hey-hoho

Investigating High Memory Usage on TiKV Nodes in Mixed x86 and ARM Deployment Architecture

Contributor: @mydb

Case of High TiDB Server CPU Due to Large Number of SET autocommit

Contributor: @Suzhou Liu Sanqiang

High TiDB CPU Usage Part 1: Scheduler Worker CPU

Contributor: @TiDBer_guanguanglei

Several Cases of High Memory Usage in tidb-v5.2.3

Contributor: @navyaijm2017

Locating TiDB Hotspot Issues

High IO/Memory/CPU - Technical Q&A

High Memory Usage Issue with dm worker

High Memory Usage Leading to OOM in Tidb4.0.11 cdc

Investigating High CPU and IO on tikv Nodes Leading to OOM

Full Memory in tidb

High Memory Usage in 5.4.0 Queries

Periodic Disk IO and CPU Spikes on TiDB Server Leading to Overall Downtime

High CPU Usage on grafana TIDB Panel

High CPU Usage After Upgrading DM to v2.0.7

Continuous Memory Increase and Auto-Restart on TiDB Nodes

Memory Leak on TIDB Nodes

Memory Exceeding block-cache Setting on tikv

High Memory and Crash Due to Frequent DDL Rollback Checkpoint on DM

Sudden Increase in Available Memory from 6G to 200G on TiKV Server. Does TiKV Clean Memory Itself?

Consistently High Memory Usage on tikv Nodes

Can High Memory Usage on TIKV Be Controlled?

Memory Overflow OOM Due to Complex Queries

High Memory Usage on tidb

Memory Surge on tidb Node Due to admin check table

High CPU Usage on tiflash

Memory Exceeding Threshold for Single SQL Execution

High Memory Usage on tikv Nodes

High Memory Usage on tikv Service

High Load on tikv Nodes, Recovery After Restart, Cause Analysis

High CPU Usage on tidb-server

Memory Surge on tidb-server Service

99.9% Memory Usage on tidb_server and pd

High CPU on tikv After Version Upgrade Leading to Slow Read/Write

Memory and CPU Overload on Server During select count(*) on Large Table

High IO Usage on tikv Nodes

Sudden CPU and Memory Overload on tidb Nodes

| username: Kongdom | Original post link

[Failure Cases & Solutions] Installation and Deployment Practices and Issues Collection

Official Documentation

Common Issues in TiDB Installation and Deployment

Column Articles

Contributor: @buptzhoutian
Must-Read for SSH Errors During Deployment

Contributor: @OnTheRoad
TiDB v6.1.0 and TiUniManager Deployment Practices in openEuler 22.03

Contributor: @mao_siyu
TiKV Cluster Deployment Considerations

Contributor: @pepezzzz
TiDB Deployment and Common Issues in IPv6 K8S and Physical Machine Environments

Contributor: @DBA_尹裕皓
Experimental Process of Installing and Deploying TiDB Cluster Using TiUP

Contributor: @TiDBer_小阿飞
TiDB Practical Installation and Performance Testing (Part 1)
TiDB Practical Installation and Performance Testing (Part 2)

Contributor: @JiekeXu
Nanny-Level Installation Manual for Distributed Database TiDB 6.0 Cluster

Contributor: @随缘天空
A Complete Setup Process for TiDB v7.1 in Production Environment

Contributor: @啦啦啦啦啦
Practical Experience of Mixed Deployment of TiDB Cluster in Production Environment

Contributor: @TiDBer_CQ
Simulated Deployment of Production Environment TiDB Cluster on a Single Machine with Huawei Kylin V10 SP1 OS, HUAWEI Kunpeng 920 CPU (4 Cores)

Contributor: @caiyfc
Best Practices for Deploying TiDB v5.1.2 in Production Environment on Kylin v10

Community Q&A

TiDB Installation and Deployment

Installation Error: resource snapshot.json not found

How to Optimize Topology File During TiDB v7.1.0 Installation

Issue with Executing /tmp/tiup/bin/insight Script Over SSH During TiUP Installation

Dashboard Issues After TiDB v7.1.2 Installation: Failed to Send Requests to Prometheus

Does TiDB Support Deployment on openEuler 22.03?

Error During v7.2 Deployment, Unable to Install Successfully

Newbie Cluster Installation Error

Installing TiDB 6.1.3

Error Deploying TiDB Dashboard v6.5.0 on K8S

Newbie Installation Error: Failed to Parse Topology File ./topo.yaml (topology.parse_failed)

Installation Error: User Switch Error

NUMA Allocation During TiDB Deployment

How to Deploy Two Different Versions of TiDB Clusters (e.g., 6.4.0 and 7.1.0) in the Same Environment

Exception During Cluster Risk Check Using TIUP

Error During Simulated Production Environment Cluster Deployment on Single Machine: ssh_stderr: Failed to enable unit: Unit file pd-2379.service does not exist

Unable to Open Dashboard in TiDB Single Machine Cluster Deployment on Win11 WSL Environment

Failed to Install and Deploy TiDB on WSL2

Deploying TiDB on Linux Virtual Machine

Login Prompt for Password After First Installation of 7.4.0 Using MySQL Client

Single Machine Cluster Deployment Error: init Failed

Newbie Installation Error: open /root/.tiup/bin/root.json: no such file or directory

| username: Jellybean | Original post link

This post is great! Support support :clap: :+1:

| username: heiwandou | Original post link

This post is definitely going to be popular, marking my spot first.

| username: 小龙虾爱大龙虾 | Original post link

:+1::+1::+1:

| username: 像风一样的男子 | Original post link

Waiting for the experts to summarize and compile!

| username: Aionn | Original post link

Day 2: Learning from the experts~

| username: TiDBer_杨龟干外公 | Original post link

Learning from the experts.

| username: Fly-bird | Original post link

:100: :100: :100:

| username: Billmay表妹 | Original post link

Looks like I’m enjoying the keyboard all by myself!

| username: Billmay表妹 | Original post link

[Failure Cases & Solutions] Execution Plan Inaccuracy/Error/Cache/Index/Not Using TiFlash Issues

Execution Plan Inaccuracy/Error/Cache/Index/Not Using TiFlash Issues - Column Articles

Contributor: @h5n1

Using SPM to Fix Execution Plans

Contributor: @army

Failure Analysis: v5.1.1 - Adjusting the Variable tidb_isolation_read_engines Affects TiFlash SQL Execution Plan

Contributor: @Community Assistant Forwarding

TiDB Query Optimization and Tuning Series (Part 4): Adjusting and Optimizing Query Execution Plans

Contributor: @BraveChen

SQL Tuning Case Sharing Based on TiDB Execution Plans

Contributor: @HHHHHHULK

SQL Running Normally in MySQL Slows Down in TiDB

Contributor: @tracy0984

A Case of Handling TiDB Database Errors

Contributor: @18515065291

TiDB Optimization Worth Hundreds of Thousands

Contributor: @hey-hoho

TiDB SQL Tuning Case: Avoiding TiFlash Missteps

Contributor: @CuteRay

TiDB SQL Tuning Practice - Index Issues

Contributor: @ealam_小羽

A Slow Query Due to Multi-Table Join Order - TiDB Join Characteristics

Execution Plan Inaccuracy/Error/Cache/Index/Not Using TiFlash Issues - Technical Q&A

TiDB Execution Plan Inaccuracy Issue, Not Using TiFlash, Forcing TiFlash is Much Faster

Question About Order By Limit in TiDB Execution Plan

Large Execution Time Difference in Execution Plans

Specified INL_JOIN, But Execution Plan Does Not Follow

TiDB 5.4 Version Did Not Generate Correct Execution Plan, Leading to Long SQL Execution Time

Execution Plan Issue

Execution Plan Display is Incorrect

Execution Plan - Index Created But Not Used

TiDB-6.1.0 Execution Plan Not Using TiFlash

Why Does not(isnull( Appear in Execution Plan?

Different autocommit or Explicit Transactions Show Different Execution Plans

SQL Execution Plan Uses Wrong Index

TiDB Execution Plan Instability Issue

Same SQL, Different TiDB Instances, Different Results (Execution Plans Also Different)

Error Creating Binding Execution Plan: ERROR 1105 (HY000): runtime error: invalid memory address or nil pointer dereference

Execution Plan Cache Issue

Execution Plan Inaccuracy Phenomenon

select for update Did Not Hit Index, Even with FORCE INDEX

SQL Execution Plan Abnormality

Query Execution Directly Causes OOM

Error [9012] [HY000]: TiFlash Server Timeout

not in subquery Execution Plan is Unreasonable

Execution Plan Cache Not Effective During JDBC Batch Insert

Have You Encountered Different Execution Plans for the Same SQL in Different TiDB Servers in the Same Cluster?

Execution Plan Inaccuracy/Error/Cache/Index/Not Using TiFlash Issues - Official Documentation

Prepare Statement Execution Plan Cache

3.3 Execution Plan is Incorrect

Execution Plans for Other Types of Queries

TiDB Execution Plan Issues Leading to Increased Latency

Overview of TiDB Execution Plans

Slow Queries Due to Changes in Execution Plans

Controlling Execution Plans

Execution Plan Management (SPM)

Understanding TiDB Execution Plans

Using EXPLAIN to Understand Execution Plans

| username: TiDB社区小助手 | Original post link

[Community Wisdom Collection] Simple Production Guide :muscle: (Only Three Steps):

Step 1: Determine the theme direction of the collection you want to make, such as disaster recovery, optimization, migration, resource management, etc., or you can also categorize by components;

Step 2: Use the search function to find official documents, column articles, high-quality Q&A, etc., related to the theme that you think are good.

Step 3: Organize and simply format them.

Of course, this is just the most basic collection production guide. We look forward to seeing TiDBers unleash their creativity and use their professional and industry perspectives to create more valuable [Community Wisdom Collections], helping other community members better understand and use TiDB!

| username: Jellybean | Original post link

[Failure Cases & Solutions] Handling TiDB Read/Write Slowdown

Handling TiDB Read/Write Slowdown - Column Articles

SOP: Best Practices for Analyzing TiDB Business Read Slowdown
Contributor: @Jellybean

SOP: Best Practices for Analyzing TiDB Business Write Slowdown
Contributor: @Jellybean

Case: Autohome - A Business Optimization Case to Resolve Read/Write Conflicts, Improving Performance by 5 Times
Contributor: @mydb

An Unusual Case of Slow Write Issue in TiDB Cluster
Contributor: @mydb

A Case of Slow Write Issue in TiDB Cluster Due to SSD Disk Life Depletion
Contributor: @mydb

SQL Executing Normally in MySQL Becomes Slow in TiDB
Contributor: @HHHHHHULK

A Slow Query Case Due to Multi-Table Join Order - TiDB Join Features
Contributor: @ealam_小羽

TiDB SQL Tuning Case to Avoid TiFlash Causing Trouble
Contributor: @hey-hoho

Handling TiDB Read/Write Slowdown - Technical Q&A

Cluster Overall Response Slowdown

Abnormal tikv Duration

MVCC and Read/Write Conflicts

TIDB6.5 Takes 50ms to Write a Single Data in Single Thread, but 400ms per Data in Multi-Thread

Why Does Insert Slow Down as the Data Volume of a Table Increases?
TiDB Data Generation Speed Slows Down

Update Slowdown with Where Condition as Primary Key + Others

Slowdown After Upgrading from 6.2 to 6.5

Query Slowdown After Upgrading to Version 7.1.0, copr_cache_hit_ratio Decreased by Two Orders of Magnitude

Does Too Many Visible Versions Cause Query Slowdown?

Handling TiDB Read/Write Slowdown - Official Documentation

Handling SQL Slowdown Due to TiDB Lock Conflicts

Impact of DDL Operations on Read/Write Performance

Increased Cluster Read/Write Latency

Dashboard Cluster Slow Query Analysis

Analysis of Long-Running SQL in Cluster

| username: 春风十里 | Original post link

New to TiDB, start by learning.

| username: Mickyun | Original post link

I want a keyboard, I’m trying hard.

| username: 清风明月 | Original post link

Studying hard