[TiFlash Source Code Analysis] The Most Comprehensive and Up-to-Date Collection of TiFlash Source Code Analysis Materials

Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.

Original topic: 【TiFlash 源码解读】最全最新的 TiFlash 源码解读资料大合集

| username: YY-ha

From April to August, in the four months following the official open-source announcement of TiFlash, the TiFlash R&D team has shared a lot of information online about the architecture and technical principles behind TiFlash. We also thank the source code fans for their continuous support. In the last chat session, we collected many expectations and questions from community members regarding future source code interpretations. We will continue to bring more online interpretations from frontline engineers, so please continue to support us.

Below is a collection of past TiFlash source code interpretation materials. Interested friends can download them.

First Session: Design Ideas of TiFlash Storage Engine

Author: Huang Junshen

Content Summary: This session introduces the overall form of TiDB HTAP and details the design ideas for optimizing the storage layer DeltaTree engine and its sub-modules.

Meeting Materials: TiFlash Storage Layer Overview.pdf (877.2 KB)

Video Replay: TiFlash 存储引擎的设计思路_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash 源码阅读(一) TiFlash 存储层概览 | TiDB 社区

Second Session: Overview of TiFlash Computing Layer

Author: Xu Fei

Content Summary: This session provides an overview of the design principles and code implementation of the TiFlash computing layer.

Meeting Materials: TiFlash Computing Layer Overview - Xu Fei.pdf (1.1 MB)

Video Replay: 源码解读 - TiFlash 计算层 Overview_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash 源码阅读(二)计算层概览 | TiDB 社区

Third Session: Analysis of TiFlash DeltaTree Engine Design and Implementation Part 1

Author: Shi Wenxuan

Content Summary: This session provides an in-depth understanding of the principles and workflows related to the write path of the TiFlash storage layer DeltaTree engine.

Meeting Materials: TiFlash DeltaTree Storage Engine (Part 1).pdf (2.2 MB)

Video Replay: TiFlash DeltaTree 引擎设计及实现解析_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash 源码阅读(三) DeltaTree 存储引擎设计及实现分析 - Part 1 | TiDB 社区

Fourth Session: Analysis of TiFlash DeltaTree Engine Design and Implementation Part 2

Author: Shi Wenxuan

Content Summary: This session provides an in-depth understanding of the read and write workflows and code implementation of the TiFlash storage layer DeltaTree engine.

Meeting Materials: TiFlash DeltaTree Storage Engine (Part 2).pdf (1.2 MB)

Video Replay: 源码解读 | TiFlash 存储层 DeltaTree 引擎(读路径)_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash 源码阅读(五) DeltaTree 存储引擎设计及实现分析 - Part 2 | TiDB 社区

Fifth Session: Analysis of TiFlash DDL Module Design and Implementation

Author: Hong Yunyan

Content Summary: This session provides an understanding of the design ideas and code implementation of the TiFlash DDL module.

Meeting Materials: TiFlash Source Code Interpretation - DDL Module(2).pdf (1.5 MB)

Video Replay: 源码解读 | TiFlash DDL 模块设计及实现解析_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash 源码解读(四) | TiFlash DDL 模块设计及实现分析 | TiDB 社区

Sixth Session: Design and Implementation of Common Operators in TiFlash

Author: Qi Zhi

Content Summary: This session provides an understanding of the various stages of TiFlash operators, the design logic of the operator code, and enables further independent code reading or simple issue handling.

Meeting Materials: Design and Implementation of Common Operators in TiFlash.pdf (2.9 MB)

Video Replay: 源码解读 | TiFlash 中常用算子的设计与实现_哔哩哔哩_bilibili

Seventh Session: Design and Implementation of TiFlash DeltaTree Index

Author: Li Dezhu

Content Summary: This session provides an understanding of the role and implementation principles of the core data structure DeltaTree Index in the TiFlash storage layer.

Meeting Materials: Design and Implementation Analysis of TiFlash DeltaTree Index.pdf (1.2 MB)

Video Replay: TiFlash DeltaTree Index_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash DeltaTree Index 的设计和实现分析 | TiDB 社区

Eighth Session: Introduction to TiFlash Proxy Module

Author: Luo Rongzhen

Content Summary: This session helps understand the principles of the TiFlash Proxy module, how it helps TiFlash obtain data, how it interacts with TiFlash, and the adjustments and optimizations made for TiFlash’s write mode compared to TiKV.

Meeting Materials: TiFlash Source Code Interpretation - Proxy Module.pdf (1.6 MB)

Video Replay: TiFlash Proxy 模块介绍_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash Proxy 模块介绍 | TiDB 社区

Ninth Session: Design and Implementation of TiFlash Expressions

Author: Huang Haisheng

Content Summary: This session provides an understanding of the design and source code implementation of TiFlash expressions, aiding in future contributions to TiFlash.

Meeting Materials: Design and Implementation of TiFlash Expressions.pdf (1.8 MB)

Video Replay: TiFlash 表达式的实现与设计_哔哩哔哩_bilibili

Full Review: 专栏 - TiFlash 表达式的实现与设计 | TiDB 社区

| username: ShawnYan | Original post link

Awesome~ YYDS~

| username: 半瓶醋仙 | Original post link

Got it.

| username: 程序员小王 | Original post link

Saved it.