Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.Original topic: 同步数据

How can I use CDC to synchronize data from other types of databases into TiDB in real-time?
Note:
This topic has been translated from a Chinese forum by GPT and might contain errors.Original topic: 同步数据
How can I use CDC to synchronize data from other types of databases into TiDB in real-time?
Simply put, just search on Baidu for something like: “hive data migration to MySQL.” Methods that work for MySQL are generally suitable for TiDB.
The production business uses PostgreSQL data, and some functions may not be supported. How should this be handled?
Convert the PG xx function to MySQL syntax.
Or use AI, any AI tool will do, the accuracy of SQL rewriting is very high.
Custom configurations would be troublesome; TiDB does not support them.
There are many things that are not supported. Just the fact that foreign keys are not supported makes it difficult.
TiDB supports defining foreign keys, but they do not work. This needs to be controlled in the business code.
Some are just syntax support without actual functionality. It depends on your expected modifications.
You can take a look at this tool, TurboDX for MySQL
, but I’m not quite sure about the custom function part, it still needs to be modified.
There are many methods to migrate PostgreSQL data to TiDB: datax, navicat, TurboDX for MySQL, TiDB-for-PostgreSQL (GitHub - DigitalChinaOpenSource/TiDB-for-PostgreSQL: PgSQL compatible on distributed database TiDB), etc. Currently, I haven’t seen any methods to achieve real-time synchronization.
Similar to incremental migration tools. Not many, domestically there are DSG, Yingfang, etc.; internationally there is OGG. It seems they are all paid.
If it’s a public network, you can try Alibaba Cloud’s DTS, or use ETL tools for real-time synchronization.
What solution did you end up using? We are migrating from SQL Server to TiDB and also have concerns about migrating functions.
Otherwise, it depends on the upstream. If it’s Oracle, use TMS. If it’s MySQL, use DM. If neither works, OGG is suitable for everything.
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.