TiDB Binlog Deployment Topology

This document describes the deployment topology ofTiDB Binlogbased on the minimal TiDB topology.

TiDB Binlog is the widely used component for replicating incremental data. It provides near real-time backup and replication.

Topology information

Instance	数	Physical machine configuration	IP	配置
TiDB	3	16 VCore 32 GB	10.0.1.1 10.0.1.2 10.0.1.3	Default port configuration; Enableenable_binlog; Enableignore-error
PD	3	4 VCore 8 GB	10.0.1.4 10.0.1.5 10.0.1.6	Default port configuration
TiKV	3	16 VCore 32 GB	10.0.1.7 10.0.1.8 10.0.1.9	Default port configuration
Pump	3	8 VCore 16GB	10.0.1.1 10.0.1.7 10.0.1.8	Default port configuration; Set GC time to 7 days
Drainer	1	8 VCore 16GB	10.0.1.12	Default port configuration; 设置默认initialization commitTS -1 as the latest timestamp; Configure the downstream target TiDB as10.0.1.12:4000

Topology templates

• The simple template for the TiDB Binlog topology (withmysqlas the downstream type)
• The simple template for the TiDB Binlog topology (withfileas the downstream type)
• The complex template for the TiDB Binlog topology

For detailed descriptions of the configuration items in the above TiDB cluster topology file, seeTopology Configuration File for Deploying TiDB Using TiUP.

Key parameters

The key parameters in the topology configuration templates are as follows:

• server_configs.tidb.binlog.enable: true

  • Enables the binlog service.
  • Default value:false.

• server_configs.tidb.binlog.ignore-error: true

  • It is recommended to enable this configuration in high availability scenarios.
  • If set totrue, when an error occurs, TiDB stops writing data into binlog, and adds1to the value of thetidb_server_critical_error_totalmonitoring metric.
  • If set tofalse, when TiDB fails to write data into binlog, the whole TiDB service is stopped.

• drainer_servers.config.syncer.db-type

  The downstream type of TiDB Binlog. Currently,mysql,tidb,kafka, andfileare supported.

• drainer_servers.config.syncer.to

  The downstream configuration of TiDB Binlog. Depending on differentdb-types, you can use this configuration item to configure the connection parameters of the downstream database, the connection parameters of Kafka, and the file save path. For details, refer toTiDB Binlog Configuration File.