MySQL高可用集群

https://dev.mysql.com/doc/mysql-shell/8.4/en/mysql-innodb-cluster.html

1 什么是MySQL高可用集群

• MySQL高可用集群：MySQL InnoDB Cluster
• InnoDB Cluster是MySQL官方实现高可用+读写分离的架构方案，包含以下组件
  • MySQL Group Replication：简称MGR，是MySQL的主从同步高可用方案，包括数据同步和角色选举
  • MySQL Shell是InnoDB Cluster的管理工具，用来创建和管理集群
  • MySQL Router是业务流量入口，支持对MGR的主从角色判断，可以配置不同的端口分别对外提供读写服务，实现读写分离
• MySQL InnoDB Cluster架构图

• InnoDB Cluster将三个MySQL数据库实例构成一个高可用集群
• 其中一个实例是具有读写能力的主成员
• 其他两个实例是具有只读能力的次成员
• 组复制将数据从主成员复制到次成员
• MySQL Router将连接读写端口的客户端请求转发到主成员，将连接到只读端口的客户端请求转发到次成员

2 搭建高可用集群示例

2.1 准备三个MySQL实例

2.2.1 准备MySQL实例20000

• 创建目录

mkdir -p /opt/mysql/20000/{data,log,tmp}

• 准备配置文件

vi /opt/mysql/20000/my.cnf[mysql]
#设置mysql客户端默认编码
default-character-set=utf8
[mysqld]
port=20000
pid-file= /opt/mysql/20000/mysqld.pid
socket= /opt/mysql/20000/mysqld.sock
datadir= /opt/mysql/20000/data
log-error=/opt/mysql/20000/log/mysqld.log
tmpdir=/opt/mysql/20000/tmp
mysqlx-port=20010
mysqlx-socket=/opt/mysql/20000/mysqldx.sock
secure-file-priv= NULL
# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
#服务器唯一ID，默认是1
server-id=20000
#启用二进制日志
log-bin=mysql-bin
#最大连接数
max_connections=1000
#设置默认时区
default-time_zone='+8:00'
# 0:区分大小写
# 1:不区分大小写
lower_case_table_names=1
user = mysql
#启用全局事务标识符（GTID）模式
gtid_mode=on
#强制GTID的一致性。这意味着在执行事务时，MySQL将确保所有涉及的服务器都使用相同的GTID集。
enforce_gtid_consistency=on
#启用并行复制
binlog_transaction_dependency_tracking=WRITESET
replica_preserve_commit_order=ON
replica_parallel_type=LOGICAL_CLOCK
transaction_write_set_extraction=XXHASH64

• 初始化库

chown -R mysql:mysql /opt/mysql/20000
mysqld --defaults-file=/opt/mysql/20000/my.cnf --initialize

• 启库

mysqld --defaults-file=/opt/mysql/20000/my.cnf &

• 初始化密码

#查看临时密码
cat /opt/mysql/20000/log/mysqld.log|grep "A temporary password"
#登录
mysql -uroot -p'ji2m:aJ9K26y' --socket=/opt/mysql/20000/mysqld.sock
>ALTER USER 'root'@'localhost' identified by '123456';
  CREATE USER 'root'@'%' IDENTIFIED  BY '123456';
  GRANT ALL PRIVILEGES ON *.* TO 'root'@'%';
  flush privileges;

• 给root账号赋InnoDB Cluster 相关权限

mysql -uroot -p'123456' --socket=/opt/mysql/20000/mysqld.sock
>GRANT CLONE_ADMIN, CONNECTION_ADMIN, CREATE USER, EXECUTE, FILE, GROUP_REPLICATION_ADMIN, PERSIST_RO_VARIABLES_ADMIN, PROCESS, RELOAD, REPLICATION CLIENT, REPLICATION SLAVE, REPLICATION_APPLIER, REPLICATION_SLAVE_ADMIN, ROLE_ADMIN, SELECT, SHUTDOWN, SYSTEM_VARIABLES_ADMIN ON *.* TO 'root'@'%' WITH GRANT OPTION;GRANT DELETE, INSERT, UPDATE ON mysql.* TO 'root'@'%' WITH GRANT OPTION;GRANT ALTER, ALTER ROUTINE, CREATE, CREATE ROUTINE, CREATE TEMPORARY TABLES, CREATE VIEW, DELETE, DROP, EVENT, EXECUTE, INDEX, INSERT, LOCK TABLES, REFERENCES, SHOW VIEW, TRIGGER, UPDATE ON mysql_innodb_cluster_metadata.* TO 'root'@'%' WITH GRANT OPTION;GRANT ALTER, ALTER ROUTINE, CREATE, CREATE ROUTINE, CREATE TEMPORARY TABLES, CREATE VIEW, DELETE, DROP, EVENT, EXECUTE, INDEX, INSERT, LOCK TABLES, REFERENCES, SHOW VIEW, TRIGGER, UPDATE ON mysql_innodb_cluster_metadata_bkp.* TO 'root'@'%' WITH GRANT OPTION;GRANT ALTER, ALTER ROUTINE, CREATE, CREATE ROUTINE, CREATE TEMPORARY TABLES, CREATE VIEW, DELETE, DROP, EVENT, EXECUTE, INDEX, INSERT, LOCK TABLES, REFERENCES, SHOW VIEW, TRIGGER, UPDATE ON mysql_innodb_cluster_metadata_previous.* TO 'root'@'%' WITH GRANT OPTION;

2.2.2 复制实例20001

cp -rf /opt/mysql/20000 /opt/mysql/20001
sed -i "s#20000#20001#g" /opt/mysql/20001/my.cnf
sed -i "s#20010#20011#g" /opt/mysql/20001/my.cnf
rm -f /opt/mysql/20001/data/auto.cnf
chown -R mysql:mysql /opt/mysql/20001
mysqld --defaults-file=/opt/mysql/20001/my.cnf &

2.2.3 复制实例20002

cp -rf /opt/mysql/20000 /opt/mysql/20002
sed -i "s#20000#20002#g" /opt/mysql/20002/my.cnf
sed -i "s#20010#20012#g" /opt/mysql/20001/my.cnf
rm -f /opt/mysql/20002/data/auto.cnf
chown -R mysql:mysql /opt/mysql/20002
mysqld --defaults-file=/opt/mysql/20002/my.cnf &

2.2 MySQL Shell部署集群

2.2.1 安装MySQL Shell

MySQL :: Download MySQL Shell

2.2.2 MySQL Shell 集群相关常用命令

mysqlsh root@192.168.221.100:20000 --js
> dba.help(); --查看帮助文档? dba.deploySandboxInstance --查看具体操作的帮助文档

2.2.3 检测实例是否满足要求

mysqlsh root@192.168.221.100:20000 --js
> dba.checkInstanceConfiguration('root@192.168.221.100:20000');dba.checkInstanceConfiguration('root@192.168.221.100:20001');dba.checkInstanceConfiguration('root@192.168.221.100:20002');

返回ok表示验证通过

2.2.4 初始化InnoDB Cluster配置

mysqlsh root@192.168.221.100:20000 --js
> dba.configureInstance('root@192.168.221.100:20000');dba.configureInstance('root@192.168.221.100:20001');dba.configureInstance('root@192.168.221.100:20002');

2.2.5 使用主实例创建集群

• 创建集群

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.createCluster('myCluster');

• 创建集群后默认会将当前节点添加进集群，并作为主节点
• 默认创建单主模式集群

• 查看集群状态

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.status();

2.2.6 添加副本实例

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.addInstance('root@192.168.221.100:20001');cluster.addInstance('root@192.168.221.100:20002');cluster.status();

新添加进来的实例默认作为副本节点

2.3 InnoDB Cluster数据同步测试

• 主库20000添加数据

mysql -uroot -p'123456' --socket=/opt/mysql/20000/mysqld.sock
> create database test;use test;create table test (id int,name varchar(10));ALTER TABLE test ADD PRIMARY KEY id(id);insert into test values(1,'a'),(2,'b'),(3,'c');

• 从库20001查询数据

mysql -uroot -p'123456' --socket=/opt/mysql/20001/mysqld.sock
>  use test;select * from test;

• 从库20002查询数据

mysql -uroot -p'123456' --socket=/opt/mysql/20002/mysqld.sock
>  use test;select * from test;

2.4 InnoDB Cluster主从切换测试

• kill主库实例20000
• 查看组成员

mysql -uroot -p'123456' --socket=/opt/mysql/20001/mysqld.sock
>  SELECT CHANNEL_NAME,MEMBER_ID,MEMBER_HOST,MEMBER_PORT, MEMBER_ROLE FROM performance_schema.replication_group_members;

• 查看集群状态

mysqlsh root@192.168.221.100:20001 --js
> var cluster = dba.getCluster('myCluster');cluster.status();

2.5 MySQL Shell集群常见操作

2.5.1 参数配置

• 使用cluster.options()查看当前集群的配置属性
• 集群参数配置分为两种方式
  • cluster.setOption()设置集群属性，所有节点的
  • cluster.setInstanceOption()设置指定节点属性

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.setOption("memberWeight",50);#重新加入集群重试次数改为5次cluster.setOption("autoRejoinTries",5);#将其中一个节点的权重改为75
  cluster.setInstanceOption("192.168.221.100:20001","memberWeight",75)；#重新加入集群重试次数改为10次
  cluster.setInstanceOption("192.168.221.100:20001","autoRejoinTries",10)

2.5.2 配置节点权重

• memberWeight选项的值域为0~100之间的整数，缺省值为50;
• 该值是故障转移时自动选举主节点的百分比权重
• 具有较高memberWeight值的实例更有可能在单主集群被选为主节点

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');#查看集群的参数配置cluster.options();#创建集群配置dba.createCluster('myCluster', {memberWeight:75});#添加实例时配置var cluster = dba.getCluster();cluster.addInstance('root@192.168.221.100:20001',{memberWeight:50});#集群创建完后修改配置
  cluster.setInstanceOption('192.168.221.100:20000','memberWeight',100)

2.5.3 将节点重新加入集群

• 状态为missing的节点是组复制关闭或者中断
• 可使用cluster.rejionInstance()重新加入集群
• 会重新对该节点设置MGR相关参数

2.5.4 集群多数节点异常恢复

• 当集群多个节点异常，则失去了仲裁机制，无法选举出主节点
• 使用cluster.forceQuorumUsingPartitionOf将集群剥离为单节点运行

2.5.5 集群节点角色切换

• 单主模式指定主节点切换

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.setPrimaryInstance('192.168.221.100:20001');

• 单主模式切换为多主模式

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.switchToMultiPrimaryMode();

• 多主模式切换为单主模式

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');
   cluster.switchToSinglePrimaryMode("192.168.221.100:20000")

2.5.6 销毁集群

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.dissolve();

2.5.7 创建集群管理用户

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.setupAdminAccount('test');

• 该操作会创建MySQL系统账号
• mysqlsh连接集群时也可使用该账号登录

2.6 MySQL Router连接集群

2.6.1 安装MySQL Router

MySQL :: Download MySQL Router

2.6.2 配置路由

mysqlrouter --bootstrap root@192.168.221.100:20000 --force --user=root

2.6.3 查看集群路由信息

mysqlsh root@192.168.221.100:20000 --js
> var cluster = dba.getCluster('myCluster');cluster.listRouters();

2.6.4 启动路由

mysqlrouter &

2.6.5 通过路由连接MySQL

• mysql client连接路由

mysql -uroot -p123456 -P6446  -h192.168.221.100

• mysqlsh连接路由

mysqlsh root@192.168.221.100:6446  --sql

2.7 MySQL Router连接测试

• R/W端口测试读写
• R/O端口测试读写
• R/W Split端口测试读写