提供了编程的基础技术教程

zl程序教程

您现在的位置是：首页 >  系统

当前栏目

Centos7 tiup搭建tiBD集群、扩容、缩容存储节点、修改监控节点

centos7监控节点存储集群 搭建 修改 扩容
2023-09-14 09:01:13 时间

一、TiDB介绍

　　1、TiDB介绍：

　　TiDB 是 PingCAP 公司受 Google Spanner / F1 论文启发而设计的开源分布式 HTAP (Hybrid Transactional and Analytical Processing) 数据库，结合了传统的 RDBMS 和 NoSQL 的最佳特性。TiDB 兼容 MySQL，支持无限的水平扩展，具备强一致性和高可用性。

　　2、逻辑图：

 

 

 二、 离线安装部署

　　1、外网下载离线安装包

curl --proto '=https' --tlsv1.2 -sSf https://tiup-mirrors.pingcap.com/install.sh | sh
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 4410k  100 4410k    0     0  2064k      0  0:00:02  0:00:02 --:--:-- 2063k

　　2、测试tiup工具

[root@localhost tidb-tiup]# source /root/.bash_profile
[root@localhost tidb-tiup]# which tiup
/root/.tiup/bin/tiup

　　3、查看可以下载的tidb版本

[root@deam tidb]# tiup list tidb
Available versions for tidb:
Version        Installed  Release                              Platforms
-------        ---------  -------                              ---------
nightly                   2020-07-08T06:39:00+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.0                      2020-04-16T16:58:06+08:00            darwin/amd64,linux/amd64
v3.0.0                    2020-04-16T14:03:31+08:00            darwin/amd64,linux/amd64
v3.0.1                    2020-04-27T19:38:36+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.0.2                    2020-04-16T23:55:11+08:00            darwin/amd64,linux/amd64
v3.0.3                    2020-04-17T00:16:31+08:00            darwin/amd64,linux/amd64
v3.0.4                    2020-04-17T00:22:46+08:00            darwin/amd64,linux/amd64
v3.0.5                    2020-04-17T00:29:45+08:00            darwin/amd64,linux/amd64
v3.0.6                    2020-04-17T00:39:33+08:00            darwin/amd64,linux/amd64
v3.0.7                    2020-04-17T00:46:32+08:00            darwin/amd64,linux/amd64
v3.0.8                    2020-04-17T00:54:19+08:00            darwin/amd64,linux/amd64
v3.0.9                    2020-04-17T01:00:58+08:00            darwin/amd64,linux/amd64
v3.0.10                   2020-03-13T14:11:53.774527401+08:00  darwin/amd64,linux/amd64
v3.0.11                   2020-04-17T01:09:20+08:00            darwin/amd64,linux/amd64
v3.0.12                   2020-04-17T01:16:04+08:00            darwin/amd64,linux/amd64
v3.0.13                   2020-04-26T17:25:01+08:00            darwin/amd64,linux/amd64
v3.0.14                   2020-05-09T21:11:49+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.0.15                   2020-06-05T16:50:59+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.0.16                   2020-07-03T20:05:15+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.1.0-beta               2020-05-22T14:35:59+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.1.0-beta.1             2020-05-22T15:22:30+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.1.0-beta.2             2020-05-22T15:28:20+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.1.0-rc                 2020-05-22T15:56:23+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.1.0                    2020-05-22T15:34:33+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.1.1                    2020-04-30T21:02:32+08:00            linux/arm64,darwin/amd64,linux/amd64
v3.1.2                    2020-06-04T17:53:39+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.0-beta               2020-05-26T11:18:05+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.0-beta.1             2020-05-26T11:42:48+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.0-beta.2             2020-05-26T11:56:51+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.0-rc                 2020-05-26T14:56:06+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.0-rc.1               2020-04-29T01:03:31+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.0-rc.2               2020-05-15T21:54:51+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.0                    2020-05-28T16:23:23+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.1                    2020-06-15T12:00:45+08:00            linux/arm64,darwin/amd64,linux/amd64
v4.0.2                    2020-07-01T19:57:14+08:00            linux/arm64,darwin/amd64,linux/amd64

　　4、生成需要的tidb离线版本（这儿生成的v4.0.2）

[root@localhost tidb-tiup]# tiup mirror clone tidb-community-server-v4.0.2-linux-amd64 v4.0.2 --os=linux --arch=amd64
Start to clone mirror, targetDir is tidb-community-server-v4.0.2-linux-amd64, selectedVersions are [v4.0.2]
If this does not meet expectations, please abort this process, read `tiup mirror clone --help` and run again
Arch [amd64]
OS [linux]
download https://tiup-mirrors.pingcap.com/alertmanager-v0.17.0-linux-amd64.tar.gz 22.54 MiB / 22.54 MiB 100.00% 2.03 MiB p/s                                    download 

https://tiup-mirrors.pingcap.com/bench-v1.0.7-linux-amd64.tar.gz 3.55 MiB / 3.55 MiB 100.00% ? p/s                                                     download https://tiup-

　　5、打包离线文件

tar czvf tidb-community-server-v4.0.2-linux-amd64.tar.gz tidb-community-server-v4.0.2-linux-amd64

　　6、内网tidb安装

　　将离线包发送到目标集群的中控机后，执行以下命令安装 TiUP 组件：

tar xzvf tidb-community-server-v4.0.2-linux-amd64.tar.gz && sh tidb-community-server-v4.0.2-linux-amd64/local_install.sh
source /home/tidb/.bash_profile

　　7、TiKV 数据盘挂载

磁盘大于1T方法
#fdisk -l
Disk /dev/vdb: 1000 GB
#parted -s -a optimal /dev/vdb mklabel gpt -- mkpart primary ext4 1 -1   #创建分区
#mkfs.ext4 /dev/vdb1                                                     #格式化磁盘
#echo "UUID=`lsblk -f|grep vdb1|awk '{print $3}'` /data1 ext4 defaults,nodelalloc,noatime 0 2" >> /etc/fstab  #配置开机自动挂载
#more /etc/fstab
#mkdir /data1  && mount -a  #挂载盘
----------------------------
磁盘小于1T方法
pvcreate /dev/vdb
vgcreate vg_data /dev/vdb
lvcreate -l 100%VG -n lv_tidb vg_data 
mkdir /data1
mkfs.ext4 /dev/mapper/vg_data-lv_tidb
echo "UUID=`lsblk -f|grep vg_data-lv_tidb|awk '{print $3}'` /data1 ext4 defaults,nodelalloc,noatime 0 2" >> /etc/fstab 
more /etc/fstab
mount -a

　　8、配置ssh免密登陆

ssh-keygen                           #一直回车
ssh-copy-id root@10.0.0.1   #输入密码配置免密登陆
ssh-copy-id root@10.0.0.2
ssh-copy-id root@10.0.0.3
ssh-copy-id root@10.0.0.4
ssh-copy-id root@10.0.0.5
ssh-copy-id root@10.0.0.6
ssh-copy-id root@10.0.0.7

　　9、集群初始化配置文件需要手动编写，需要在中控机上面创建 YAML 格式配置文件，例如 topology.yaml:

# # Global variables are applied to all deployments and used as the default value of
# # the deployments if a specific deployment value is missing.
global:
  user: "tidb"
  ssh_port: 22
  deploy_dir: "/tidb-deploy"
  data_dir: "/tidb-data"

server_configs:
  pd:
    replication.enable-placement-rules: true

pd_servers:
  - host: 10.0.1.4
  - host: 10.0.1.5
  - host: 10.0.1.6
tidb_servers:
  - host: 10.0.1.7
  - host: 10.0.1.8
  - host: 10.0.1.9
tikv_servers:
  - host: 10.0.1.1
  - host: 10.0.1.2
  - host: 10.0.1.3
tiflash_servers:
  - host: 10.0.1.10
    data_dir: /data1/tiflash/data,/data2/tiflash/data
cdc_servers:
  - host: 10.0.1.6
  - host: 10.0.1.7
  - host: 10.0.1.8
monitoring_servers:
  - host: 10.0.1.4
grafana_servers:
  - host: 10.0.1.4
alertmanager_servers:
  - host: 10.0.1.4
#以前版本没有缓存服务器的配置
pd_servers:
  - host: 172.16.5.134
    name: pd-134
  - host: 172.16.5.139
    name: pd-139
  - host: 172.16.5.140
    name: pd-140

tidb_servers:
  - host: 172.16.5.134
  - host: 172.16.5.139
  - host: 172.16.5.140

tikv_servers:
  - host: 172.16.5.134
  - host: 172.16.5.139
  - host: 172.16.5.140

grafana_servers:
  - host: 172.16.5.134

monitoring_servers:
  - host: 172.16.5.134

　　10、部署 TiDB 集群

useradd tidb      #每台服务器创建tidb用户
echo 'yourpasswd'|passwd --stdin tidb
export TIUP_MIRRORS=/path/to/mirror   #/path/to/mirror 是执行 local_install.sh 命令时输出的离线镜像包的位置
tiup cluster deploy tidb-cluster v4.0.2 topology.yaml --user tidb  
tiup cluster start tidb-cluster

　　11、tidb常用命令

[root@localhost tidb-tiup]# tiup cluster
The component `cluster` is not installed; downloading from repository.
download https://tiup-mirrors.pingcap.com/cluster-v1.0.7-linux-amd64.tar.gz 9.62 MiB / 9.62 MiB 100.00% 245.11 MiB p/s                                                          
Starting component `cluster`: /root/.tiup/components/cluster/v1.0.7/tiup-cluster
Deploy a TiDB cluster for production

Usage:
  tiup cluster cluster [flags]
  tiup cluster [command]

Available Commands:
  check       Perform preflight checks for the cluster.
  deploy      Deploy a cluster for production
  start       Start a TiDB cluster
  stop        Stop a TiDB cluster
  restart     Restart a TiDB cluster
  scale-in    Scale in a TiDB cluster
  scale-out   Scale out a TiDB cluster
  destroy     
  upgrade     Upgrade a specified TiDB cluster
  exec        Run shell command on host in the tidb cluster
  display     Display information of a TiDB cluster
  list        List all clusters
  audit       Show audit log of cluster operation
  import      Import an exist TiDB cluster from TiDB-Ansible
  edit-config Edit TiDB cluster config
  reload      Reload a TiDB cluster's config and restart if needed
  patch       Replace the remote package with a specified package and restart the service
  help        Help about any command

Flags:
  -h, --help               help for tiup
      --ssh-timeout int    Timeout in seconds to connect host via SSH, ignored for operations that don't need an SSH connection. (default 5)
  -v, --version            version for tiup
      --wait-timeout int   Timeout in seconds to wait for an operation to complete, ignored for operations that don't fit. (default 60)
  -y, --yes                Skip all confirmations and assumes 'yes'

Use "tiup cluster help [command]" for more information about a command.

三、在线部署安装

　　1、所有节点需配置ssh免密登录

ssh-keygen                           #一直回车
ssh-copy-id root@10.0.0.1   #输入密码配置免密登陆
ssh-copy-id root@10.0.0.2
ssh-copy-id root@10.0.0.3
ssh-copy-id root@10.0.0.4
ssh-copy-id root@10.0.0.5
ssh-copy-id root@10.0.0.6
ssh-copy-id root@10.0.0.7

　　2、关闭SElinux、关闭防火墙

# 关闭防火墙
systemctl stop firewalld
systemctl disable firewalld

# 关闭selinux
sed -i 's/enforcing/disabled/' /etc/selinux/config  # 永久
setenforce 0  # 临时

　　3、安装tiup工具

curl --proto '=https' --tlsv1.2 -sSf https://tiup-mirrors.pingcap.com/install.sh | sh

　　4、安装完成后重新声明环境变量

source .bash_profile

　　5、确认安装位置

which tiup

　　6、安装 TiUP cluster 组件

tiup cluster

　　7、创建 topology.yaml 文件

global:
  user: "bbders"
  ssh_port: 22
  deploy_dir: "/ssd/tidb-deploy"
  data_dir: "/ssd/tidb-data"

monitored:
  node_exporter_port: 9100
  blackbox_exporter_port: 9115
  deploy_dir: "/ssd/tidb-deploy/monitored-9100"
  data_dir: "/ssd/tidb-data/monitored-9100"
  log_dir: "/ssd/tidb-deploy/monitored-9100/log"

server_configs:
  pd:
    replication.enable-placement-rules: true

pd_servers:
  - host: 10.28.100.151
  - host: 10.28.100.160
  - host: 10.28.100.161

tidb_servers:
  - host: 10.28.100.151
  - host: 10.28.100.160
  - host: 10.28.100.161

tikv_servers:
  - host: 10.28.100.151
  - host: 10.28.100.160
  - host: 10.28.100.161

monitoring_servers:
  - host: 10.28.100.161

grafana_servers:
  - host: 10.28.100.161

alertmanager_servers:
  - host: 10.28.100.161

　　8、TiDB基本操作命令

查看已部署的集群
$ tiup cluster list
启动集群
$ tiup cluster start bbders-tidb
查看集群状态
$ tiup cluster display bbders-tidb

　　9、访问地址

dashboard访问地址：http://10.28.100.161:2379/dashboard
默认用户/密码：root/空

Grafana访问地址：http://10.28.100.161:3000/
默认用户/密码：admin/admin

四、扩容主机

　　1、查看当前配置

tiup cluster list                                     #查看当前的集群名称列表
tiup cluster edit-config <cluster-name>               #查看集群配置、拷贝对应的配置

　　2、编写扩容脚本，复制上一步看到得配置信息即可

vi scale-out.yaml
tikv_servers:
- host: 192.168.112.60
  ssh_port: 22
  port: 20160
  status_port: 20180
  deploy_dir: /ssd/tidb-deploy/tikv-20160
  data_dir: /ssd/tidb-data/tikv-20160
  arch: amd64
  os: linux
- host: 192.168.112.61
  ssh_port: 22
  port: 20160
  status_port: 20180
  deploy_dir: /ssd/tidb-deploy/tikv-20160
  data_dir: /ssd/tidb-data/tikv-20160
  arch: amd64
  os: linux
- host: 192.168.112.62
  ssh_port: 22
  port: 20160
  status_port: 20180
  deploy_dir: /ssd/tidb-deploy/tikv-20160
  data_dir: /ssd/tidb-data/tikv-20160
  arch: amd64
  os: linux

　　3、执行扩容脚本

tiup cluster scale-out <cluster-name> scale-out.yaml

　　4、检查集群状态

tiup cluster display <cluster-name>

　　5、重启grafana

 tiup cluster restart <cluster-name> -R grafana

五、缩容主机节点

　　1、 查看集群信息

tiup cluster display <cluster-name>       查看集群信息

　　2、执行缩容操作

tiup cluster scale-in <cluster-name> --node 10.0.1.5:20160

 六、修改监控节点

　　1、扩容一个监控节点

tiup cluster list #查看当前的集群名称列表
tiup cluster edit-config <cluster-name> #查看集群配置、拷贝对应的配置

　　2、编写扩容脚本

vi scale-out.yaml

grafana_servers:
- host: 192.168.6.123
ssh_port: 22
port: 3000
deploy_dir: /ssd/tidb-deploy/grafana-3000
arch: amd64
os: linux
username: admin
password: admin
alertmanager_servers:
- host: 192.168.6.123
ssh_port: 22
web_port: 9093
cluster_port: 9094
deploy_dir: /ssd/tidb-deploy/alertmanager-9093
data_dir: /ssd/tidb-data/alertmanager-9093
arch: amd64
os: linux

执行扩容脚本
tiup cluster scale-out <cluster-name> scale-out.yaml

　　3、修改监控节点

tiup cluster edit-config bbders-tidb

grafana_servers:
- host: 192.168.112.60 #换成你主节点的IP
ssh_port: 22
port: 3000
deploy_dir: /ssd/tidb-deploy/grafana-3000
arch: amd64
os: linux
username: admin
password: admin
anonymous_enable: false
root_url: ""
domain: ""
- host: 192.168.112.65 #换成你要下线的IP
ssh_port: 22
port: 3000
deploy_dir: /ssd/tidb-deploy/grafana-3000
arch: amd64
os: linux
username: admin
password: admin
anonymous_enable: false
root_url: ""
domain: ""

重新应用
tiup cluster reload s1-tidb

　　4、剔除监控节点

tiup cluster scale-in bbders-tidb --node 192.168.112.60:3000

　　5、以此操作勾选的其他服务

       

 

相关文章