k8s故障记录
k8s 记录 故障
2023-09-14 08:59:27 时间
一、etcd故障修改
1、利用已存活的etcd做个备份
ETCDCTL_API=3 /opt/etcd/bin/etcdctl --cacert=/opt/etcd/ssl/ca.pem --cert=/opt/etcd/ssl/server.pem --key=/opt/etcd/ssl/server-key.pem --endpoints="https://192.168.112.110:2379" snapshot save snapshot.db
2、从集群中剔除有问题的节点
ETCDCTL_API=3 /opt/etcd/bin/etcdctl --cacert=/opt/etcd/ssl/ca.pem --cert=/opt/etcd/ssl/server.pem --key=/opt/etcd/ssl/server-key.pem --endpoints="https://192.168.112.110:2379,https://192.168.112.111:2379,https://192.168.112.112:2379" member list
3、删除掉坏的节点
ETCDCTL_API=3 /opt/etcd/bin/etcdctl --cacert=/opt/etcd/ssl/ca.pem --cert=/opt/etcd/ssl/server.pem --key=/opt/etcd/ssl/server-key.pem --endpoints="https://192.168.112.110:2379,https://192.168.112.111:2379,https://192.168.112.112:2379" member remove 6627a32423113ab8
4、修改坏掉节点的配置文件
如果是旧机器,请先清除etcd的数据存储目录里面的文件。
-initial-cluster-state 由"new" 改成"existing"
5、在启动新节点之前,必须把新节点接入集群
ETCDCTL_API=3 /opt/etcd/bin/etcdctl --cacert=/opt/etcd/ssl/ca.pem --cert=/opt/etcd/ssl/server.pem --key=/opt/etcd/ssl/server-key.pem --endpoints="https://192.168.112.110:2379,https://192.168.112.111:2379,https://192.168.112.112:2379" member add etcd-3 --peer-urls=https://192.168.112.112:2380
6、启动节点
systemctl start etcd
7、再次检查集群状态
ETCDCTL_API=3 /opt/etcd/bin/etcdctl --cacert=/opt/etcd/ssl/ca.pem --cert=/opt/etcd/ssl/server.pem --key=/opt/etcd/ssl/server-key.pem --endpoints="https://192.168.112.110:2379,https://192.168.112.111:2379,https://192.168.112.112:2379" endpoint health https://192.168.112.111:2379 is healthy: successfully committed proposal: took = 17.633542ms https://192.168.112.112:2379 is healthy: successfully committed proposal: took = 18.544015ms https://192.168.112.110:2379 is healthy: successfully committed proposal: took = 19.061029ms
二、harbor私有仓库引起rancher集群报错
1、在master节点上起了一个harbor仓库,rancher访问不了
相关文章
- K8s 从懵圈到熟练-集群伸缩原理
- 一文读懂 K8s 持久化存储流程
- 8 分钟入门 K8s | 详解容器基本概念
- k8s故障记录
- k8s kustomize 简明教程:安装 kustomization.yml常用字段解读
- k8s 安装redis-operator并以operator方式部署redis-standalone redis-cluster集群完整操作记录
- k8s部署busybox:内置比较丰富的Linux命令,方便测试
- k8s部署nfs-client-provisioner完整实践版(亲测有效)
- 【k8s】kuboard获取token命令
- (提示)ubuntu16.04通过sealos安装k8s,需要重新部署apply一下calico组件
- 【K8s】第1篇 一篇文章带你部署安装k8s集群(linux-arm64)
- k8s极简史:K8s多集群技术发展的历史、现状与未来
- (2022版)一套教程搞定k8s安装到实战 | K8s集群安装(二进制)
- (2022版)一套教程搞定k8s安装到实战 | K8s集群安装(Kubeadm)
- 【云原生之kubernetes实战】在k8s环境下部署Wordpress应用服务
- 【云原生之kubernetes实战】使用Sealos部署k8s集群环境
- K8S定期清理或重启问题pod脚本 —— 筑梦之路
- 【K8S系列】深入解析 k8s:入门指南(二)