k8s上搭建elasticsearch集群

2020-10-13
在k8s中搭建es集群的思路如下圖：

k8s搭建es服務(wù)集群結(jié)構(gòu)示意圖

service1、service2、service3用于集群內(nèi)服務(wù)互通，service用于集群服務(wù)對(duì)外提供訪問。

方式一：使用自定義存儲(chǔ)卷

statefulset的部署文件 es-statefulset.yaml

apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es-sts-01
spec:
  selector:
    matchLabels:
      app: es  
      es-cluster: es01
  serviceName: "elasticsearch-svc"   
  replicas: 1 
  template:
    metadata:
      labels:
        app: es 
        es-cluster: es01
    spec:
      terminationGracePeriodSeconds: 10
      volumes:
       - name: data-storage
         persistentVolumeClaim:
           claimName: es-nfs-pvc-1 #使用第一塊存儲(chǔ)卷
      containers:
      - name: elasticsearch
        image: docker.elastic.co/elasticsearch/elasticsearch:7.9.2
        ports:
        - containerPort: 9200
          name: es-cli
        - containerPort: 9300
          name: es-inner
        env:
        - name: cluster.name
          value: es-luster
        - name: node.name
          value: es01 
        - name: cluster.initial_master_nodes #用于第一次啟動(dòng)時(shí)引導(dǎo)集群的創(chuàng)建，集群組建成功后就可以不需要了
          value: es01,es02,es03  #對(duì)應(yīng)各個(gè)es的node.name
        - name: discovery.seed_hosts
          value: es-svc-inner-02,es-svc-inner-02 
        - name: http.cors.enabled
          value: "true"
        - name: http.cors.allow-origin
          value: "*"
        volumeMounts:
         - mountPath: "/usr/share/elasticsearch/data"
           name: data-storage

---
kind: StatefulSet
metadata:
  name: es-sts-02
spec:
  selector:
    matchLabels:
      app: es  
      es-cluster: es02
  serviceName: "elasticsearch-svc"   
  replicas: 1  
  template:
    metadata:
      labels:
        app: es  
        es-cluster: es02
    spec:
      terminationGracePeriodSeconds: 10
      volumes:
       - name: data-storage
         persistentVolumeClaim:
           claimName: es-nfs-pvc-2 #使用第二塊存儲(chǔ)卷
      containers:
      - name: es-02
        image: docker.elastic.co/elasticsearch/elasticsearch:7.9.2
        ports:
        - containerPort: 9200
          name: es-cli
        - containerPort: 9300
          name: es-inner
        env:
        - name: cluster.name
          value: es-cluster
        - name: node.name
          value: es02
        - name: cluster.initial_master_nodes  # 最好每個(gè)都要配置這個(gè)列表，而且要與es01配置的一致
          value: es01,es02,es03 
        - name: discovery.seed_hosts
          value: es-svc-inner-01,es-svc-inner-03
        - name: http.cors.enabled
          value: "true"
        - name: http.cors.allow-origin
          value: "*"
        volumeMounts:
         - mountPath: "/usr/share/elasticsearch/data"
           name: data-storage
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es-sts-03
spec:
  selector:
    matchLabels:
      app: es 
      es-cluster: es03
  serviceName: "elasticsearch-svc"   
  replicas: 1 
  template:
    metadata:
      labels:
        app: es 
        es-cluster: es03
    spec:
      terminationGracePeriodSeconds: 10
      volumes:
       - name: data-storage
         persistentVolumeClaim:
           claimName: es-nfs-pvc-3  #使用第三塊存儲(chǔ)卷
      containers:
      - name: es-03
        image: docker.elastic.co/elasticsearch/elasticsearch:7.9.2
        ports:
        - containerPort: 9200
          name: es-cli
        - containerPort: 9300
          name: es-iner
        env:
        - name: cluster.name
          value: es-cluster
        - name: node.name
          value: es03
        - name: cluster.initial_master_nodes #    最好每個(gè)都要配置這個(gè)列表，而且要與es01配置的一致
        - name: discovery.seed_hosts
          value: es-svc-inner-01,es-svc-inner-02
        - name: http.cors.enabled
          value: "true"
        - name: http.cors.allow-origin
          value: "*"
        volumeMounts:
         - mountPath: "/usr/share/elasticsearch/data"
           name: data-storage

存儲(chǔ)卷的部署：persistant-voulmes.yaml

apiVersion: v1
kind: PersistentVolume
metadata:
  name: es-nfs-pv-1
  labels:
    pv: es-nfs-pv-1
spec:
  capacity:
    storage: 1Gi
  #volumeMode: Filesystem
  accessModes:
    - ReadWriteOnce
  persistentVolumeReclaimPolicy: Recycle
  storageClassName: nfs
  nfs:
    path: /data/nfs/es
    server: k8snode-01
---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: es-nfs-pv-2
  labels:
    pv: es-nfs-pv-2
spec:
  capacity:
    storage: 1Gi
  #volumeMode: Filesystem
  accessModes:
    - ReadWriteOnce
  persistentVolumeReclaimPolicy: Recycle
  storageClassName: nfs
  nfs:
    path: /data/nfs/es
    server: k8snode-02

---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: es-nfs-pv-3
  labels:
    pv: es-nfs-pv-3
spec:
  capacity:
    storage: 1Gi
  #volumeMode: Filesystem
  accessModes:
    - ReadWriteOnce
  persistentVolumeReclaimPolicy: Recycle
  storageClassName: nfs
  nfs:
    path: /data/nfs/es
    server:  k8snode-03

##claim部署
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: es-nfs-pvc-1
spec:
  accessModes:
    - ReadWriteOnce
  #volumeMode: Filesystem
  resources:
    requests:
      storage: 1Gi
  storageClassName: nfs
  selector:
    matchLabels:
      pv: "es-nfs-pv-1"

---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: es-nfs-pvc-2
spec:
  accessModes:
    - ReadWriteOnce
  #volumeMode: Filesystem
  resources:
    requests:
      storage: 1Gi
  storageClassName: nfs
  selector:
    matchLabels:
      pv: "es-nfs-pv-2"
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: es-nfs-pvc-3
spec:
  accessModes:
    - ReadWriteOnce
  #volumeMode: Filesystem
  resources:
    requests:
      storage: 1Gi
  storageClassName: nfs
  selector:
    matchLabels:
      pv: "es-nfs-pv-3"

注：存儲(chǔ)卷的部署不成功的問題，提供下思路：需要對(duì)應(yīng)的服務(wù)器上啟動(dòng)nfs服務(wù)和相關(guān)路徑的讀寫權(quán)限。

Service的部署：es-service.yaml

##用于對(duì)外提供服務(wù)的Service
apiVersion: v1
kind: Service
metadata:
  name: elasticsearch-svc
  labels:
    app: elasticsearch-svc
spec:
  type: NodePort
  ports:
  - port: 9200
    name: es-cli
    nodePort: 30001
  selector:
    app: es

---
##用于集群內(nèi)部服務(wù)間互通的Service
apiVersion: v1
kind: Service
metadata:
  name: es-svc-inner-01
  labels:
    app: es-svc-inner-01
spec:
  type: ClusterIP
  ports:
  - port: 9300
    name: es-port
  selector:
    es-cluster: es01

---
apiVersion: v1
kind: Service
metadata:
  name: es-svc-inner-02
  labels:
    app: es-svc-inner-02
spec:
  type: ClusterIP
  ports:
  - port: 9300
    name: es-port
  selector:
    es-cluster: es02

---
apiVersion: v1
kind: Service
metadata:
  name: es-svc-inner-03
  labels:
    app: es-svc-inner-03
spec:
  type: ClusterIP
  ports:
  - port: 9300
    name: es-port
  selector:
    es-cluster: es03

方式二：使用阿里云存儲(chǔ)

使用阿里云存儲(chǔ)就不需要上面方試一那樣麻創(chuàng)建PV和PVC了。

apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es-sts-01
  namespace: elasticsearch
spec:
  selector:
    matchLabels:
      app: es 
      es-cluster: es01
  serviceName: "elasticsearch-svc"   
  replicas: 1 # by default is 1
  template:
    metadata:
      labels:
        app: es  
        es-cluster: es01
    spec:
      securityContext:
        fsGroup: 1000  #使用這個(gè)獲得讀寫權(quán)限
      terminationGracePeriodSeconds: 10
      volumes:
       - name: aliyun-nas-01
         flexVolume:
           driver: "alicloud/nas"
           options:
             server: "xxxxxx.xxxxxx.nas.aliyuncs.com"
             path: "/elasticsearch/test/node01"
             vers: "3"
      containers:
      - name: elasticsearch
        image: docker.elastic.co/elasticsearch/elasticsearch:7.9.2
        ports:
        - containerPort: 9200
          name: es-cli
        - containerPort: 9300
          name: es-iner
        env:
        - name: cluster.name
          value: es-cluster
        - name: node.name
          value: es01
        - name: cluster.initial_master_nodes
          value: es01,es02,es03
        - name: discovery.seed_hosts
          value: es-svc-inner-02,es-svc-inner-02
        - name: http.cors.enabled
          value: "true"
        - name: http.cors.allow-origin
          value: "*"
        volumeMounts:
         - mountPath: "/usr/share/elasticsearch/data"
           name: aliyun-nas-01

---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es-sts-02
  namespace: elasticsearch
spec:
  selector:
    matchLabels:
      app: es  
      es-cluster: es02
  serviceName: "elasticsearch-svc"   
  replicas: 1  
  template:
    metadata:
      labels:
        app: es  
        es-cluster: es02
    spec:
      securityContext:
        fsGroup: 1000
      terminationGracePeriodSeconds: 10
      volumes:
       - name: aliyun-nas-02
         flexVolume:
           driver: "alicloud/nas"
           options:
             server: "xxxxxx.xxxxxx.nas.aliyuncs.com"
             path: "/elasticsearch/test/node02"
             vers: "3"
      containers:
      - name: es-02
        image: docker.elastic.co/elasticsearch/elasticsearch:7.9.2
        ports:
        - containerPort: 9200
          name: es-cli
        - containerPort: 9300
          name: es-iner
        env:
        - name: cluster.name
          value: es-cluster
        - name: node.name
          value: es02
        - name: cluster.initial_master_nodes
          value: es01,es02,es03 
        - name: discovery.seed_hosts
          value: es-svc-inner-01,es-svc-inner-03
        - name: http.cors.enabled
          value: "true"
        - name: http.cors.allow-origin
          value: "*"
        volumeMounts:
         - mountPath: "/usr/share/elasticsearch/data"
           name: aliyun-nas-02

---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es-sts-03
  namespace: elasticsearch
spec:
  selector:
    matchLabels:
      app: es  
      es-cluster: es03
  serviceName: "elasticsearch-svc"   
  replicas: 1  
  template:
    metadata:
      labels:
        app: es  
        es-cluster: es03
    spec:
      securityContext:
        fsGroup: 1000
      terminationGracePeriodSeconds: 10
      volumes:
       - name: aliyun-nas-03
         flexVolume:
           driver: "alicloud/nas"
           options:
             server: "xxxxxx.xxxxxx.nas.aliyuncs.com"
             path: "/elasticsearch/test/node03"
             vers: "3"
      containers:
      - name: es-03
        image: docker.elastic.co/elasticsearch/elasticsearch:7.9.2
        ports:
        - containerPort: 9200
          name: es-cli
        - containerPort: 9300
          name: es-iner
        env:
        - name: cluster.name
          value: es-cluster 
        - name: node.name
          value: es03
        - name: cluster.initial_master_nodes
          value: es01,es02,es03 
        - name: discovery.seed_hosts
          value: es-svc-inner-01,es-svc-inner-02
        - name: http.cors.enabled
          value: "true"
        - name: http.cors.allow-origin
          value: "*"
        volumeMounts:
         - mountPath: "/usr/share/elasticsearch/data"
           name: aliyun-nas-03

經(jīng)驗(yàn)證，需要搭建三個(gè)es實(shí)例才能保證其中一個(gè)掛了之后集群還能正常運(yùn)行，官方也推薦最好配置三個(gè)以上的mater node，以防數(shù)據(jù)的丟失。

ps: Elasticsearch默認(rèn)單機(jī)情況下會(huì)自動(dòng)引導(dǎo)組建集群，但是只要配置了
discovery.seed_providers
discovery.seed_hosts
cluster.initial_master_nodes
三個(gè)中的一個(gè)Elasticsearch就不會(huì)自動(dòng)引導(dǎo)集群了。

最后編輯于 ：
?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請(qǐng)聯(lián)系作者
【社區(qū)內(nèi)容提示】社區(qū)部分內(nèi)容疑似由AI輔助生成，瀏覽時(shí)請(qǐng)結(jié)合常識(shí)與多方信息審慎甄別。
平臺(tái)聲明：文章內(nèi)容（如有圖片或視頻亦包括在內(nèi)）由作者上傳并發(fā)布，文章內(nèi)容僅代表作者本人觀點(diǎn)，簡書系信息發(fā)布平臺(tái)，僅提供信息存儲(chǔ)服務(wù)。

友情鏈接更多精彩內(nèi)容