Openshift4 中的 Image policies 與 Machineconfig

概述

在指定 pod 拉取外網(wǎng)鏡像重定向到內(nèi)網(wǎng)鏡像倉(cāng)庫(kù)經(jīng)常出現(xiàn)拉取外網(wǎng)鏡像失敗的問(wèn)題,這個(gè)問(wèn)題在離線安裝operatorhub尤其明顯,主要原因還是在于最終生效的 Machineconfig 配置以及 Image policies 策略。

介紹

離線安裝ocp4.3結(jié)束后

在離線安裝ocp4后會(huì)生成兩個(gè)imagecontentsourcepolicies.operator.openshift.io,

# oc get imagecontentsourcepolicies.operator.openshift.io
NAME             AGE
example          8d
image-policy-0   10d
image-policy-1   10d

查看image-policy-0和image-policy-1的內(nèi)容,可以看到兩個(gè)外網(wǎng)和內(nèi)網(wǎng)兩個(gè)鏡像倉(cāng)庫(kù)的映射關(guān)系:

[root@registry ~]# oc describe imagecontentsourcepolicies.operator.openshift.io image-policy-0
Name:         image-policy-0
Namespace:
Labels:       <none>
Annotations:  <none>
API Version:  operator.openshift.io/v1alpha1
Kind:         ImageContentSourcePolicy
Metadata:
  Creation Timestamp:  2020-04-22T08:35:06Z
  Generation:          1
  Resource Version:    554
  Self Link:           /apis/operator.openshift.io/v1alpha1/imagecontentsourcepolicies/image-policy-0
  UID:                 266570fb-f9ae-4e48-84fd-6fba137a642e
Spec:
  Repository Digest Mirrors:
    Mirrors:
      registry.ocp4.offline.zsp.com:5000/ocp4/openshift4
    Source:  quay.io/openshift-release-dev/ocp-release
Events:      <none>
[root@registry ~]# oc describe imagecontentsourcepolicies.operator.openshift.io image-policy-1
Name:         image-policy-1
Namespace:
Labels:       <none>
Annotations:  <none>
API Version:  operator.openshift.io/v1alpha1
Kind:         ImageContentSourcePolicy
Metadata:
  Creation Timestamp:  2020-04-22T08:35:06Z
  Generation:          1
  Resource Version:    559
  Self Link:           /apis/operator.openshift.io/v1alpha1/imagecontentsourcepolicies/image-policy-1
  UID:                 ac03f2de-4944-44da-9ced-1e7ceea34d91
Spec:
  Repository Digest Mirrors:
    Mirrors:
      registry.ocp4.offline.zsp.com:5000/ocp4/openshift4
    Source:  quay.io/openshift-release-dev/ocp-v4.0-art-dev
Events:      <none>

這兩個(gè)imagecontentsourcepolicies是由我們離線安裝時(shí)在install-config.yaml里面定義的以下字段生成:

imageContentSources:
- mirrors:
  - registry.ocp4.poc.com:5000/ocp4/openshift4
  source: quay.io/openshift-release-dev/ocp-release
- mirrors:
  - registry.ocp4.poc.com:5000/ocp4/openshift4
  source: quay.io/openshift-release-dev/ocp-v4.0-art-dev

因?yàn)檫@些參數(shù)最終是要給每個(gè)節(jié)點(diǎn)來(lái)使用的,作為配置存在節(jié)點(diǎn)上,ocp4節(jié)點(diǎn)的管理由machine operator,所以我們需要查看 machineconfig :

# oc get machineconfig
NAME                                                        GENERATEDBYCONTROLLER                      IGNITIONVERSION   AGE
00-master                                                   5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
00-master-test                                              5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             7d3h
00-worker                                                   5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
01-master-container-runtime                                 5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
01-master-kubelet                                           5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
01-worker-container-runtime                                 5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
01-worker-kubelet                                           5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
99-master-12cf926e-f293-45ce-9bb4-21aef7eec4cf-registries   5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
99-master-ssh                                                                                          2.2.0             10d
99-worker-73f736fe-bf60-4834-befe-b7b44a343572-registries   5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             10d
99-worker-ssh                                                                                          2.2.0             10d
rendered-master-30a5781e8ac597ecabb1205ad8d7d82c            5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             7d3h
rendered-master-51788310d621218c658311e34fd3aac5            5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             8d
rendered-master-88b3e65881e31a9a0915e6bf27dea73d            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             10d
rendered-master-9a83f11058611f346f2b5539a98d59c7            f6d1fe753cbcecb3aa1c2d3d3edd4a5d04ffca54   2.2.0             9d
rendered-master-cf4df21382f9c71e79aa98b7a3cf2f8f            f6d1fe753cbcecb3aa1c2d3d3edd4a5d04ffca54   2.2.0             8d
rendered-worker-a778c09867f0b7889b4a6f034e113216            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             10d
rendered-worker-ae3b3ff2d7103312b48841d9471539d2            f6d1fe753cbcecb3aa1c2d3d3edd4a5d04ffca54   2.2.0             9d
rendered-worker-cb525d7b2cf5fc2518d2656cc4a4359d            5803275f05729eef2a5affc1ad437235c6981f68   2.2.0             8d
rendered-worker-d0aec4b2f11f239256493436faa37927            f6d1fe753cbcecb3aa1c2d3d3edd4a5d04ffca54   2.2.0             8d

對(duì)應(yīng)兩個(gè)imagecontentsourcepolicies的是99-master-12cf926e-f293-45ce-9bb4-21aef7eec4cf-registries99-worker-73f736fe-bf60-4834-befe-b7b44a343572-registries,查看一下內(nèi)容:

# oc get machineconfig 99-master-12cf926e-f293-45ce-9bb4-21aef7eec4cf-registries -oyaml
apiVersion: machineconfiguration.openshift.io/v1
kind: MachineConfig
metadata:
  annotations:
    machineconfiguration.openshift.io/generated-by-controller-version: 5803275f05729eef2a5affc1ad437235c6981f68
  creationTimestamp: "2020-04-22T08:44:18Z"
  generation: 2
  labels:
    machineconfiguration.openshift.io/role: master
  name: 99-master-12cf926e-f293-45ce-9bb4-21aef7eec4cf-registries
  ownerReferences:
  - apiVersion: config.openshift.io/v1
    kind: Image
    name: cluster
    uid: ef354909-71a2-4dd6-8a88-97c167d52524
spec:
  config:
    ignition:
      config: {}
      security:
        tls: {}
      timeouts: {}
      version: 2.2.0
    networkd: {}
    passwd: {}
    storage:
      files:
      - contents:
          source: data:text/plain,unqualified-search-registries%20%3D%20%5B%22registry.access.redhat.com%22%2C%20%22docker.io%22%5D%0A%0A%5B%5Bregistry%5D%5D%0A%20%20prefix%20%3D%20%22%22%0A%20%20location%20%3D%20%22quay.io%2Fopenshift-release-dev%2Focp-release%22%0A%20%20mirror-by-digest-only%20%3D%20true%0A%0A%20%20%5B%5Bregistry.mirror%5D%5D%0A%20%20%20%20location%20%3D%20%22registry.ocp4.offline.zsp.com%3A5000%2Focp4%2Fopenshift4%22%0A%0A%5B%5Bregistry%5D%5D%0A%20%20prefix%20%3D%20%22%22%0A%20%20location%20%3D%20%22quay.io%2Fopenshift-release-dev%2Focp-v4.0-art-dev%22%0A%20%20mirror-by-digest-only%20%3D%20true%0A%0A%20%20%5B%5Bregistry.mirror%5D%5D%0A%20%20%20%20location%20%3D%20%22registry.ocp4.offline.zsp.com%3A5000%2Focp4%2Fopenshift4%22%0A
          verification: {}
        filesystem: root
        mode: 420
        path: /etc/containers/registries.conf
    systemd: {}
  fips: false
  kernelArguments: null
  kernelType: ""
  osImageURL: ""

將source字段的內(nèi)容進(jìn)行url解碼,可以看到以下內(nèi)容,這文件的在節(jié)點(diǎn)上的路徑為/etc/containers/registries.conf:

unqualified-search-registries = ["registry.access.redhat.com", "docker.io"]

[[registry]]
  prefix = ""
  location = "quay.io/openshift-release-dev/ocp-release"
  mirror-by-digest-only = true

  [[registry.mirror]]
    location = "registry.ocp4.offline.zsp.com:5000/ocp4/openshift4"

[[registry]]
  prefix = ""
  location = "quay.io/openshift-release-dev/ocp-v4.0-art-dev"
  mirror-by-digest-only = true

  [[registry.mirror]]
    location = "registry.ocp4.offline.zsp.com:5000/ocp4/openshift4"

在有多個(gè)MachineConfig中定義相同配置文件,則最后一個(gè)生效,如果要看最后綜合的MachineConfig,則需要看對(duì)應(yīng)的rendered*的MachineConfig,最終生效的MachineConfig時(shí)間距離最近,如果不確定可以把所有的rendered刪了,過(guò)一會(huì)兒會(huì)自動(dòng)生成,

手動(dòng)創(chuàng)建MachineConfig

以上演示的集群沒(méi)有多個(gè)相同/etc/containers/registries.conf的MachineConfig,所以我將切換一個(gè)集群,并且我會(huì)創(chuàng)建一個(gè)ImageContentSourcePolicy,因?yàn)槟J(rèn)的被我刪了,但是最終也是在99-XXXX-XXXX-registries里面配置。

apiVersion: operator.openshift.io/v1alpha1
kind: ImageContentSourcePolicy
metadata:
  name: example
spec:
  repositoryDigestMirrors:
  - mirrors:
    - registry.ocp4.poc.com:5000/ocp4/ose-elasticsearch-operator
    source: registry.redhat.io/openshift4/ose-elasticsearch-operator

創(chuàng)建

oc create -f imagecontentsourcepolicy
imagecontentsourcepolicy.operator.openshift.io/example created

查看創(chuàng)建的imagecontentsourcepolicy.內(nèi)容

oc get imagecontentsourcepolicy.operator.openshift.io/example -oyaml
apiVersion: operator.openshift.io/v1alpha1
kind: ImageContentSourcePolicy
metadata:
  creationTimestamp: "2020-05-02T13:53:12Z"
  generation: 1
  name: example
  resourceVersion: "2161933"
  selfLink: /apis/operator.openshift.io/v1alpha1/imagecontentsourcepolicies/example
  uid: 46876e0d-c892-4a75-a640-a6806072f985
spec:
  repositoryDigestMirrors:
  - mirrors:
    - registry.ocp4.poc.com:5000/ocp4/ose-elasticsearch-operator
    source: registry.redhat.io/openshift4/ose-elasticsearch-operator
  • 查看machineconfig
# oc get machineconfig
NAME                                                        GENERATEDBYCONTROLLER                      IGNITIONVERSION   CREATED
00-master                                                   ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             3d10h
00-worker                                                   ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             3d10h
01-master-container-runtime                                 ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             3d10h
01-master-kubelet                                           ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             3d10h
01-worker-container-runtime                                 ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             3d10h
01-worker-kubelet                                           ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             3d10h
99-master-5907d758-226d-4a6f-89da-20a1100f288c-registries   ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             148m
99-master-container-registry-conf                                                                      2.2.0             44h
99-master-ssh                                                                                          2.2.0             3d10h
99-worker-a59b993d-7ded-4e15-89c4-72a4980df15a-registries   ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             148m
99-worker-ssh                                                                                          2.2.0             3d10h
rendered-master-3bb8239d0ca28cfdc00382d5c5a0a79f            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             147m
rendered-master-7402c8f74c8a28c7f995c038d956aef1            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             149m
rendered-worker-1bf4fc757fba4f5450d39f5b4ae73a8b            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             147m
rendered-worker-cb7b84e687a34004966348a5c912f340            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             77m
rendered-worker-eec15a28849de7ad99ea8e3f95b3d9a4            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             149m
rendered-worker-f080151f04d85d01a3dc5a44ca75fe98            ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             128m

查看對(duì)應(yīng)的machineconfig內(nèi)容

# oc get machineconfig 99-worker-a59b993d-7ded-4e15-89c4-72a4980df15a-registries -oyaml
apiVersion: machineconfiguration.openshift.io/v1
kind: MachineConfig
metadata:
  annotations:
    machineconfiguration.openshift.io/generated-by-controller-version: ab4d62a3bf3774b77b6f9b04a2028faec1568aca
  creationTimestamp: "2020-05-02T11:26:02Z"
  generation: 3
  labels:
    machineconfiguration.openshift.io/role: worker
  name: 99-worker-a59b993d-7ded-4e15-89c4-72a4980df15a-registries
  ownerReferences:
  - apiVersion: config.openshift.io/v1
    kind: Image
    name: cluster
    uid: 799c6b45-5743-452a-99f8-c93db41fb959
  resourceVersion: "2161935"
  selfLink: /apis/machineconfiguration.openshift.io/v1/machineconfigs/99-worker-a59b993d-7ded-4e15-89c4-72a4980df15a-registries
  uid: 12f5b91a-84ec-4b24-8b06-7e77e741c8b7
spec:
  config:
    ignition:
      config: {}
      security:
        tls: {}
      timeouts: {}
      version: 2.2.0
    networkd: {}
    passwd: {}
    storage:
      files:
      - contents:
          source: data:text/plain,unqualified-search-registries%20%3D%20%5B%22registry.access.redhat.com%22%2C%20%22docker.io%22%5D%0A%0A%5B%5Bregistry%5D%5D%0A%20%20prefix%20%3D%20%22%22%0A%20%20location%20%3D%20%22registry.redhat.io%2Fopenshift4%2Fose-elasticsearch-operator%22%0A%20%20mirror-by-digest-only%20%3D%20true%0A%0A%20%20%5B%5Bregistry.mirror%5D%5D%0A%20%20%20%20location%20%3D%20%22registry.ocp4.poc.com%3A5000%2Focp4%2Fose-elasticsearch-operator%22%0A
          verification: {}
        filesystem: root
        mode: 420
        path: /etc/containers/registries.conf
    systemd: {}
  fips: false
  kernelArguments: null
  osImageURL: ""

解碼source的內(nèi)容:

unqualified-search-registries = ["registry.access.redhat.com", "docker.io"]

[[registry]]
  prefix = ""
  location = "registry.redhat.io/openshift4/ose-elasticsearch-operator"
  mirror-by-digest-only = true

  [[registry.mirror]]
    location = "registry.ocp4.poc.com:5000/ocp4/ose-elasticsearch-operator"
  • 我手動(dòng)創(chuàng)建了一個(gè)叫99-master-container-registry-conf的machineconfig,查看內(nèi)容:
# oc get machineconfig 99-master-container-registry-conf -oyaml
apiVersion: machineconfiguration.openshift.io/v1
kind: MachineConfig
metadata:
  generation: 2
  labels:
    machineconfiguration.openshift.io/role: master
  name: 99-master-container-registry-conf
spec:
  config:
    ignition:
      version: 2.2.0
    storage:
      files:
      - contents:
          source: data:text/plain;charset=utf-8;base64,W1tyZWdpc3RyeV1dCiAgbG9jYXRpb24gPSAicXVheS5pby9vcGVuc2hpZnQtcmVsZWFzZS1kZXYvb2NwLXJlbGVhc2UiCiAgaW5zZWN1cmUgPSBmYWxzZQogIGJsb2NrZWQgPSBmYWxzZQogIG1pcnJvci1ieS1kaWdlc3Qtb25seSA9IHRydWUKICBwcmVmaXggPSAiIgoKICBbW3JlZ2lzdHJ5Lm1pcnJvcl1dCiAgICBsb2NhdGlvbiA9ICJyZWdpc3RyeS5vY3A0LnBvYy5jb206NTAwMC9vY3A0L29wZW5zaGlmdDQiCiAgICBpbnNlY3VyZSA9IGZhbHNlCgpbW3JlZ2lzdHJ5XV0KICBsb2NhdGlvbiA9ICJxdWF5LmlvL29wZW5zaGlmdC1yZWxlYXNlLWRldi9vY3AtdjQuMC1hcnQtZGV2IgogIGluc2VjdXJlID0gZmFsc2UKICBibG9ja2VkID0gZmFsc2UKICBtaXJyb3ItYnktZGlnZXN0LW9ubHkgPSB0cnVlCiAgcHJlZml4ID0gIiIKCiAgW1tyZWdpc3RyeS5taXJyb3JdXQogICAgbG9jYXRpb24gPSAicmVnaXN0cnkub2NwNC5wb2MuY29tOjUwMDAvb2NwNC9vcGVuc2hpZnQ0IgogICAgaW5zZWN1cmUgPSBmYWxzZQ==
          verification: {}
        filesystem: root
        mode: 420
        path: /etc/containers/registries.conf

因?yàn)檫@個(gè)文件我是用base64加密的,所以要解碼source內(nèi)容:

[[registry]]
  location = "quay.io/openshift-release-dev/ocp-release"
  insecure = false
  blocked = false
  mirror-by-digest-only = true
  prefix = ""

  [[registry.mirror]]
    location = "registry.ocp4.poc.com:5000/ocp4/openshift4"
    insecure = false

[[registry]]
  location = "quay.io/openshift-release-dev/ocp-v4.0-art-dev"
  insecure = false
  blocked = false
  mirror-by-digest-only = true
  prefix = ""

  [[registry.mirror]]
    location = "registry.ocp4.poc.com:5000/ocp4/openshift4"
    insecure = false

其中這個(gè)時(shí)候有三個(gè)MachineConfig定義了/etc/containers/registries.conf文件內(nèi)容

01-master-container-runtime                                 ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             3d10h
99-master-5907d758-226d-4a6f-89da-20a1100f288c-registries   ab4d62a3bf3774b77b6f9b04a2028faec1568aca   2.2.0             148m
99-master-container-registry-conf                                                                      2.2.0             44h

01-master-container-runtime 內(nèi)容關(guān)于/etc/containers/registries.conf就是默認(rèn)的,很少

# oc get machineconfig 01-master-container-runtime -oyaml
apiVersion: machineconfiguration.openshift.io/v1
kind: MachineConfig
metadata:
  annotations:
  name: 01-master-container-runtime
spec:
  config:
    storage:
      files:
      - contents:
          source: data:,unqualified-search-registries%20%3D%20%5B'registry.access.redhat.com'%2C%20'docker.io'%5D%0A
          verification: {}
        filesystem: root
        mode: 420
        path: /etc/containers/registries.conf

查看

# oc get machineconfig  rendered-master-7402c8f74c8a28c7f995c038d956aef1 -oyaml
apiVersion: machineconfiguration.openshift.io/v1
kind: MachineConfig
metadata:
  annotations:
    machineconfiguration.openshift.io/generated-by-controller-version: ab4d62a3bf3774b77b6f9b04a2028faec1568aca
  creationTimestamp: "2020-05-02T11:24:07Z"
  generation: 1
  name: rendered-master-7402c8f74c8a28c7f995c038d956aef1
···············································································································
      - contents:
          source: data:,unqualified-search-registries%20%3D%20%5B'registry.access.redhat.com'%2C%20'docker.io'%5D%0A
          verification: {}
        filesystem: root
        mode: 420
        path: /etc/containers/registries.conf
···············································································································
      - contents:
          source: data:text/plain,unqualified-search-registries%20%3D%20%5B%22registry.access.redhat.com%22%2C%20%22docker.io%22%5D%0A%0A%5B%5Bregistry%5D%5D%0A%20%20prefix%20%3D%20%22%22%0A%20%20location%20%3D%20%22registry.redhat.io%2Fopenshift4%2Fose-elasticsearch-operator%22%0A%20%20mirror-by-digest-only%20%3D%20true%0A%0A%20%20%5B%5Bregistry.mirror%5D%5D%0A%20%20%20%20location%20%3D%20%22registry.ocp4.poc.com%3A5000%2Focp4%2Fose-elasticsearch-operator%22%0A
          verification: {}
        filesystem: root
        mode: 420
        path: /etc/containers/registries.conf
···············································································································
      - contents:
          source: data:text/plain;charset=utf-8;base64,W1tyZWdpc3RyeV1dCiAgbG9jYXRpb24gPSAicXVheS5pby9vcGVuc2hpZnQtcmVsZWFzZS1kZXYvb2NwLXJlbGVhc2UiCiAgaW5zZWN1cmUgPSBmYWxzZQogIGJsb2NrZWQgPSBmYWxzZQogIG1pcnJvci1ieS1kaWdlc3Qtb25seSA9IHRydWUKICBwcmVmaXggPSAiIgoKICBbW3JlZ2lzdHJ5Lm1pcnJvcl1dCiAgICBsb2NhdGlvbiA9ICJyZWdpc3RyeS5vY3A0LnBvYy5jb206NTAwMC9vY3A0L29wZW5zaGlmdDQiCiAgICBpbnNlY3VyZSA9IGZhbHNlCgpbW3JlZ2lzdHJ5XV0KICBsb2NhdGlvbiA9ICJxdWF5LmlvL29wZW5zaGlmdC1yZWxlYXNlLWRldi9vY3AtdjQuMC1hcnQtZGV2IgogIGluc2VjdXJlID0gZmFsc2UKICBibG9ja2VkID0gZmFsc2UKICBtaXJyb3ItYnktZGlnZXN0LW9ubHkgPSB0cnVlCiAgcHJlZml4ID0gIiIKCiAgW1tyZWdpc3RyeS5taXJyb3JdXQogICAgbG9jYXRpb24gPSAicmVnaXN0cnkub2NwNC5wb2MuY29tOjUwMDAvb2NwNC9vcGVuc2hpZnQ0IgogICAgaW5zZWN1cmUgPSBmYWxzZQ==
          verification: {}
        filesystem: root
        mode: 420
        path: /etc/containers/registries.conf
···············································································································

按照順序最后一個(gè)生效,進(jìn)入節(jié)點(diǎn)的/etc/containers/registries.conf就可以確認(rèn)了

[core@master00 ~]$ cat /etc/containers/registries.conf
[[registry]]
  location = "quay.io/openshift-release-dev/ocp-release"
  insecure = false
  blocked = false
  mirror-by-digest-only = true
  prefix = ""

  [[registry.mirror]]
    location = "registry.ocp4.poc.com:5000/ocp4/openshift4"
    insecure = false

[[registry]]
  location = "quay.io/openshift-release-dev/ocp-v4.0-art-dev"
  insecure = false
  blocked = false
  mirror-by-digest-only = true
  prefix = ""

  [[registry.mirror]]
    location = "registry.ocp4.poc.com:5000/ocp4/openshift4"
    insecure = false

手動(dòng)驗(yàn)證,進(jìn)入節(jié)點(diǎn),切換到root或者使用sudo執(zhí)行podman login登錄本地倉(cāng)庫(kù),然后拉取外網(wǎng)鏡像,就能拉取了,可以在podman后面加上--log-level debug查看過(guò)程,如果拉取失敗,則有以下幾種原因,
1、內(nèi)部鏡像倉(cāng)庫(kù)https證書(shū)錯(cuò)誤。
2、內(nèi)部鏡像倉(cāng)庫(kù)登錄失敗,密碼錯(cuò)誤等。
3、內(nèi)部鏡像倉(cāng)庫(kù)沒(méi)有對(duì)應(yīng)的鏡像。
以上三種情況發(fā)生時(shí)則會(huì)去外網(wǎng)拉取鏡像,不能聯(lián)網(wǎng)的話就會(huì)報(bào)錯(cuò)。

默認(rèn)節(jié)點(diǎn)的鏡像倉(cāng)庫(kù)https證書(shū)路徑:

/etc/pki/ca-trust/source/anchors/openshift-config-user-ca-bundle.crt

默認(rèn)節(jié)點(diǎn)的鏡像倉(cāng)庫(kù)登錄文件路徑:

cat /var/lib/kubelet/config.json
{"auths":{"registry.ocp4.poc.com:5000":{"auth":"YWRtaW46YWRtaW4=","email":"you@example.com"}}}

使用podman拉取鏡像帶上密碼文件:

sudo podman pull  --authfile /var/lib/kubelet/config.json quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6f2788587579df093bf990268390f7f469cce47e45a7f36b04b74aa00d1dd9e0

關(guān)于/etc/containers/registries.conf內(nèi)的配置

mirror-by-digest-only這個(gè)配置很重要,意思是說(shuō)如果這個(gè)值為true,那么你拉取鏡像的時(shí)候的時(shí)候必須要用sha256,如果用tag就去外網(wǎng)拉取鏡像了,如果用sha256就必須保證本地的鏡像倉(cāng)庫(kù)必須有對(duì)應(yīng)sha256的鏡像,如果你是用docker save或者podman save從其他機(jī)器拿來(lái)的,再push到本地鏡像倉(cāng)庫(kù),那么sha256基本就變了,所以這個(gè)要注意,尤其ocp4離線安裝的時(shí)候,都是用sha256來(lái)拉取鏡像。
mirror-by-digest-only這個(gè)值我查了openshift文檔沒(méi)法在ImageContentSourcePolicy里面定義,所以只能通過(guò)手動(dòng)創(chuàng)建MachineConfig導(dǎo)入了。

  • 官方解釋:
    mirror-by-digest-only : true or false. If true, mirrors will only be used during pulling if the image reference includes a digest. Referencing an image by digest ensures that the same is always used (whereas referencing an image by a tag may cause different registries to return different images if the tag mapping is out of sync).
    https://github.com/containers/image/blob/master/docs/containers-registries.conf.5.md

關(guān)于配置本地鏡像倉(cāng)庫(kù)證書(shū)和登錄的問(wèn)題參考以下鏈接

https://docs.openshift.com/container-platform/4.3/openshift_images/image-configuration.html
https://docs.openshift.com/container-platform/4.3/openshift_images/managing_images/using-image-pull-secrets.html

參考鏈接

https://docs.openshift.com/container-platform/4.3/openshift_images/image-configuration.html
https://access.redhat.com/solutions/4838051

最后編輯于
?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請(qǐng)聯(lián)系作者
【社區(qū)內(nèi)容提示】社區(qū)部分內(nèi)容疑似由AI輔助生成,瀏覽時(shí)請(qǐng)結(jié)合常識(shí)與多方信息審慎甄別。
平臺(tái)聲明:文章內(nèi)容(如有圖片或視頻亦包括在內(nèi))由作者上傳并發(fā)布,文章內(nèi)容僅代表作者本人觀點(diǎn),簡(jiǎn)書(shū)系信息發(fā)布平臺(tái),僅提供信息存儲(chǔ)服務(wù)。

友情鏈接更多精彩內(nèi)容