containerd配置私有仓库registry

机器	ip	端口
regtisry	192.168.0.72	5000
k8s-*	-------	k8s集群

1、镜像上传

root@admin:~# docker push 192.168.0.72:5000/nginx:1.26.1-alpine
The push refers to repository [192.168.0.72:5000/nginx]
6961f0b8531c: Pushed
3112cd521249: Pushed
d3f50ce9b5b5: Pushed
9efaf2eb479a: Pushed
bef35f150926: Pushed
7b87df18a0ed: Pushed
4160c36f5f9d: Pushed
d4fc045c9e3a: Pushed
1.26.1-alpine: digest: sha256:2565e998caf6d270af6ded12206135ffd3247aeb362f5dc5ad2c7449f3712df0 size: 1989

2、重要报错

[root@k8s-master3 ~]# journalctl -u containerd -f -- Logs begin at Fri 2024-10-25 15:25:01 CST. -- Nov 06 14:08:14 k8s-master3 containerd[19662]: time="2024-11-06T14:08:14.052429673+08:00" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured" Nov 06 14:08:14 k8s-master3 containerd[19662]: time="2024-11-06T14:08:14.154156087+08:00" level=warning msg="failed to load plugin io.containerd.grpc.v1.cri" error="invalid plugin config: mirrors cannot be set when config_path is provided" Nov 06 14:08:14 k8s-master3 systemd[1]: Started containerd container runtime. Nov 06 14:22:06 k8s-master3 systemd[1]: Stopping containerd container runtime... Nov 06 14:22:06 k8s-master3 systemd[1]: Stopped containerd container runtime. Nov 06 14:22:06 k8s-master3 systemd[1]: Starting containerd container runtime... Nov 06 14:22:06 k8s-master3 containerd[28450]: time="2024-11-06T14:22:06.359645523+08:00" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured" Nov 06 14:22:06 k8s-master3 containerd[28450]: time="2024-11-06T14:22:06.360210472+08:00" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured" Nov 06 14:22:06 k8s-master3 containerd[28450]: time="2024-11-06T14:22:06.475504596+08:00" level=warning msg="failed to load plugin io.containerd.grpc.v1.cri" error="invalid plugin config: mirrors cannot be set when config_path is provided" Nov 06 14:22:06 k8s-master3 systemd[1]: Started containerd container runtime. [root@k8s-master3 ~]# ctr plugins ls | grep cri io.containerd.grpc.v1 cri linux/amd64 error

从日志来看，出现了以下错误：

invalid plugin config: mirrors cannot be set when config_path is provided

这表明在 /etc/containerd/config.toml 中，mirrors 和 config_path 配置项冲突。根据 containerd 配置规则，当使用 config_path 指定了证书和私有仓库配置文件目录时，不允许再使用 mirrors 配置。

解决方案

要解决此问题，可以选择以下两种方式之一：

方案 1：删除 mirrors 配置

如果你更愿意通过 config_path 指定私有仓库配置文件，则删除 mirrors 配置部分，保留 config_path 配置。例如，更新后的 config.toml 文件为：

version = 2 root = "/var/lib/containerd" state = "/run/containerd" oom_score = 0 [grpc] address = "/run/containerd/containerd.sock" [plugins."io.containerd.grpc.v1.cri"] sandbox_image = "registry.aliyuncs.com/google_containers/pause:3.7" [plugins."io.containerd.grpc.v1.cri".containerd] snapshotter = "overlayfs" default_runtime_name = "runc" [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc] runtime_type = "io.containerd.runc.v2" [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options] SystemdCgroup = true [plugins."io.containerd.grpc.v1.cri".registry] config_path = "/etc/containerd/certs.d" [plugins."io.containerd.grpc.v1.cri".registry.configs."192.168.0.72:5000".tls] insecure_skip_verify = true [plugins."io.containerd.grpc.v1.cri".registry.configs."192.168.0.72:5000".auth] username = "admin" password = "admin"

#本人使用的方案二解决

方案 2：移除 config_path 并仅使用 mirrors

如果你更偏向在 config.toml 中直接配置镜像仓库的地址，则可以删除 config_path 行，仅使用 mirrors 配置。例如：

[plugins."io.containerd.grpc.v1.cri".registry] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."192.168.0.72:5000"] endpoint = ["http://192.168.0.72:5000"] [plugins."io.containerd.grpc.v1.cri".registry.configs."192.168.0.72:5000".tls] insecure_skip_verify = true [plugins."io.containerd.grpc.v1.cri".registry.configs."192.168.0.72:5000".auth] username = "admin" password = "admin"

重启 Containerd 并验证

更新配置后，重新启动 containerd 服务：

sudo systemctl restart containerd

#成功验证，既能通过crictl拉取，还能写入到yaml文件中拉取，而不用为集群中每一台机器上传镜像

at
[root@k8s-master1 containerd]# crictl pull ​​192.168.0.72:5000/nginx:1.26.1-alpine
Image is up to date for sha256:98abffe47b9c4812f59d521554e7b2245196e882bca57ece5b23d38ede0cc137
[root@k8s-master1 containerd]# crictl images
IMAGE                                     TAG                 IMAGE ID            SIZE

192.168.0.72:5000/nginx                   1.26.1-alpine       98abffe47b9c4       20.5MB