bclinux aarch64 ceph 14.2.10 文件存储 Ceph File System, 需要部署mds： ceph-deploy mds
创建池
[root@ceph-0 ~]# ceph osd pool create cephfs_data 64
pool 'cephfs_data' created
[root@ceph-0 ~]# ceph osd pool create cephfs_metadata 32
pool 'cephfs_metadata' created
cephfs_metadata 64 报错
官方说明：
元数据池通常最多可容纳几 GB 的数据。为 因此，通常建议使用较小的PG计数。通常为 64 或 128 在实践中用于大型集群。
pool列表
[root@ceph-0 ~]# ceph osd pool ls
vdbench
cephfs_data
cephfs_metadata
创建文件系统
[root@ceph-0 ~]# ceph fs new cephfs cephfs_metadata cephfs_data
new fs with metadata pool 4 and data pool 3
[root@ceph-0 ~]# ceph fs ls
name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ]
文件系统状态
[root@ceph-0 ~]# ceph fs status cephfs
cephfs - 0 clients
======
+------+-------+-----+----------+-----+------+
| Rank | State | MDS | Activity | dns | inos |
+------+-------+-----+----------+-----+------+
+------+-------+-----+----------+-----+------+
+-----------------+----------+-------+-------+
| Pool | type | used | avail |
+-----------------+----------+-------+-------+
| cephfs_metadata | metadata | 0 | 103G |
| cephfs_data | data | 0 | 103G |
+-----------------+----------+-------+-------+
+-------------+
| Standby MDS |
+-------------+
+-------------+
+---------+---------+
| version | daemons |
+---------+---------+
+---------+---------+
集群状态
[root@ceph-0 ~]# ceph -s
cluster:
id: ff72b496-d036-4f1b-b2ad-55358f3c16cb
health: HEALTH_ERR
1 filesystem is offline
1 filesystem is online with fewer MDS than max_mds
mon ceph-0 is low on available space
services:
mon: 4 daemons, quorum ceph-3,ceph-1,ceph-0,ceph-2 (age 4h)
mgr: ceph-0(active, since 45h), standbys: ceph-1, ceph-3, ceph-2
mds: cephfs:0
osd: 4 osds: 3 up (since 45h), 3 in (since 44h)
data:
pools: 3 pools, 224 pgs
objects: 4.30k objects, 17 GiB
usage: 53 GiB used, 247 GiB / 300 GiB avail
pgs: 224 active+clean
查看mds状态（x）
[root@ceph-0 ~]# ceph mds stat
cephfs:0
mds没有就绪节点
这个服务没有基于ceph-deploy部署
ceph-deploy 部署 mds
ceph-deploy mds create ceph-0 ceph-1 ceph-2 ceph-3部署成功日志
[root@ceph-0 ~]# cd /etc/ceph/
[root@ceph-0 ceph]# ceph-deploy mds create ceph-0 ceph-1 ceph-2 ceph-3
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO ] Invoked (2.0.1): /usr/bin/ceph-deploy mds create ceph-0 ceph-1 ceph-2 ceph-3
[ceph_deploy.cli][INFO ] ceph-deploy options:
[ceph_deploy.cli][INFO ] username : None
[ceph_deploy.cli][INFO ] verbose : False
[ceph_deploy.cli][INFO ] overwrite_conf : False
[ceph_deploy.cli][INFO ] subcommand : create
[ceph_deploy.cli][INFO ] quiet : False
[ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0xffff976c7640>
[ceph_deploy.cli][INFO ] cluster : ceph
[ceph_deploy.cli][INFO ] func : <function mds at 0xffff977620d0>
[ceph_deploy.cli][INFO ] ceph_conf : None
[ceph_deploy.cli][INFO ] mds : [('ceph-0', 'ceph-0'), ('ceph-1', 'ceph-1'), ('ceph-2', 'ceph-2'), ('ceph-3', 'ceph-3')]
[ceph_deploy.cli][INFO ] default_release : False
[ceph_deploy.mds][DEBUG ] Deploying mds, cluster ceph hosts ceph-0:ceph-0 ceph-1:ceph-1 ceph-2:ceph-2 ceph-3:ceph-3
[ceph-0][DEBUG ] connected to host: ceph-0
[ceph-0][DEBUG ] detect platform information from remote host
21.10U3 LTS
bclinux
[ceph-0][DEBUG ] detect machine type
[ceph_deploy.mds][INFO ] Distro info: bclinux 21.10U3 21.10U3 LTS
[ceph_deploy.mds][DEBUG ] remote host will use systemd
[ceph_deploy.mds][DEBUG ] deploying mds bootstrap to ceph-0
[ceph-0][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-0][WARNIN] mds keyring does not exist yet, creating one
[ceph-0][DEBUG ] create a keyring file
[ceph-0][DEBUG ] create path if it doesn't exist
[ceph-0][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mds --keyring /var/lib/ceph/bootstrap-mds/ceph.keyring auth get-or-create mds.ceph-0 osd allow rwx mds allow mon allow profile mds -o /var/lib/ceph/mds/ceph-ceph-0/keyring
[ceph-0][INFO ] Running command: systemctl enable ceph-mds@ceph-0
[ceph-0][WARNIN] Created symlink /etc/systemd/system/ceph-mds.target.wants/ceph-mds@ceph-0.service → /usr/lib/systemd/system/ceph-mds@.service.
[ceph-0][INFO ] Running command: systemctl start ceph-mds@ceph-0
[ceph-0][INFO ] Running command: systemctl enable ceph.target
dhclient(1787) is already running - exiting. This version of ISC DHCP is based on the release available
on ftp.isc.org. Features have been added and other changes
have been made to the base software release in order to make
it work better with this distribution.Please report issues with this software via:
https://gitee.com/src-openeuler/dhcp/issuesexiting.
dhclient(1787) is already running - exiting. This version of ISC DHCP is based on the release available
on ftp.isc.org. Features have been added and other changes
have been made to the base software release in order to make
it work better with this distribution.Please report issues with this software via:
https://gitee.com/src-openeuler/dhcp/issuesexiting.
[ceph-1][DEBUG ] connected to host: ceph-1
[ceph-1][DEBUG ] detect platform information from remote host
21.10U3 LTS
bclinux
[ceph-1][DEBUG ] detect machine type
[ceph_deploy.mds][INFO ] Distro info: bclinux 21.10U3 21.10U3 LTS
[ceph_deploy.mds][DEBUG ] remote host will use systemd
[ceph_deploy.mds][DEBUG ] deploying mds bootstrap to ceph-1
[ceph-1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-1][WARNIN] mds keyring does not exist yet, creating one
[ceph-1][DEBUG ] create a keyring file
[ceph-1][DEBUG ] create path if it doesn't exist
[ceph-1][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mds --keyring /var/lib/ceph/bootstrap-mds/ceph.keyring auth get-or-create mds.ceph-1 osd allow rwx mds allow mon allow profile mds -o /var/lib/ceph/mds/ceph-ceph-1/keyring
[ceph-1][INFO ] Running command: systemctl enable ceph-mds@ceph-1
[ceph-1][WARNIN] Created symlink /etc/systemd/system/ceph-mds.target.wants/ceph-mds@ceph-1.service → /usr/lib/systemd/system/ceph-mds@.service.
[ceph-1][INFO ] Running command: systemctl start ceph-mds@ceph-1
[ceph-1][INFO ] Running command: systemctl enable ceph.target
dhclient(1742) is already running - exiting. This version of ISC DHCP is based on the release available
on ftp.isc.org. Features have been added and other changes
have been made to the base software release in order to make
it work better with this distribution.Please report issues with this software via:
https://gitee.com/src-openeuler/dhcp/issuesexiting.
dhclient(1742) is already running - exiting. This version of ISC DHCP is based on the release available
on ftp.isc.org. Features have been added and other changes
have been made to the base software release in order to make
it work better with this distribution.Please report issues with this software via:
https://gitee.com/src-openeuler/dhcp/issuesexiting.
[ceph-2][DEBUG ] connected to host: ceph-2
[ceph-2][DEBUG ] detect platform information from remote host
21.10U3 LTS
bclinux
[ceph-2][DEBUG ] detect machine type
[ceph_deploy.mds][INFO ] Distro info: bclinux 21.10U3 21.10U3 LTS
[ceph_deploy.mds][DEBUG ] remote host will use systemd
[ceph_deploy.mds][DEBUG ] deploying mds bootstrap to ceph-2
[ceph-2][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-2][WARNIN] mds keyring does not exist yet, creating one
[ceph-2][DEBUG ] create a keyring file
[ceph-2][DEBUG ] create path if it doesn't exist
[ceph-2][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mds --keyring /var/lib/ceph/bootstrap-mds/ceph.keyring auth get-or-create mds.ceph-2 osd allow rwx mds allow mon allow profile mds -o /var/lib/ceph/mds/ceph-ceph-2/keyring
[ceph-2][INFO ] Running command: systemctl enable ceph-mds@ceph-2
[ceph-2][WARNIN] Created symlink /etc/systemd/system/ceph-mds.target.wants/ceph-mds@ceph-2.service → /usr/lib/systemd/system/ceph-mds@.service.
[ceph-2][INFO ] Running command: systemctl start ceph-mds@ceph-2
[ceph-2][INFO ] Running command: systemctl enable ceph.target
dhclient(1722) is already running - exiting. This version of ISC DHCP is based on the release available
on ftp.isc.org. Features have been added and other changes
have been made to the base software release in order to make
it work better with this distribution.Please report issues with this software via:
https://gitee.com/src-openeuler/dhcp/issuesexiting.
dhclient(1722) is already running - exiting. This version of ISC DHCP is based on the release available
on ftp.isc.org. Features have been added and other changes
have been made to the base software release in order to make
it work better with this distribution.Please report issues with this software via:
https://gitee.com/src-openeuler/dhcp/issuesexiting.
[ceph-3][DEBUG ] connected to host: ceph-3
[ceph-3][DEBUG ] detect platform information from remote host
21.10U3 LTS
bclinux
[ceph-3][DEBUG ] detect machine type
[ceph_deploy.mds][INFO ] Distro info: bclinux 21.10U3 21.10U3 LTS
[ceph_deploy.mds][DEBUG ] remote host will use systemd
[ceph_deploy.mds][DEBUG ] deploying mds bootstrap to ceph-3
[ceph-3][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-3][WARNIN] mds keyring does not exist yet, creating one
[ceph-3][DEBUG ] create a keyring file
[ceph-3][DEBUG ] create path if it doesn't exist
[ceph-3][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mds --keyring /var/lib/ceph/bootstrap-mds/ceph.keyring auth get-or-create mds.ceph-3 osd allow rwx mds allow mon allow profile mds -o /var/lib/ceph/mds/ceph-ceph-3/keyring
[ceph-3][INFO ] Running command: systemctl enable ceph-mds@ceph-3
[ceph-3][WARNIN] Created symlink /etc/systemd/system/ceph-mds.target.wants/ceph-mds@ceph-3.service → /usr/lib/systemd/system/ceph-mds@.service.
[ceph-3][INFO ] Running command: systemctl start ceph-mds@ceph-3
[ceph-3][INFO ] Running command: systemctl enable ceph.target
[root@ceph-0 ceph]#
mds状态正常
准备一台客户端虚拟机
[root@ceph-0 ~]# rsync -avr ceph-14.2.10-rpms root@172.17.158.161:~/
只安装ceph客户端
安装liboath
需要配置外部源，安装成功日志
[root@ceph-client aarch64]# yum install -y ceph-common-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librados2-14.2.10-0.oe1.bclinux.aarch64.rpm \
> libcephfs2-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librbd1-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-cephfs-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-rados-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-rbd-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librgw2-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-rgw-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python-rgw-14.2.10-0.oe1.bclinux.aarch64.rpm
Unable to connect to Registration Management Service
Last metadata expiration check: 0:08:18 ago on Mon 13 Nov 2023 03:08:56 PM CST.
Dependencies resolved.
===========================================================================================================================================================================================================================================================================
Package Architecture Version Repository Size
===========================================================================================================================================================================================================================================================================
Installing:
ceph-common aarch64 14.2.10-0.oe1.bclinux @commandline 17 M
libcephfs2 aarch64 14.2.10-0.oe1.bclinux @commandline 436 k
librgw2 aarch64 14.2.10-0.oe1.bclinux @commandline 4.5 M
python-ceph-argparse aarch64 14.2.10-0.oe1.bclinux @commandline 39 k
python-rgw aarch64 14.2.10-0.oe1.bclinux @commandline 99 k
python3-ceph-argparse aarch64 14.2.10-0.oe1.bclinux @commandline 39 k
python3-cephfs aarch64 14.2.10-0.oe1.bclinux @commandline 113 k
python3-rados aarch64 14.2.10-0.oe1.bclinux @commandline 197 k
python3-rbd aarch64 14.2.10-0.oe1.bclinux @commandline 181 k
python3-rgw aarch64 14.2.10-0.oe1.bclinux @commandline 81 k
Installing dependencies:
jemalloc aarch64 5.1.0-4.oe1 everything 169 k
jemalloc-help aarch64 5.1.0-4.oe1 everything 54 k
leveldb aarch64 1.20-4.oe1 everything 150 k
Downgrading:
librados2 aarch64 14.2.10-0.oe1.bclinux @commandline 3.0 M
librbd1 aarch64 14.2.10-0.oe1.bclinux @commandline 1.4 M
Transaction Summary
===========================================================================================================================================================================================================================================================================
Install 13 Packages
Downgrade 2 Packages
Total size: 28 M
Total download size: 373 k
Downloading Packages:
(1/3): jemalloc-help-5.1.0-4.oe1.aarch64.rpm 3.5 MB/s | 54 kB 00:00
(2/3): leveldb-1.20-4.oe1.aarch64.rpm 4.1 MB/s | 150 kB 00:00
(3/3): jemalloc-5.1.0-4.oe1.aarch64.rpm 3.5 MB/s | 169 kB 00:00
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 7.3 MB/s | 373 kB 00:00
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Downgrading : librados2-14.2.10-0.oe1.bclinux.aarch64 1/17
Running scriptlet: librados2-14.2.10-0.oe1.bclinux.aarch64 1/17
Installing : python3-rados-14.2.10-0.oe1.bclinux.aarch64 2/17
Downgrading : librbd1-14.2.10-0.oe1.bclinux.aarch64 3/17
Running scriptlet: librbd1-14.2.10-0.oe1.bclinux.aarch64 3/17
Installing : libcephfs2-14.2.10-0.oe1.bclinux.aarch64 4/17
Running scriptlet: libcephfs2-14.2.10-0.oe1.bclinux.aarch64 4/17
Installing : librgw2-14.2.10-0.oe1.bclinux.aarch64 5/17
Running scriptlet: librgw2-14.2.10-0.oe1.bclinux.aarch64 5/17
Installing : python3-rgw-14.2.10-0.oe1.bclinux.aarch64 6/17
Installing : python3-rbd-14.2.10-0.oe1.bclinux.aarch64 7/17
Installing : python3-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64 8/17
Installing : python3-cephfs-14.2.10-0.oe1.bclinux.aarch64 9/17
Installing : python-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64 10/17
Installing : leveldb-1.20-4.oe1.aarch64 11/17
Running scriptlet: leveldb-1.20-4.oe1.aarch64 11/17
Installing : jemalloc-help-5.1.0-4.oe1.aarch64 12/17
Installing : jemalloc-5.1.0-4.oe1.aarch64 13/17
Running scriptlet: jemalloc-5.1.0-4.oe1.aarch64 13/17
Running scriptlet: ceph-common-14.2.10-0.oe1.bclinux.aarch64 14/17
Installing : ceph-common-14.2.10-0.oe1.bclinux.aarch64 14/17
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
Running scriptlet: ceph-common-14.2.10-0.oe1.bclinux.aarch64 14/17
Installing : python-rgw-14.2.10-0.oe1.bclinux.aarch64 15/17
Cleanup : librbd1-2:12.2.8-16.oe1.aarch64 16/17
Running scriptlet: librbd1-2:12.2.8-16.oe1.aarch64 16/17
Cleanup : librados2-2:12.2.8-16.oe1.aarch64 17/17
Running scriptlet: librados2-2:12.2.8-16.oe1.aarch64 17/17
Verifying : librados2-14.2.10-0.oe1.bclinux.aarch64 1/17
Verifying : librados2-2:12.2.8-16.oe1.aarch64 2/17
Verifying : librbd1-14.2.10-0.oe1.bclinux.aarch64 3/17
Verifying : librbd1-2:12.2.8-16.oe1.aarch64 4/17
Verifying : jemalloc-5.1.0-4.oe1.aarch64 5/17
Verifying : jemalloc-help-5.1.0-4.oe1.aarch64 6/17
Verifying : leveldb-1.20-4.oe1.aarch64 7/17
Verifying : ceph-common-14.2.10-0.oe1.bclinux.aarch64 8/17
Verifying : libcephfs2-14.2.10-0.oe1.bclinux.aarch64 9/17
Verifying : python-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64 10/17
Verifying : python3-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64 11/17
Verifying : python3-cephfs-14.2.10-0.oe1.bclinux.aarch64 12/17
Verifying : python3-rados-14.2.10-0.oe1.bclinux.aarch64 13/17
Verifying : python3-rbd-14.2.10-0.oe1.bclinux.aarch64 14/17
Verifying : librgw2-14.2.10-0.oe1.bclinux.aarch64 15/17
Verifying : python3-rgw-14.2.10-0.oe1.bclinux.aarch64 16/17
Verifying : python-rgw-14.2.10-0.oe1.bclinux.aarch64 17/17
Downgraded:
librados2-14.2.10-0.oe1.bclinux.aarch64 librbd1-14.2.10-0.oe1.bclinux.aarch64
Installed:
ceph-common-14.2.10-0.oe1.bclinux.aarch64 jemalloc-5.1.0-4.oe1.aarch64 jemalloc-help-5.1.0-4.oe1.aarch64 leveldb-1.20-4.oe1.aarch64 libcephfs2-14.2.10-0.oe1.bclinux.aarch64
librgw2-14.2.10-0.oe1.bclinux.aarch64 python-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64 python-rgw-14.2.10-0.oe1.bclinux.aarch64 python3-ceph-argparse-14.2.10-0.oe1.bclinux.aarch64 python3-cephfs-14.2.10-0.oe1.bclinux.aarch64
python3-rados-14.2.10-0.oe1.bclinux.aarch64 python3-rbd-14.2.10-0.oe1.bclinux.aarch64 python3-rgw-14.2.10-0.oe1.bclinux.aarch64
Complete!
故障 ImportError: No module named rados
再次安装
[root@ceph-client aarch64]# yum install -y ceph-common-14.2.10-0.oe1.bclinux.aarch64.rpm ceph-base-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librados2-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librados-devel-14.2.10-0.oe1.bclinux.aarch64.rpm \
> libradospp-devel-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librbd1-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librbd-devel-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librgw2-14.2.10-0.oe1.bclinux.aarch64.rpm \
> librgw-devel-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-rados-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-rbd-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python3-rgw-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python-rados-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python-rbd-14.2.10-0.oe1.bclinux.aarch64.rpm \
> python-rgw-14.2.10-0.oe1.bclinux.aarch64.rpm \
> rados-objclass-devel-14.2.10-0.oe1.bclinux.aarch64.rpm \
> rbd-fuse-14.2.10-0.oe1.bclinux.aarch64.rpm \
> rbd-mirror-14.2.10-0.oe1.bclinux.aarch64.rpm \
> rbd-nbd-14.2.10-0.oe1.bclinux.aarch64.rpm
Unable to connect to Registration Management Service
Last metadata expiration check: 0:14:26 ago on Mon 13 Nov 2023 03:08:56 PM CST.
Package ceph-common-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Package librados2-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Package librbd1-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Package librgw2-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Package python3-rados-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Package python3-rbd-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Package python3-rgw-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Package python-rgw-14.2.10-0.oe1.bclinux.aarch64 is already installed.
Dependencies resolved.
===========================================================================================================================================================================================================================================================================
Package Architecture Version Repository Size
===========================================================================================================================================================================================================================================================================
Installing:
ceph-base aarch64 14.2.10-0.oe1.bclinux @commandline 4.5 M
librados-devel aarch64 14.2.10-0.oe1.bclinux @commandline 83 k
libradospp-devel aarch64 14.2.10-0.oe1.bclinux @commandline 31 k
librbd-devel aarch64 14.2.10-0.oe1.bclinux @commandline 21 k
librgw-devel aarch64 14.2.10-0.oe1.bclinux @commandline 10 k
python-rados aarch64 14.2.10-0.oe1.bclinux @commandline 227 k
python-rbd aarch64 14.2.10-0.oe1.bclinux @commandline 212 k
rados-objclass-devel aarch64 14.2.10-0.oe1.bclinux @commandline 7.8 k
rbd-fuse aarch64 14.2.10-0.oe1.bclinux @commandline 66 k
rbd-mirror aarch64 14.2.10-0.oe1.bclinux @commandline 2.0 M
rbd-nbd aarch64 14.2.10-0.oe1.bclinux @commandline 130 k
Transaction Summary
===========================================================================================================================================================================================================================================================================
Install 11 Packages
Total size: 7.3 M
Installed size: 31 M
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : librados-devel-14.2.10-0.oe1.bclinux.aarch64 1/11
Installing : libradospp-devel-14.2.10-0.oe1.bclinux.aarch64 2/11
Installing : python-rados-14.2.10-0.oe1.bclinux.aarch64 3/11
Installing : ceph-base-14.2.10-0.oe1.bclinux.aarch64 4/11
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
warning: user ceph does not exist - using root
warning: group ceph does not exist - using root
Running scriptlet: ceph-base-14.2.10-0.oe1.bclinux.aarch64 4/11
Installing : rbd-mirror-14.2.10-0.oe1.bclinux.aarch64 5/11
Running scriptlet: rbd-mirror-14.2.10-0.oe1.bclinux.aarch64 5/11
Installing : python-rbd-14.2.10-0.oe1.bclinux.aarch64 6/11
Installing : librbd-devel-14.2.10-0.oe1.bclinux.aarch64 7/11
Installing : rados-objclass-devel-14.2.10-0.oe1.bclinux.aarch64 8/11
Installing : librgw-devel-14.2.10-0.oe1.bclinux.aarch64 9/11
Installing : rbd-nbd-14.2.10-0.oe1.bclinux.aarch64 10/11
Installing : rbd-fuse-14.2.10-0.oe1.bclinux.aarch64 11/11
Running scriptlet: rbd-fuse-14.2.10-0.oe1.bclinux.aarch64 11/11
Verifying : ceph-base-14.2.10-0.oe1.bclinux.aarch64 1/11
Verifying : librados-devel-14.2.10-0.oe1.bclinux.aarch64 2/11
Verifying : libradospp-devel-14.2.10-0.oe1.bclinux.aarch64 3/11
Verifying : librbd-devel-14.2.10-0.oe1.bclinux.aarch64 4/11
Verifying : librgw-devel-14.2.10-0.oe1.bclinux.aarch64 5/11
Verifying : python-rados-14.2.10-0.oe1.bclinux.aarch64 6/11
Verifying : python-rbd-14.2.10-0.oe1.bclinux.aarch64 7/11
Verifying : rados-objclass-devel-14.2.10-0.oe1.bclinux.aarch64 8/11
Verifying : rbd-fuse-14.2.10-0.oe1.bclinux.aarch64 9/11
Verifying : rbd-mirror-14.2.10-0.oe1.bclinux.aarch64 10/11
Verifying : rbd-nbd-14.2.10-0.oe1.bclinux.aarch64 11/11
Installed:
ceph-base-14.2.10-0.oe1.bclinux.aarch64 librados-devel-14.2.10-0.oe1.bclinux.aarch64 libradospp-devel-14.2.10-0.oe1.bclinux.aarch64 librbd-devel-14.2.10-0.oe1.bclinux.aarch64 librgw-devel-14.2.10-0.oe1.bclinux.aarch64
python-rados-14.2.10-0.oe1.bclinux.aarch64 python-rbd-14.2.10-0.oe1.bclinux.aarch64 rados-objclass-devel-14.2.10-0.oe1.bclinux.aarch64 rbd-fuse-14.2.10-0.oe1.bclinux.aarch64 rbd-mirror-14.2.10-0.oe1.bclinux.aarch64
rbd-nbd-14.2.10-0.oe1.bclinux.aarch64
Complete!
故障 ImportError: No module named prettytable
yum install python2-prettytable客户端指令验证ok
ceph.conf 配置
ceph-0上生成最小配置
[root@ceph-0 ~]# ceph config generate-minimal-conf
# minimal ceph.conf for ff72b496-d036-4f1b-b2ad-55358f3c16cb
[global]
fsid = ff72b496-d036-4f1b-b2ad-55358f3c16cb
mon_host = [v2:172.17.163.105:3300/0,v1:172.17.163.105:6789/0] [v2:172.17.112.206:3300/0,v1:172.17.112.206:6789/0] [v2:172.17.227.100:3300/0,v1:172.17.227.100:6789/0] [v2:172.17.67.157:3300/0,v1:172.17.67.157:6789/0]
ceph-client ceph.conf
编辑/etc/ceph/ceph.conf
# minimal ceph.conf for ff72b496-d036-4f1b-b2ad-55358f3c16cb
[global]fsid = ff72b496-d036-4f1b-b2ad-55358f3c16cbmon_host = [v2:172.17.163.105:3300/0,v1:172.17.163.105:6789/0] [v2:172.17.112.206:3300/0,v1:172.17.112.206:6789/0] [v2:172.17.227.100:3300/0,v1:172.17.227.100:6789/0] [v2:172.17.67.157:3300/0,v1:172.17.67.157:6789/0]秘钥
ceph-0 上生成密码
[root@ceph-0 ~]# ceph fs authorize cephfs client.foo / rw
[client.foo]
key = AQDI1FFlhnz6KhAAe3TA0YhZy3I8oW0Fus3WfQ==
ceph-client配置秘钥文件
/etc/ceph/ceph.client.foo.keyring
[client.foo]key = AQDI1FFlhnz6KhAAe3TA0YhZy3I8oW0Fus3WfQ==配置权限
[root@ceph-client ceph]# chmod 600 ceph.client.foo.keyring
[root@ceph-client ceph]# chmod 644 ceph.conf
挂载失败
最新官网文档方案报错，估计版本差异大
[root@ceph-client ceph]# mount.ceph ceph@ff72b496-d036-4f1b-b2ad-55358f3c16cb.cephfs=/ /mnt/cephfs -o mon_addr=ceph-0:6789
source mount path was not specified
unable to parse mount source: -22
[root@ceph-client ~]# mount -t ceph ceph-0:/ /mnt/cephfs/
unable to get monitor info from DNS SRV with service name: ceph-mon
2023-11-13 16:33:07.761 ffff9a776010 -1 failed for service _ceph-mon._tcp
2023-11-13 16:33:07.761 ffff9a776010 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.guest.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory
mount error 22 = Invalid argument
[root@ceph-client ceph]# mv ceph.client.foo.keyring ceph.keyring
[root@ceph-client ceph]# mount -t ceph ceph-0:/ /mnt/cephfs/
unable to get monitor info from DNS SRV with service name: ceph-mon
2023-11-13 16:35:04.049 ffffa93fe010 -1 failed for service _ceph-mon._tcp
mount error 22 = Invalid argument
[root@ceph-client ceph]# mount -t ceph ceph-0:/ /mnt/cephfs/ -o name=client.foo,secret=AQDI1FFlhnz6KhAAe3TA0YhZy3I8oW0Fus3WfQ==
mount error 1 = Operation not permitted
挂载成功
mount -t ceph ceph-0:/ /mnt/cephfs/ -o name=foo,secret=AQDI1FFlhnz6KhAAe3TA0YhZy3I8oW0Fus3WfQ==
高可用挂载
mount -t ceph ceph-0,ceph-1,ceph-2,ceph-3:/ /mnt/cephfs/ -o name=foo,secret=AQDI1FFlhnz6KhAAe3TA0YhZy3I8oW0Fus3WfQ==dd测试
参考：
Ceph Filesystem — Ceph Documentation nautilus 14.2.10版本文档
Ceph文件系统_mount -t ceph-CSDN博客
相关文章：
bclinux aarch64 ceph 14.2.10 文件存储 Ceph File System, 需要部署mds： ceph-deploy mds
创建池 [rootceph-0 ~]# ceph osd pool create cephfs_data 64 pool cephfs_data created [rootceph-0 ~]# ceph osd pool create cephfs_metadata 32 pool cephfs_metadata created cephfs_metadata 64 报错 官方说明： 元数据池通常最多可容纳几 GB 的数据。为…...
【微前端】micro-app搭建项目实战
主应用 1、安装依赖 npm i micro-zoe/micro-app --save 2、初始化micro-app import microApp from ‘micro-zoe/micro-app’ microApp.start() 项目环境 vue3 ts 主应用实例 // main.ts 1.引入插件 import microApp from ‘micro-zoe/micro-app’ 2.初始化插件 microApp.star…...
C语言——分割单向链表
本文的内容是使用C语言分割单向链表，给出一个链表和一个值，要求链表中小于给定值的节点全都位于大于或等于给定值的节点之前，打印原始链表的所有元素和经此操作之后链表的所有元素。 分析：本题只是单向链表的分割，不涉…...
台式电脑的IP地址在哪里？解密台式电脑网络连接的秘密！
如今智能手机和便携式笔记本电脑盛行的时代，台式电脑似乎逐渐被人们所忽视。然而，对于需要高性能和大容量存储的用户来说，台式电脑依然是最好的选择。而作为一款能够连接网络的设备，台式电脑也有自己独特的IP地址。下面虎观代理…...
)
设计模式案例 （三)
文章目录 系列文章目录前言一、单例模式懒汉模式case 包饿汉模式case 包懒汉模式枷锁case 包 系列文章目录 第一章 设计模式案例 (一) 第二章 设计模式案例 （二) 第三章 设计模式案例 （二) 文章目录 系列文章目录前言一、单例模式懒汉模式case 包饿汉模…...
JZ22：链表中倒数第k个结点
JZ22：链表中倒数第k个结点 题目描述： 输入一个链表，输出该链表中倒数第k个结点。 示例1 输入： 1,{1,2,3,4,5} 返回值： {5} 分析： 快慢指针思想： 需要两个指针，快指针fast&…...
python的高性能web应用的开发与测试实验
引言 python语言一直以开发效率高著称，被广泛地应用于自动化领域： 测试自动化运维自动化构建发布自动化 但是因为其也具有如下两个特征： 解释型语言GIL全局解释器锁 前者导致其性能天然就被编译型语言在性能上落后了许多。而后者则在多核…...
除了http还有哪些通信协议？
除了HTTP协议外，还存在许多其他通信协议。以下是一些常见的通信协议： 1：HTTPS：HTTPS（HTTP Secure）是HTTP的安全版本，通过使用SSL（Secure Sockets Layer）或TLS࿰…...
基于遗传算法的图像重建
图像重建涉及从图像的有限信息中恢复出可能丢失或受损的信息。使用遗传算法进行图像重建的一般思路是调整某些参数或者操作，以使得图像的质量或者特定的性能指标最优化。 以下是一个简单的图像重建的遗传算法示例，以模拟重建一个被模糊的图像。 图像重…...
【Redis】Redis-Key的使用
上一篇： redis-server和redis-cli https://blog.csdn.net/m0_67930426/article/details/134361885?spm1001.2014.3001.5501 官网 命令 |雷迪斯 (redis.io) 设置key set name xxxxx 查看key keys * 再设置一个key并且查看 这里查看了两个key（name a…...
为忙碌的软件工程师精心准备的编码面试准备材料，超过 100,000 人受益！
这是一个针对技术面试准备的手册。它收集了大量的面试问题和答案，涵盖了算法、系统设计、前端等主题，并且还在不断更新和完善中。 这个项目是“Tech Interview Handbook”，解决了求职者在技术面试中遇到的各种难题，帮助他们更好地…...
SpringCloud Alibaba(上)：注册中心-nacos、负载均衡-ribbon、远程调用-feign
Nacos 概念：Nacos是阿里巴巴推出的一款新开源项目，它是一个更易于构建云原生应用的动态服务发现、配置管理和服务管理平台。Nacos致力于帮助用户发现、配置和管理微服务，它提供了一组简单易用的特性集，包括动态服务发现、服务配置…...
基于乌鸦算法优化概率神经网络PNN的分类预测 - 附代码
基于乌鸦算法优化概率神经网络PNN的分类预测 - 附代码 文章目录 基于乌鸦算法优化概率神经网络PNN的分类预测 - 附代码1.PNN网络概述2.变压器故障诊街系统相关背景2.1 模型建立 3.基于乌鸦优化的PNN网络5.测试结果6.参考文献7.Matlab代码 摘要：针对PNN神经网络的光滑…...
Jenkins中强制停止停不下来的job
# Script console 执行脚本 Jenkins 的提供了 script console 的功能，允许你写一些脚本，来调度 Jenkins 执行一些任务。 我们就可以利用 script console 来强制停止 job 执行。 首先进入 Jenkins 的 script console 页面： script console 路…...
北邮22级信通院数电：Verilog-FPGA（9）第九周实验（1）实现带同步复位功能、采用上升沿触发的D触发器
北邮22信通一枚~ 跟随课程进度更新北邮信通院数字系统设计的笔记、代码和文章 持续关注作者 迎接数电实验学习~ 获取更多文章，请访问专栏： 北邮22级信通院数电实验_青山如墨雨如画的博客-CSDN博客 目录 一.顶层模块的书写 二.两种验证方法 2.1使用…...
go中的rune类型
go语言中 ，rune其实是一种int32的数据类型的别名。 // rune is an alias for int32 and is equivalent to int32 in all ways. It is // used, by convention, to distinguish character values from integer values. type rune int32rune通常用于处理字符串中的单…...
C51--PC通过串口（中断）点亮LED
B4中的：REN允许 / 禁止串行接收控制位 REN 1为允许串行接收状态。 接收数据必须开启。所以SCON：0101 0000 ；即0x50 如何知道数据已经接收 RI位：当收到数据后 RI 1（由硬件置一） 硬件置一后必须用软件…...
使用pixy计算群体遗传学统计量
1 数据过滤 过滤参数：过滤掉次等位基因频率（minor allele frequency，MAF）低于0.05、哈达-温伯格平衡（Hardy– Weinberg equilibrium，HWE）对应的P值低于1e-10或杂合率（heterozygosit…...
第十九章总结：Java绘图
19.1：Java绘图类 19.2：绘制图形 package nineteentn; import java.awt.*; import javax.swing.*; public class DrawCircle extends JFrame { private final int OVAL_WIDTH 80; // 圆形的宽 private final int OVAL_HEIGHT 80; // 圆形的高…...
Mybatis-Plus条件构造器QueryWrapper
Mybatis-Plus条件构造器QueryWrapper 1、条件构造器关系介绍 介绍 ： 上图绿色框为抽象类 蓝色框为正常类，可创建对象 黄色箭头指向为父子类关系，箭头指向为父类 wapper介绍 ： Wrapper ： 条件构造抽象类࿰…...
云计算——弹性云计算器（ECS）
弹性云服务器：ECS 概述 云计算重构了ICT系统，云计算平台厂商推出使得厂家能够主要关注应用管理而非平台管理的云平台，包含如下主要概念。 ECS（Elastic Cloud Server）：即弹性云服务器，是云计算…...
抖音增长新引擎：品融电商，一站式全案代运营领跑者
抖音增长新引擎：品融电商，一站式全案代运营领跑者 在抖音这个日活超7亿的流量汪洋中，品牌如何破浪前行？自建团队成本高、效果难控；碎片化运营又难成合力——这正是许多企业面临的增长困局。品融电商以「抖音全案代运营…...
【C语言练习】080. 使用C语言实现简单的数据库操作
080. 使用C语言实现简单的数据库操作 080. 使用C语言实现简单的数据库操作使用原生APIODBC接口第三方库ORM框架文件模拟1. 安装SQLite2. 示例代码：使用SQLite创建数据库、表和插入数据3. 编译和运行4. 示例运行输出：5. 注意事项6. 总结080. 使用C语言实现简单的数据库操作 在…...
【碎碎念】宝可梦 Mesh GO : 基于MESH网络的口袋妖怪 宝可梦GO游戏自组网系统
目录 游戏说明《宝可梦 Mesh GO》 —— 局域宝可梦探索Pokmon GO 类游戏核心理念应用场景Mesh 特性 宝可梦玩法融合设计游戏构想要素1. 地图探索（基于物理空间 广播范围）2. 野生宝可梦生成与广播3. 对战系统4. 道具与通信5. 延伸玩法 安全性设计 技术选…...
中关于正整数输入的校验规则)
Element Plus 表单(el-form)中关于正整数输入的校验规则
目录 1 单个正整数输入1.1 模板1.2 校验规则 2 两个正整数输入（联动）2.1 模板2.2 校验规则2.3 CSS 1 单个正整数输入 1.1 模板 <el-formref"formRef":model"formData":rules"formRules"label-width"150px"…...
20个超级好用的 CSS 动画库
分享 20 个最佳 CSS 动画库。 它们中的大多数将生成纯 CSS 代码，而不需要任何外部库。 1.Animate.css 一个开箱即用型的跨浏览器动画库，可供你在项目中使用。 2.Magic Animations CSS3 一组简单的动画，可以包含在你的网页或应用项目中。 3.An…...
AirSim/Cosys-AirSim 游戏开发（四）外部固定位置监控相机
这个博客介绍了如何通过 settings.json 文件添加一个无人机外的 固定位置监控相机，因为在使用过程中发现 Airsim 对外部监控相机的描述模糊，而 Cosys-Airsim 在官方文档中没有提供外部监控相机设置，最后在源码示例中找到了，所以感…...
【JVM】Java虚拟机（二）——垃圾回收
目录 一、如何判断对象可以回收 （一）引用计数法 （二）可达性分析算法 二、垃圾回收算法 （一）标记清除 （二）标记整理 （三）复制 （四ÿ…...
《Docker》架构
文章目录 架构模式单机架构应用数据分离架构应用服务器集群架构读写分离/主从分离架构冷热分离架构垂直分库架构微服务架构容器编排架构什么是容器，docker，镜像，k8s 架构模式 单机架构 单机架构其实就是应用服务器和单机服务器都部署在同一…...
使用SSE解决获取状态不一致问题
使用SSE解决获取状态不一致问题 1. 问题描述2. SSE介绍2.1 SSE 的工作原理2.2 SSE 的事件格式规范2.3 SSE与其他技术对比2.4 SSE 的优缺点 3. 实战代码 1. 问题描述 目前做的一个功能是上传多个文件，这个上传文件是整体功能的一部分，文件在上传的过程中…...