问题描述
我按照this link的以下步骤在Centos 8.1上设置了ceph集群
curl --silent --remote-name --location https://github.com/ceph/ceph/raw/octopus/src/cephadm/cephadm
chmod +x cephadm
./cephadm add-repo --release octopus
./cephadm install
执行上述命令后，我发现ceph需要docker或podman才能运行。因此，我从https://docs.ceph.com/en/latest/cephadm/install/安装了docker的社区版本，并继续执行以下步骤。
./cephadm install
mkdir -p /etc/ceph
cephadm bootstrap --mon-ip *ip_of_the_current_machine (host1)*
cephadm install ceph-common
ssh-copy-id -f -i /etc/ceph/ceph.pub root@host2*
ceph orch host add host2
[root@host1 home]# ceph orch host add host2
INFO:cephadm:Inferring fsid 12345678-2345-6789-1011-000129110013
INFO:cephadm:Inferring config /var/lib/ceph/12345678-2345-6789-1011-000129110013/mon.host1/config
INFO:cephadm:Using recent ceph image ceph/ceph:v15
Error EINVAL: Failed to connect to host2 (host2).
Check that the host is reachable and accepts connections using the cephadm SSH key
you may want to run:
> ceph cephadm get-ssh-config > ssh_config
> ceph config-key get mgr/cephadm/ssh_identity_key > key
> ssh -F ssh_config -i key root@host2
我可以使用上述步骤登录到host2。 有人可以告诉我我做错了什么吗。我该如何解决这个问题。
解决方法
因此，经过几天的调试，我发现想添加的节点上缺少python3。我要做的就是使用命令检查最后几条日志。
ceph log last cephadm
这给出了以下日志消息。
Traceback (most recent call last):
File "/usr/share/ceph/mgr/cephadm/module.py",line 1036,in _remote_connection
raise execnet.gateway_bootstrap.HostNotFound(msg)
execnet.gateway_bootstrap.HostNotFound: Can't communicate with remote host `host2`,possibly because python3 is not installed there: cannot send (already closed?)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/share/ceph/mgr/orchestrator/_interface.py",line 295,in _finalize
next_result = self._on_complete(self._value)
File "/usr/share/ceph/mgr/cephadm/module.py",line 103,in <lambda>
return CephadmCompletion(on_complete=lambda _: f(*args,**kwargs))
File "/usr/share/ceph/mgr/cephadm/module.py",line 1201,in add_host
return self._add_host(spec)
File "/usr/share/ceph/mgr/cephadm/module.py",line 1187,in _add_host
error_ok=True,no_fsid=True)
File "/usr/share/ceph/mgr/cephadm/module.py",line 1104,in _run_cephadm
with self._remote_connection(host,addr) as tpl:
File "/lib64/python3.6/contextlib.py",line 81,in __enter__
return next(self.gen)
File "/usr/share/ceph/mgr/cephadm/module.py",line 1055,in _remote_connection
raise OrchestratorError(msg) from e
orchestrator._interface.OrchestratorError: Failed to connect to host2 (host2).
Check that the host is reachable and accepts connections using the cephadm SSH key
下一步添加我运行的节点。
ceph orch host add host2 ip_address
我遇到了同样的问题，但最重要的错误消息是
2021-01-13T15:21:13.071913+0000 mgr.ha1.qzzjzw (mgr.18492) 167366 : cephadm [ERR] _Promise failed
Traceback (most recent call last):
File "/lib/python3.6/site-packages/execnet/gateway_bootstrap.py",line 48,in bootstrap_exec
s = io.read(1)
File "/lib/python3.6/site-packages/execnet/gateway_base.py",line 402,in read
raise EOFError("expected %d bytes,got %d" % (numbytes,len(buf)))
EOFError: expected 1 bytes,got 0
解决方法也对我有帮助
ceph orch host add host2 ip_address
我在 debian 10 上使用 cephadm 遇到了与 Oleg 相同的问题。
解决方法是添加 IP 地址。
sudo ./cephadm shell
ceph orch host add host2 ip_address
Added host 'host2'