问题描述
我正在将 Solr 从 3 台旧机器迁移到 3 台新机器,但我只能让 Solr 在 3 台新机器中的 1 台上运行。 Solr 在 3 台旧机器上运行良好,但不知道为什么它不能在 2 台新机器上运行。
我在 3 台 RHEL 7 机器上运行 Solr 7.4。
对于 2 台无法启动 Solr 的新机器,我在尝试启动时收到以下错误。
Starting Solr...
find: `/user/solr/tagCollection/core_node3': No such file or directory
*** [WARN] *** Your open file limit is currently 1024.
It should be set to 65000 to avoid operational disruption.
If you no longer wish to see this warning,set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
*** [WARN] *** Your Max Processes Limit is currently 4096.
It should be set to 65000 to avoid operational disruption.
If you no longer wish to see this warning,set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
Waiting up to 180 seconds to see Solr running on port 8983 [-] Still not seeing Solr listening on 8983 after 180 seconds!
2021-06-22 08:15:48.910 INFO (qtp867148091-17) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=183
2021-06-22 08:15:48.911 INFO (qtp867148091-20) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:16:49.424 INFO (qtp867148091-17) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=182
2021-06-22 08:16:49.425 INFO (qtp867148091-16) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:17:49.932 INFO (qtp867148091-17) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:17:49.934 INFO (qtp867148091-13) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:18:50.463 INFO (qtp867148091-13) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:18:50.466 INFO (qtp867148091-22) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:19:50.979 INFO (qtp867148091-13) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=187
2021-06-22 08:19:50.981 INFO (qtp867148091-19) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:20:01.494 INFO (qtp867148091-18) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=clusterstatus&wt=json and sendToOCPQueue=true
2021-06-22 08:20:01.495 INFO (qtp867148091-18) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=clusterstatus&wt=json} status=0 QTime=1
2021-06-22 08:20:51.495 INFO (qtp867148091-13) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:20:51.502 INFO (qtp867148091-14) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=6
2021-06-22 08:21:52.024 INFO (qtp867148091-13) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:21:52.026 INFO (qtp867148091-16) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:22:52.546 INFO (qtp867148091-13) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:22:52.548 INFO (qtp867148091-20) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:23:53.050 INFO (qtp867148091-20) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=182
2021-06-22 08:23:53.053 INFO (qtp867148091-22) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:24:53.569 INFO (qtp867148091-20) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:24:53.570 INFO (qtp867148091-85) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:25:01.787 INFO (qtp867148091-18) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=clusterstatus&wt=json and sendToOCPQueue=true
2021-06-22 08:25:01.788 INFO (qtp867148091-18) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=clusterstatus&wt=json} status=0 QTime=1
2021-06-22 08:25:54.096 INFO (qtp867148091-20) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:25:54.098 INFO (qtp867148091-14) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:26:54.617 INFO (qtp867148091-20) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=194
2021-06-22 08:26:54.619 INFO (qtp867148091-19) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:27:55.130 INFO (qtp867148091-19) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:27:55.131 INFO (qtp867148091-13) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processcpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemloadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=
有人对如何解决这个问题有任何想法吗?我已经更新了所有配置设置以使用 Zookeeper 中的新 IP,当我在所有 3 个新服务器上运行 zookeeper 状态时,它们会相应地报告。我真的很难理解为什么 3 台新服务器中的 1 台正在工作。
此外,这是我在 Solr 运行良好的 1 台主机上获得的输出。
Starting Solr...
find: `/user/solr/tagCollection/core_node3': No such file or directory
*** [WARN] *** Your open file limit is currently 1024.
It should be set to 65000 to avoid operational disruption.
If you no longer wish to see this warning,set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
*** [WARN] *** Your Max Processes Limit is currently 1024.
It should be set to 65000 to avoid operational disruption.
If you no longer wish to see this warning,set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
Warning: Available entropy is low. As a result,use of the UUIDField,SSL,or any other features that require
RNG might not work properly. To check for the amount of available entropy,use 'cat /proc/sys/kernel/random/entropy_avail'.
Waiting up to 180 seconds to see Solr running on port 8983 [\]
Started Solr server on port 8983 (pid=10825). Happy searching!
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
java 10825 solruser 125u IPv6 7365290 0t0 TCP *:8983 (LISTEN)
解决方法
因此,在花了数小时尝试解决此问题后,我们发现我们的 2 个新 VM 没有重新创建,使其具有与旧机器相同的规格。它们的 RAM 大约是我们原始机器的一半。因此,每当我们在它们上启动 Solr 时,它们都不会启动,因为作为 Solr 启动过程的一部分,我们为 RAM 设置了一个自定义大小,该值高于新机器的值。将 2 个服务器重建为具有正确规格的新实例后,Solr 开始没有问题。
,这只是一个警告,如果您将使用大数据,您应该解决它。所以你需要在你的操作系统中添加打开文件的限制。如果您使用 Linux,请在 /etc/sysctl.conf
中添加以下内容并在重新登录后重新启动。
soft nofile 65536
hard nofile 65536