hadoop start-dfs.sh的系统服务

问题描述

我无法让Hadoop dfs作为Ubuntu18.04上的系统服务运行。 从终端运行start-dfs.sh可以正常运行,但是作为systemd服务运行失败。

我还在这里(Systemd Hdfs Service [hadoop] - startup)尝试了该示例,但是失败了。

服务文件..

[Unit]
Description=Hadoop DFS namenode and datanode
After=syslog.target network.target remote-fs.target nss-lookup.target network-online.target
Requires=network-online.target

[Service]
User=ubuntu
Group=ubuntu
Type=forking
ExecStart=/opt/hadoop/sbin/start-dfs.sh
ExecStop=/opt/hadoop/sbin/stop-dfs.sh
WorkingDirectory=/home/ubuntu
Environment=JAVA_HOME=/usr/lib/jvm/jdk1.8.0_251
Environment=SPARK_HOME=/opt/spark
Environment=HADOOP_HOME=/opt/hadoop
Environment=HADOOP_CONF_DIR=/opt/hadoop/etc/hadoop
Environment=HADOOP_OPTS="-Djava.library.path=/opt/hadoop/lib/native"
Environment=YARN_HOME=/opt/hadoop
Environment=LD_LIBRARY_PATH=/opt/hadoop/lib/native
TimeoutStartSec=2min
#Restart=on-failure
PIDFile=/tmp/hadoop-ubuntu-namenode.pid
RestartSec= 30
StartLimitInterval=350
StartLimitBurst=10
SuccessExitStatus=143

[Install]
WantedBy=multi-user.target

错误...

ubuntu@sc:/etc/systemd/system$ sudo service hadoop-dfs status
● hadoop-dfs.service - Hadoop DFS namenode and datanode
   Loaded: loaded (/etc/systemd/system/hadoop-dfs.service; disabled; vendor preset: enabled)
   Active: failed (Result: protocol) since Wed 2020-10-14 14:28:19 UTC; 8s ago
  Process: 4992 ExecStart=/opt/hadoop/sbin/start-dfs.sh (code=exited,status=0/SUCCESS)

Oct 14 14:28:00 sc systemd[1]: Starting Hadoop DFS namenode and datanode...
Oct 14 14:28:01 sc start-dfs.sh[4992]: Starting namenodes on [localhost]
Oct 14 14:28:06 sc start-dfs.sh[4992]: localhost: starting namenode,logging to /opt/hadoop-2.8.5/logs/hadoop-ubuntu-namenode-sc.out
Oct 14 14:28:11 sc start-dfs.sh[4992]: localhost: starting datanode,logging to /opt/hadoop-2.8.5/logs/hadoop-ubuntu-datanode-sc.out
Oct 14 14:28:12 sc start-dfs.sh[4992]: Starting secondary namenodes [0.0.0.0]
Oct 14 14:28:17 sc start-dfs.sh[4992]: 0.0.0.0: starting secondarynamenode,logging to /opt/hadoop-2.8.5/logs/hadoop-ubuntu-secondarynamenode-sc.out
Oct 14 14:28:19 sc systemd[1]: hadoop-dfs.service: New main PID 6948 does not belong to service,and PID file is not owned by root. Refusing.
Oct 14 14:28:19 sc systemd[1]: hadoop-dfs.service: Failed with result 'protocol'.
Oct 14 14:28:19 sc systemd[1]: Failed to start Hadoop DFS namenode and datanode.

设置专用用户并仅运行namenode

● hadoop-dfs.service - Hadoop DFS namenode and datanode
   Loaded: loaded (/etc/systemd/system/hadoop-dfs.service; disabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Wed 2020-10-14 15:59:35 UTC; 5s ago
  Process: 12633 ExecStart=/opt/hadoop/sbin/hadoop-daemon.sh start namenode (code=exited,status=1/FAILURE)

Oct 14 15:59:31 sc systemd[1]: Starting Hadoop DFS namenode and datanode...
Oct 14 15:59:31 sc hadoop-daemon.sh[12633]: starting namenode,logging to /opt/hadoop-2.8.5/logs/hadoop-hadoop-namenode-sc.out
Oct 14 15:59:35 sc systemd[1]: hadoop-dfs.service: Control process exited,code=exited status=1
Oct 14 15:59:35 sc systemd[1]: hadoop-dfs.service: Failed with result 'exit-code'.
Oct 14 15:59:35 sc systemd[1]: Failed to start Hadoop DFS namenode and datanode.

解决方法

暂无找到可以解决该程序问题的有效方法,小编努力寻找整理中!

如果你已经找到好的解决方法,欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@)