Hadoop 3.3和oozie 5.2.0

问题描述

我正在使用hadoop 3.3和oozie 5.2.0。

我遇到以下错误：

Exception in thread "main" java.lang.NullPointerException
    at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.unregisterapplicationMaster(AMRMClientImpl.java:519)
    at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl.unregisterapplicationMaster(AMRMClientAsyncImpl.java:220)
    at org.apache.oozie.action.hadoop.LauncherAM.unregisterWithRM(LauncherAM.java:354)
    at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:280)
    at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:155)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupinformation.doAs(UserGroupinformation.java:1845)
    at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:143)

解决方法

可能存在hadoop3.3不兼容的oozie 5.2.0

https://issues.apache.org/jira/browse/OOZIE-3219?page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel&focusedCommentId=17156510#comment-17156510

Oozie 5.2的默认Hadoop版本为2.6.0

您可能需要针对较新版本的Hadoop构建Oozie

http://oozie.apache.org/docs/5.2.0/ENG_Building.html

oozie yarn