问题描述
我使用的是VM，并且群集中包含1个主节点和一个节点以及3个其他节点，我安装了hadoop并将其复制到所有节点，并在主节点中部署了giraph，但是我不知道该复制giraph文件夹是否也分布到所有节点！！，我使用的是真实数据集WikiTalk，而我的命令行是
$ HADOOP_HOME / bin / hadoop jar $ GIRAPH_HOME / giraph-examples / target / giraph-examples-1.3.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar org.apache.giraph。 GiraphRunner org.apache.giraph.examples.SimplePageRankcomputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubLevertexInputFormat -vip /user/hduser/input/WikiTalk.txt -vof org.apache.giraph.io.formats.IdWithValuetextformat / user / hduser / output / wikiTalk11_output -w 4
但我发现了此异常
20/09/22 23:14:28 INFO job.GiraphJob: Waiting for resources... Job will start only when it gets all 5 mappers
20/09/22 23:14:50 INFO mapreduce.Job: Running job: job_1600808538899_0008
20/09/22 23:14:50 INFO mapreduce.Job: Job job_1600808538899_0008 running in uber mode : false
20/09/22 23:14:50 INFO mapreduce.Job: map 100% reduce 0%
20/09/22 23:14:50 INFO mapreduce.Job: Job job_1600808538899_0008 Failed with state Failed due to: Task Failed task_1600808538899_0008_m_000002
Job Failed as tasks Failed. FailedMaps:1 FailedReduces:0
20/09/22 23:14:50 INFO mapreduce.Job: Counters: 12
Job Counters
Failed map tasks=1
Killed map tasks=4
Launched map tasks=5
Other local map tasks=5
Total time spent by all maps in occupied slots (ms)=65129
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=65129
Total vcore-seconds taken by all map tasks=65129
Total megabyte-seconds taken by all map tasks=66692096
Map-Reduce Framework
cpu time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
所以我不知道发生此异常的原因是什么！！
解决方法
暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！
如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。
小编邮箱:dio#foxmail.com (将#修改为@）