问题描述
我正在学习在具有能够运行Hadoop的硬件的个人计算机上使用Spark。这是配置：
带有Cloudera Quickstart，Spark 2.4.7，JDK1.8.0_181，Hadoop 2.6.0，Python 3.6.9的Cloudera CDH 5.5.0。
运行Python脚本（从YouTube上的Udemy视频复制）时，我遇到并修复了多个错误，但找不到以下解决方案：
java.io.IOException：HDFS URI不完整，没有主机：hdfs：/ user / cloudera / Spark / ml-100 k / u.data
回溯（最近通话最近一次）：
File "/home/cloudera/Spark/LowestRatedMovieDataFrame.py",line 75,in < module >
movieDataset = spark.createDataFrame(movies)
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/session.py",line 746,in createDataFrame
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/session.py",line 390,in _createFromrDD
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/session.py",line 361,in _inferSchema
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/rdd.py",line 1378,in first
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/rdd.py",line 1327,in take
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/rdd.py",line 2517,in getNumPartitions
File "/usr/local/spark/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py",line 1257,in __call__
File "/usr/local/spark/python/lib/pyspark.zip/pyspark/sql/utils.py",line 63,in deco
File "/usr/local/spark/python/lib/py4j-0.10.7-src.zip/py4j/protocol.py",line 328,in get_return_value
py4j.protocol.Py4JJavaError: An error occurred
while calling o27.partitions.: java.io.IOException: Incomplete HDFS URI,no host: hdfs: /user/cloudera / Spark / ml - 100 k / u.data
解决方法
暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！
如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。
小编邮箱:dio#foxmail.com (将#修改为@）