FileNotFoundError: [WinError 2] 系统找不到指定的文件 - PySpark

问题描述

操作系统 - Windows 开发环境 - Eclipse PyDev

PySpark 代码 -

import sparknlp,os
from pyspark.sql.types import StringType,IntegerType
from sparknlp.base import *
from pyspark.sql import SparkSession
from sparknlp.annotator import *

sys.path.append("D:/Python/")

spark = SparkSession.builder \
 .appName("Spark NLP")\
 .master("local[4]")\
 .config("spark.driver.memory","16G")\
 .config("spark.driver.maxResultSize","0") \
 .config("spark.jars.packages","com.johnsNowlabs.nlp:spark-nlp_2.11:2.7.4")\
 .config("spark.kryoserializer.buffer.max","1000M")\
 .getorCreate()


 spark = sparknlp.start()

错误追溯 -

Traceback (most recent call last):
  
File "D:\Workspace\NLP-Parser\src\Parser.py",line 15,in <module>
    
spark = SparkSession.builder \
  
File "D:\Python\lib\site-packages\pyspark\sql\session.py",line 186,in getorCreate
    sc = SparkContext.getorCreate(sparkConf)
  
File "D:\Python\lib\site-packages\pyspark\context.py",line 376,in getorCreate
    SparkContext(conf=conf or SparkConf())
  
File "D:\Python\lib\site-packages\pyspark\context.py",line 133,in __init__
    SparkContext._ensure_initialized(self,gateway=gateway,conf=conf)
  
File "D:\Python\lib\site-packages\pyspark\context.py",line 325,in _ensure_initialized
    SparkContext._gateway = gateway or launch_gateway(conf)
  
File "D:\Python\lib\site-packages\pyspark\java_gateway.py",line 99,in launch_gateway
    proc = Popen(command,**popen_kwargs)
  
File "D:\Python\lib\subprocess.py",line 947,in __init__
    self._execute_child(args,executable,preexec_fn,close_fds,File "D:\Python\lib\subprocess.py",line 1416,in _execute_child
    hp,ht,pid,tid = _winapi.CreateProcess(executable,args,FileNotFoundError: [WinError 2] The system cannot find the file specified

解决方法

暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！

如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@）