Apache kylin 在 Spark 上构建立方体

问题描述

我正在尝试使用 spark 在 kylin 上构建一个立方体,但是,当我选择构建时,它会引发此错误。 有谁知道我该如何解决这个问题?

2021-01-14 10:20:08,585 ERROR [http-nio-7070-exec-7] controller.BasicController:63 :
org.apache.kylin.rest.exception.InternalErrorException: org/apache/spark/api/java/function/Function
    at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:435)
    at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:391)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.springframework.web.method.support.invocableHandlerMethod.doInvoke(invocableHandlerMethod.java:205)
    at org.springframework.web.method.support.invocableHandlerMethod.invokeForRequest(invocableHandlerMethod.java:133)
    at org.springframework.web.servlet.mvc.method.annotation.ServletinvocableHandlerMethod.invokeAndHandle(ServletinvocableHandlerMethod.java:97)
    org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:818)
    at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1623)
    at org.apache.tomcat.util.net.socketProcessorBase.run(SocketProcessorBase.java:49)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoClassDefFoundError: org/apache/spark/api/java/function/Function
    at org.apache.kylin.engine.spark.SparkBatchcubingJobBuilder2.<init>(SparkBatchcubingJobBuilder2.java:55)
    at org.apache.kylin.engine.spark.SparkBatchcubingEngine2.createBatchcubingJob(SparkBatchcubingEngine2.java:44)
    at org.apache.kylin.engine.EngineFactory.createBatchcubingJob(EngineFactory.java:61)
    at org.apache.kylin.rest.service.JobService.submitJobInternal(JobService.java:255)
    at org.apache.kylin.rest.service.JobService.submitJob(JobService.java:223)
    at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:431)
    ... 79 more
Caused by: java.lang.classNotFoundException: org.apache.spark.api.java.function.Function
    at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1358)
    at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1180)
    ... 85 more

解决方法

暂无找到可以解决该程序问题的有效方法,小编努力寻找整理中!

如果你已经找到好的解决方法,欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@)