我的TEZ Web无法获取数据并报告错误如何正确使用tez UI？

编程问答 2022-06-04

问题描述

环境：cdh6和centos7 hadoop3.0.0 hive2.1.1 tez0.9.1

无法获取数据；显示错误：某些数据不可用！ URL未返回任何数据：http://192.168.100.142:8188/ws/v1/timeline/TEZ_APPLICATION/tez_application_1604458903218_0002。该数据可能在YARN时间轴中不可用，或者您可能没有查看此数据所需的权限。 enter image description here

cat /opt/tomcat8/webapps/tez-ui/config/configs.env 

    ENV = {
  hosts: {
    /*
     * Timeline Server Address:
     * By default TEZ UI looks for timeline server at http://localhost:8188,uncomment and change
     * the following value for pointing to a different address.
     */
    timeline: "http://192.168.100.142:8188",/*
     * Resource Manager Address:
     * By default RM REST APIs are expected to be at http://localhost:8088,uncomment and change
     * the following value to point to a different address.
     */
    rm: "http://192.168.100.143:8088",/*
     * Resource Manager Web Proxy Address:
     * Optional - By default,value configured as RM host will be taken as proxy address
     * Use this configuration when RM web proxy is configured at a different address than RM.
     */
    //rmProxy: "http://localhost:8088",},/*
   * Time Zone in which dates are displayed in the UI:
   * If not set,local time zone will be used.
   * Refer http://momentjs.com/timezone/docs/ for valid entries.
   */
  //timeZone: "UTC",/*
   * yarnProtocol:
   * If specified,this protocol would be used to construct node manager log links.
   * Possible values: http,https
   * Default value: If not specified,protocol of hosts.rm will be used
   */
  //yarnProtocol: "<value>",};

cat /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/tez/conf/tez-site.xml 

<configuration>

<property>
<name>tez.lib.uris</name>
<value>${fs.defaultFS}/user/tez/tez-0.9.1.tar.gz</value>
</property>
<property>
<name>tez.use.cluster.hadoop-libs</name>
<value>false</value>
</property>



<property>
<name>hive.server2.tez.default.queues</name>
<value>default</value>
</property>

<property>
<name>hive.server2.tez.sessions.per.default.queue</name>
<value>3</value>
</property>

<property>
<name>hive.server2.tez.initialize.default.sessions</name>
<value>true</value>
</property>

<property>
<name>hive.prewarm.enabled</name>
<value>true</value>
</property>

<property>
<name>hive.prewarm.numcontainers</name>
<value>2</value>
</property>

<property>
<name>tez.am.container.reuse.enabled</name>
<value>true</value>
</property>

<property>
<name>hive.server2.enable.doAs</name>
<value>false</value>
</property>


<property>
<name>tez.am.container.idle.release-timeout-min.millis</name>
<value>30000</value>
</property>

<property>
<name>tez.am.container.idle.release-timeout-max.millis</name>
<value>90000</value>
</property>




<!--Configuring Tez to use YARN Timeline-->
    <property>
        <name>tez.history.logging.service.class</name>
        <value>org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService</value>
    </property>
    <property>
        <name>tez.tez-ui.history-url.base</name>
<!-- 这里的地址就是你的tomcat ip + port + webapps里面的文件夹名称 端口和文件夹名 是变量  -->
        <value>http://192.168.100.142:21111/tez-ui/</value>
    </property>





</configuration>

cat /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-yarn/etc/hadoop/yarn-site.xml 

<?xml version="1.0" encoding="UTF-8"?>

<!--Autogenerated by Cloudera Manager-->
<configuration>
  <property>
    <name>yarn.acl.enable</name>
    <value>false</value>
  </property>
  <property>
    <name>yarn.admin.acl</name>
    <value>*</value>
  </property>
  <property>
    <name>yarn.resourcemanager.address</name>
    <value>sbider-dev-02:8032</value>
  </property>
  <property>
    <name>yarn.resourcemanager.admin.address</name>
    <value>sbider-dev-02:8033</value>
  </property>
  <property>
    <name>yarn.resourcemanager.scheduler.address</name>
    <value>sbider-dev-02:8030</value>
  </property>
  <property>
    <name>yarn.resourcemanager.resource-tracker.address</name>
    <value>sbider-dev-02:8031</value>
  </property>
  <property>
    <name>yarn.resourcemanager.webapp.address</name>
    <value>sbider-dev-02:8088</value>
  </property>
  <property>
    <name>yarn.resourcemanager.webapp.https.address</name>
    <value>sbider-dev-02:8090</value>
  </property>
  <property>
    <name>yarn.resourcemanager.client.thread-count</name>
    <value>50</value>
  </property>
  <property>
    <name>yarn.resourcemanager.scheduler.client.thread-count</name>
    <value>50</value>
  </property>
  <property>
    <name>yarn.resourcemanager.admin.client.thread-count</name>
    <value>1</value>
  </property>
  <property>
    <name>yarn.scheduler.minimum-allocation-mb</name>
    <value>1024</value>
  </property>
  <property>
    <name>yarn.scheduler.increment-allocation-mb</name>
    <value>512</value>
  </property>
  <property>
    <name>yarn.scheduler.maximum-allocation-mb</name>
    <value>8192</value>
  </property>
  <property>
    <name>yarn.scheduler.minimum-allocation-vcores</name>
    <value>1</value>
  </property>
  <property>
    <name>yarn.scheduler.increment-allocation-vcores</name>
    <value>1</value>
  </property>
  <property>
    <name>yarn.scheduler.maximum-allocation-vcores</name>
    <value>4</value>
  </property>
  <property>
    <name>yarn.resourcemanager.amliveliness-monitor.interval-ms</name>
    <value>1000</value>
  </property>
  <property>
    <name>yarn.am.liveness-monitor.expiry-interval-ms</name>
    <value>600000</value>
  </property>
  <property>
    <name>yarn.resourcemanager.am.max-attempts</name>
    <value>2</value>
  </property>
  <property>
    <name>yarn.resourcemanager.container.liveness-monitor.interval-ms</name>
    <value>600000</value>
  </property>
  <property>
    <name>yarn.resourcemanager.nm.liveness-monitor.interval-ms</name>
    <value>1000</value>
  </property>
  <property>
    <name>yarn.nm.liveness-monitor.expiry-interval-ms</name>
    <value>600000</value>
  </property>
  <property>
    <name>yarn.resourcemanager.resource-tracker.client.thread-count</name>
    <value>50</value>
  </property>
  <property>
    <name>yarn.application.classpath</name>
    <value>$HADOOP_CLIENT_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/*</value>
  </property>
  <property>
    <name>yarn.resourcemanager.scheduler.class</name>
    <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value>
  </property>
  <property>
    <name>yarn.scheduler.capacity.resource-calculator</name>
    <value>org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator</value>
  </property>
  <property>
    <name>yarn.resourcemanager.max-completed-applications</name>
    <value>10000</value>
  </property>
  <property>
    <name>yarn.nodemanager.remote-app-log-dir</name>
    <value>/tmp/logs</value>
  </property>
  <property>
    <name>yarn.nodemanager.remote-app-log-dir-suffix</name>
    <value>logs</value>
  </property>



<!-- for tez web ui -->

    <!-- conf timeline server -->
    <property>
        <name>yarn.timeline-service.enabled</name>
    <value>true</value>
   </property>
   <property>
    <name>yarn.timeline-service.hostname</name>
        <value>sbider-dev-01</value>
   </property>
   <property>
        <name>yarn.timeline-service.http-cross-origin.enabled</name>
        <value>true</value>
   </property>
   <property>
        <name> yarn.resourcemanager.system-metrics-publisher.enabled</name>
        <value>true</value>
   </property>
   <property>
    <name>yarn.timeline-service.generic-application-history.enabled</name>
    <value>true</value>
   </property>
   <property>
        <description>Address for the Timeline server to start the RPC server.</description>
        <name>yarn.timeline-service.address</name>
        <value>sbider-dev-01:10201</value>
   </property>
   <property>
        <description>The http address of the Timeline service web application.</description>
        <name>yarn.timeline-service.webapp.address</name>
        <value>sbider-dev-01:8188</value>
   </property>
   <property>
        <description>The https address of the Timeline service web application.</description>
        <name>yarn.timeline-service.webapp.https.address</name>
        <value>sbider-dev-01:2191</value>
   </property>
   <property>
        <name>yarn.timeline-service.handler-thread-count</name>
        <value>24</value>
   </property>

</configuration>

我该怎么做才能解决此问题，我想使用tez-ui优化代码。谁能帮我。谢谢

解决方法

暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！

如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@）

apache-tez

相关问答

matplotlib报错：AttributeError: module 'backend_interagg' has no attribute 'FigureCanvas'. Did you mean: 'FigureCanvasAgg'?
使用本地python环境可以成功执行 import pandas as pd impor...
gitlab登录失败，报错：This challenge page was accidentally cached by an intermediary and is no longer available.
设置时间 控制面板
后端开发常见错误
错误1：Request method ‘DELETE‘ not supported 错误还原：...
docker常见错误
错误1：启动docker镜像时报错：Error response from daemon:...
idea常见错误
错误1：private field ‘xxx‘ is never assigned 按Alt...
pip安装依赖失败
报错如下，通过源不能下载，最后警告pip需升级版本 Requirem...