环境:Ubuntu 14.04、hadoop-2.2.0、hbase-0.98.7

当我启动 hadoop 和 hbase(单节点模式)时，都成功(我还检查了网站 8088 的 hadoop，60010 的 hbase)

jps
4507 SecondaryNameNode
5350 HRegionServer
4197 NameNode
4795 NodeManager
3948 QuorumPeerMain
5209 HMaster
4678 ResourceManager
5831 Jps
4310 DataNode

但是查看hbase-hadoop-master-localhost.log时，发现如下信息

    2014-10-23 14:16:11,392 INFO  [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2014-10-23 14:16:11,426 INFO  [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session

我在谷歌上搜索了很多关于那个未知错误问题的网站，但我无法解决这个问题... 以下是我的hadoop和hbase配置

哈多普:

保存内容:localhost

核心站点.xml

<configuration>
    <property>
         <name>fs.defaultFS</name>
         <value>hdfs://localhost:8020</value>
     </property>
</configuration>

yarn-site.xml

<configuration>
  <property>
    <name>yarn.resourcemanager.resource-tracker.address</name>
    <value>localhost:9001</value>
    <description>host is the hostname of the resource manager and 
    port is the port on which the NodeManagers contact the Resource Manager.
    </description>
  </property>

  <property>
    <name>yarn.resourcemanager.scheduler.address</name>
    <value>localhost:9002</value>
    <description>host is the hostname of the resourcemanager and port is the port
    on which the Applications in the cluster talk to the Resource Manager.
    </description>
  </property>

  <property>
    <name>yarn.resourcemanager.scheduler.class</name>
    <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler</value>
    <description>In case you do not want to use the default scheduler</description>
  </property>

  <property>
    <name>yarn.resourcemanager.address</name>
    <value>localhost:9003</value>
    <description>the host is the hostname of the ResourceManager and the port is the port on
    which the clients can talk to the Resource Manager. </description>
  </property>

  <property>
    <name>yarn.nodemanager.local-dirs</name>
    <value></value>
    <description>the local directories used by the nodemanager</description>
  </property>

  <property>
    <name>yarn.nodemanager.address</name>
    <value>localhost:9004</value>
    <description>the nodemanagers bind to this port</description>
  </property>  

  <property>
    <name>yarn.nodemanager.resource.memory-mb</name>
    <value>10240</value>
    <description>the amount of memory on the NodeManager in GB</description>
  </property>

  <property>
    <name>yarn.nodemanager.remote-app-log-dir</name>
    <value>/app-logs</value>
    <description>directory on hdfs where the application logs are moved to </description>
  </property>

   <property>
    <name>yarn.nodemanager.log-dirs</name>
    <value></value>
    <description>the directories used by Nodemanagers as log directories</description>
  </property>

  <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
    <description>shuffle service that needs to be set for Map Reduce to run </description>
  </property>
</configuration>

数据库:

hbase-env.sh :

..
export JAVA_HOME="/usr/lib/jvm/java-7-oracle"
..
export HBASE_MANAGES_ZK=true
..

hbase-site.xml

<configuration>
    <property>
        <name>hbase.rootdir</name>
        <value>hdfs://localhost:8020/hbase</value>
    </property>
    <property> 
        <name>hbase.cluster.distributed</name> 
        <value>true</value> 
    </property> 
    <property>
        <name>hbase.zookeeper.property.clientPort</name>
        <value>2181</value> 
    </property>
</configuration>  

区域服务器内容:本地主机

我的/etc/hosts 内容:

127.0.0.1       localhost
#127.0.1.1      localhost

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters

我尝试了很多方法来解决，但都失败了，请帮我解决一下，我真的很需要知道如何解决。

最初，我运行一个 mapreuce 程序，当 map 67% 减少 0% 时，它打印出一些信息，一些信息如下:

14/10/23 15:50:41 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=60000 watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@ce1472
14/10/23 15:50:41 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
14/10/23 15:50:41 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
14/10/23 15:50:41 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x1493be510380007, negotiated timeout = 40000
14/10/23 15:50:43 INFO mapred.LocalJobRunner: map > sort
14/10/23 15:50:46 INFO mapred.LocalJobRunner: map > sort

然后它崩溃了。我认为程序可能死锁了，这就是我想解决上面的 zookeeper 问题。

如果需要我在 hadoop 或 hbase 或其他人中设置的另一个配置文件，请告诉我，我会发布。 谢谢!

最佳答案

我不认为 zookeeper 是你的问题。您应该查看其他日志以获取有关您的 map/reduce 作业状态的更多信息。通过 yarn job tracker ui 检查 datanode 和 namenode 日志是否有错误以及 yarn 日志消息。

ZooKeeper 消息

这些消息来自尝试与 Zookeeper sasl 客户端连接的 zookeeper。如果未配置 sasl，客户端仍将能够连接，但不会对连接进行身份验证。

错误信息来自这个文件 ZooKeeperSaslClient.java

150                 // The user did not override the default context. It might be that they just don't intend to use SASL,
151                 // so log at INFO, not WARN, since they don't expect any SASL-related information.
152                 String msg = "Will not attempt to authenticate using SASL ";
153                 if (runtimeException != null) {
154                     msg += "(" + runtimeException + ")";
155                 } else {
156                     msg += "(unknown error)";
157                 }
158                 this.configStatus = msg;
159                 this.isSASLConfigured = false;
160             }

如果你想摆脱这个错误，你必须配置 zookeeper 来使用 sasl。抱歉，没有任何为 zookeeper 配置 sasl 的经验。

ZooKeeper SASL Configuration

关于hadoop - Hbase连接关于zookeeper报错，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/26522513/