我有一个带有 hbase 数据库的新 Java EE 应用程序。 我想创建集成测试，我使用 HBaseTestingUtility 类 (startMiniCluster)。

我在 Windows (Eclipse) 上工作，但出现此错误:

java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.setWriteChecksum

我的 pom.xml :

  <properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
    <hadoop.version>1.2.1</hadoop.version>
    <hadoop.common.version>2.5.1</hadoop.common.version>
    <hbase.version>1.0.0</hbase.version>
  </properties>

  <dependencies>
    <dependency>
        <groupId>junit</groupId>
        <artifactId>junit</artifactId>
        <version>4.11</version>
        <scope>test</scope>
    </dependency> 

    <!-- Hadoop dependencies -->
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-core</artifactId>
        <version>${hadoop.version}</version>     
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-test</artifactId>
        <version>${hadoop.version}</version>
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-common</artifactId>
        <version>${hadoop.common.version}</version>
        <exclusions>
            <exclusion>
                <artifactId>hadoop-annotations</artifactId>
                <groupId>org.apache.hadoop</groupId>
            </exclusion>
        </exclusions>
    </dependency>
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-hdfs</artifactId>
        <version>${hadoop.common.version}</version>
    </dependency>

    <!-- HBase dependencies -->
    <dependency>
        <groupId>org.apache.hbase</groupId>
        <artifactId>hbase-testing-util</artifactId>
        <version>${hbase.version}</version>
        <exclusions>
            <exclusion>
                <artifactId>hbase-annotations</artifactId>
                <groupId>org.apache.hbase</groupId>
            </exclusion>
        </exclusions>
    </dependency>
  </dependencies>

我检查了 hadoop-core jar (1.2.1)，setWriteChecksum 不存在。 你能帮助我吗 ？谢谢。

编辑: 随着依赖项更新:

java.net.ConnectException: Connection refused: no further information
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:712)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2015-04-01 09:17:56,834 WARN  [RecoverableZooKeeper :: retryOrThrow] Possibly transient ZooKeeper, quorum=127.0.0.1:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase-unsecure/hbaseid
2015-04-01 09:17:56,835 INFO  [RetryCounter :: sleepUntilNextRetry] Sleeping 1000ms before retry #0...
2015-04-01 09:17:57,817 INFO  [ClientCnxn$SendThread :: logStartConnect] Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2015-04-01 09:17:58,818 WARN  [ClientCnxn$SendThread :: run] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect

问题是我不知道 HBaseTestingUtility() 是否适用于 Windows... 谢谢。

最佳答案

您为 hadoop-core 使用了错误版本的 Hadoop。查看 HBase 项目 HBase Book ，向下滚动到 Section 4.1 - Hadoop，您将在其中找到兼容性矩阵。如果您使用的是 HBase 1.0.0，我建议您像在 POM 顶部那样使用 Hadoop 2.5.1。 Hadoop 现在使用 test-jar 类型及其依赖项，因此我不得不自己进行一些挖掘。

您的属性将如下所示:

<properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
    <hadoop.version>2.5.1</hadoop.version>
    <hbase.version>1.0.0</hbase.version>
</properties>

你的依赖应该是这样的:

<dependencies>
    <dependency>
        <groupId>junit</groupId>
        <artifactId>junit</artifactId>
        <version>4.11</version>
        <scope>test</scope>
    </dependency>

    <dependency>
        <groupId>org.apache.hbase</groupId>
        <artifactId>hbase-server</artifactId>
        <version>${hbase.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.hbase</groupId>
        <artifactId>hbase-server</artifactId>
        <version>${hbase.version}</version>
        <type>test-jar</type>
    </dependency>

    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-hdfs</artifactId>
        <version>${hadoop.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-hdfs</artifactId>
        <type>test-jar</type>
        <version>${hadoop.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.hbase</groupId>
        <artifactId>hbase-hadoop-compat</artifactId>
        <type>test-jar</type>
        <version>${hbase.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.hbase</groupId>
        <artifactId>hbase-hadoop2-compat</artifactId>
        <type>test-jar</type>
        <version>${hbase.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-common</artifactId>
        <type>test-jar</type>
        <version>${hadoop.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-common</artifactId>
        <version>${hadoop.version}</version>
        <exclusions>
            <exclusion>
                <artifactId>hadoop-annotations</artifactId>
                <groupId>org.apache.hadoop</groupId>
            </exclusion>
        </exclusions>
    </dependency>
</dependencies>`

关于java - Windows 上的 Hbase 集成测试，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/29311754/