So, what would you recommend in terms of getting a working HbaseTestingUtility or just unit testing in general? It's pretty much a prerequisite for me to be able to introduce HBase into production. We have a strict continuous integration process and I need to be able to build software for use with our Hbase cluster in our CI environment including running all tests. Our CI environment does not have its own test cluster and the chances of that becoming the case are slim. Besides the relative convenience of the testing utility is great.

> Here is one way of figuring out whether hdfs experiences the same issue is the following:> > check out http://svn.apache.org/repos/asf/hadoop/common/branches/branch-1> use the command to find out which tests create MiniDFSCluster: find . -name '*.java' -exec grep 'new MiniDFSCluster(' {} \; -print> run one of the tests: ant test-core -Dtestcase=TestCopyCommitter> > See if there is similar exception.> > On my Mac, I got:> > [junit] Running org.apache.hadoop.tools.distcp2.mapred.TestCopyCommitter> [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 12.283 sec> > On Sun, Jul 14, 2013 at 9:58 AM, David Williams <[EMAIL PROTECTED]> wrote:> Hi Ted,> > I'd be interested to know more about an hdfs issue. I was go to look further into the line of reasoning you mentioned about the call to getAddress. > > MiniDFSCluster.java, line 426:> String ipAddr = dn.getSelfAddr().getAddress().getHostAddress();> > So that one of getSelfAddr or getAddress returned NULL. Is there something new about hdfs or are the two related?> > > > > > On Jul 13, 2013, at 9:41 PM, Ted Yu wrote:> >> Most likely this is an hdfs issue.>> >> On Sat, Jul 13, 2013 at 4:08 PM, David Williams <[EMAIL PROTECTED]> wrote:>> Hi Ted,>> >> I updated the dependencies and ran the tests again, and on my Mac OSX they pass and on CentOS I get the same error:>> >> >> $ lein test>> Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9.pom from central>> Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9.jar from central>> Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9-tests.jar from central>> >> lein test hbase.config-test>> >> lein test hbase.table-test>> Starting DataNode 0 with dfs.data.dir: /home/dwilliams/Desktop/Repos/hbase/target/test-data/1140edc6-7242-40cd-8ed8-05847fb14949/dfscluster_1e40ce89-1986-450b-ba6d-983caa9aeb78/dfs/data/data1,/home/dwilliams/Desktop/Repos/hbase/target/test-data/1140edc6-7242-40cd-8ed8-05847fb14949/dfscluster_1e40ce89-1986-450b-ba6d-983caa9aeb78/dfs/data/data2>> >> lein test :only hbase.table-test/create-table>> >> >> ERROR in (create-table) (MiniDFSCluster.java:426)>> Uncaught exception, not in assertion.>> expected: nil>> actual: java.lang.NullPointerException: null>> at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes (MiniDFSCluster.java:426)>> org.apache.hadoop.hdfs.MiniDFSCluster.<init> (MiniDFSCluster.java:284)

> Hi Ted,>> So, what would you recommend in terms of getting a working> HbaseTestingUtility or just unit testing in general? It's pretty much a> prerequisite for me to be able to introduce HBase into production. We have> a strict continuous integration process and I need to be able to build> software for use with our Hbase cluster in our CI environment including> running all tests. Our CI environment does not have its own test cluster> and the chances of that becoming the case are slim. Besides the relative> convenience of the testing utility is great.>> > check out> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-1>> I don't know anything about the hadoop source, this branch, or what is> needed to run their JUnit tests. This is pretty much a non starter for me.>> > On my Mac, I got:> > [junit] Running org.apache.hadoop.tools.distcp2.mapred.TestCopyCommitter> > [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 12.283 sec>> Recall that this is not an issue on Mac OSX for some odd reason, only on> CentOS and Linux VM's such as in use by travis-ci. You can see the failed> build output here:>> https://travis-ci.org/mobiusinversion/hbase>> Recall also that I opened a travis-ci ticket and the travis support was> able to reproduce success on Mac OSX and failure on Linux.>> https://github.com/travis-ci/travis-ci/issues/1240>> I started a bounty on SO:>>> http://stackoverflow.com/questions/17625938/hbase-minidfscluster-java-fails-in-certain-environments>>> St.Ack - what do you think the relative priority of this issue might be?>>>>>>>> On Jul 14, 2013, at 10:47 AM, Ted Yu wrote:>> Here is one way of figuring out whether hdfs experiences the same issue is> the following:>> check out http://svn.apache.org/repos/asf/hadoop/common/branches/branch-1> use the command to find out which tests create MiniDFSCluster: find .> -name '*.java' -exec grep 'new MiniDFSCluster(' {} \; -print> run one of the tests: ant test-core -Dtestcase=TestCopyCommitter>> See if there is similar exception.>> On my Mac, I got:>> [junit] Running> org.apache.hadoop.tools.distcp2.mapred.TestCopyCommitter> [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 12.283 sec>> On Sun, Jul 14, 2013 at 9:58 AM, David Williams <[EMAIL PROTECTED]> > wrote:>>> Hi Ted,>>>> I'd be interested to know more about an hdfs issue. I was go to look>> further into the line of reasoning you mentioned about the call>> to getAddress.>>>> MiniDFSCluster.java, line 426:>> String ipAddr = dn.getSelfAddr().getAddress().getHostAddress();>>>> So that one of getSelfAddr or getAddress returned NULL. Is there>> something new about hdfs or are the two related?>>>>>>>>>>>> On Jul 13, 2013, at 9:41 PM, Ted Yu wrote:>>>> Most likely this is an hdfs issue.>>>> On Sat, Jul 13, 2013 at 4:08 PM, David Williams <>> [EMAIL PROTECTED]> wrote:>>>>> Hi Ted,>>>>>> I updated the dependencies and ran the tests again, and on my Mac OSX>>> they pass and on CentOS I get the same error:>>>>>>>>> $ lein test>>> Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9.pom from central>>> Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9.jar from central>>> Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9-tests.jar from>>> central>>>>>> lein test hbase.config-test>>>>>> lein test hbase.table-test>>> Starting DataNode 0 with dfs.data.dir:>>> /home/dwilliams/Desktop/Repos/hbase/target/test-data/1140edc6-7242-40cd-8ed8-05847fb14949/dfscluster_1e40ce89-1986-450b-ba6d-983caa9aeb78/dfs/data/data1,/home/dwilliams/Desktop/Repos/hbase/target/test-data/1140edc6-7242-40cd-8ed8-05847fb14949/dfscluster_1e40ce89-1986-450b-ba6d-983caa9aeb78/dfs/data/data2

> I would be busy today so expect delay in future response.> > bq. Recall that this is not an issue on Mac OSX for some odd reason> > I didn't reproduce the issue you mentioned on either OSX or Linux.> > Maybe people who use CentOS for ci can comment on this matter.> > Cheers> > On Mon, Jul 15, 2013 at 8:01 AM, David Williams <[EMAIL PROTECTED]> wrote:> Hi Ted,> > So, what would you recommend in terms of getting a working HbaseTestingUtility or just unit testing in general? It's pretty much a prerequisite for me to be able to introduce HBase into production. We have a strict continuous integration process and I need to be able to build software for use with our Hbase cluster in our CI environment including running all tests. Our CI environment does not have its own test cluster and the chances of that becoming the case are slim. Besides the relative convenience of the testing utility is great. > > > check out http://svn.apache.org/repos/asf/hadoop/common/branches/branch-1> > I don't know anything about the hadoop source, this branch, or what is needed to run their JUnit tests. This is pretty much a non starter for me.> > > On my Mac, I got:> > [junit] Running org.apache.hadoop.tools.distcp2.mapred.TestCopyCommitter> > [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 12.283 sec> > Recall that this is not an issue on Mac OSX for some odd reason, only on CentOS and Linux VM's such as in use by travis-ci. You can see the failed build output here:> > https://travis-ci.org/mobiusinversion/hbase> > Recall also that I opened a travis-ci ticket and the travis support was able to reproduce success on Mac OSX and failure on Linux.> > https://github.com/travis-ci/travis-ci/issues/1240> > I started a bounty on SO:> > http://stackoverflow.com/questions/17625938/hbase-minidfscluster-java-fails-in-certain-environments> > > St.Ack - what do you think the relative priority of this issue might be? > > > > > > > > On Jul 14, 2013, at 10:47 AM, Ted Yu wrote:> >> Here is one way of figuring out whether hdfs experiences the same issue is the following:>> >> check out http://svn.apache.org/repos/asf/hadoop/common/branches/branch-1>> use the command to find out which tests create MiniDFSCluster: find . -name '*.java' -exec grep 'new MiniDFSCluster(' {} \; -print>> run one of the tests: ant test-core -Dtestcase=TestCopyCommitter>> >> See if there is similar exception.>> >> On my Mac, I got:>> >> [junit] Running org.apache.hadoop.tools.distcp2.mapred.TestCopyCommitter>> [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 12.283 sec>> >> On Sun, Jul 14, 2013 at 9:58 AM, David Williams <[EMAIL PROTECTED]> wrote:>> Hi Ted,>> >> I'd be interested to know more about an hdfs issue. I was go to look further into the line of reasoning you mentioned about the call to getAddress. >> >> MiniDFSCluster.java, line 426:>> String ipAddr = dn.getSelfAddr().getAddress().getHostAddress();>> >> So that one of getSelfAddr or getAddress returned NULL. Is there something new about hdfs or are the two related?>> >> >> >> >> >> On Jul 13, 2013, at 9:41 PM, Ted Yu wrote:>> >>> Most likely this is an hdfs issue.>>> >>> On Sat, Jul 13, 2013 at 4:08 PM, David Williams <[EMAIL PROTECTED]> wrote:

I can't say for certain given the test output (would need to see the logsgenerated by the datanodes), but there is a common issue running minicluster unit tests if the environment's umask is not set to 022. This isdue to https://issues.apache.org/jira/browse/HDFS-2556 where the minicluster DNs fail fast if the dfs.data.dir permissions do not match what isexpected.

We ran into this issue setting up builds or our hRaven project (which usesHBaseTestingUtility) with Travis CI. Modifying our .travis.yml file byadding the following line fixed the problem:

> I doubt this has anything todo specifically with CentOS etc. I am not> privy to your setup up but the steps to reproduce are easy.>> 1. Get a linux distro such as CentOS. Put it say, in a VM such as> Vmware Fusion on Mac.> 2. Install Java> 3. Try to start a mini cluster (will fail)>> The bottom line is there is an uncaught null pointer exception in the> Testing Utility. Is this considered to be of little priority?>> > Here is Linux OS:>> > Linux a.net 2.6.32-220.23.1.el6.YAHOO.20120713.x86_64 #1 SMP Fri Jul 13> 11:40:51 CDT 2012 x86_64 x86_64 x86_64 GNU/Linux>> Ted, what linux distribution is that?>>>>>> On Jul 15, 2013, at 9:49 AM, Ted Yu <[EMAIL PROTECTED]> wrote:>> > I would be busy today so expect delay in future response.> >> > bq. Recall that this is not an issue on Mac OSX for some odd reason> >> > I didn't reproduce the issue you mentioned on either OSX or Linux.> >> > Maybe people who use CentOS for ci can comment on this matter.> >> > Cheers> >> > On Mon, Jul 15, 2013 at 8:01 AM, David Williams <> [EMAIL PROTECTED]> wrote:> > Hi Ted,> >> > So, what would you recommend in terms of getting a working> HbaseTestingUtility or just unit testing in general? It's pretty much a> prerequisite for me to be able to introduce HBase into production. We have> a strict continuous integration process and I need to be able to build> software for use with our Hbase cluster in our CI environment including> running all tests. Our CI environment does not have its own test cluster> and the chances of that becoming the case are slim. Besides the relative> convenience of the testing utility is great.> >> > > check out> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-1> >> > I don't know anything about the hadoop source, this branch, or what is> needed to run their JUnit tests. This is pretty much a non starter for me.> >> > > On my Mac, I got:> > > [junit] Running> org.apache.hadoop.tools.distcp2.mapred.TestCopyCommitter> > > [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 12.283 sec> >> > Recall that this is not an issue on Mac OSX for some odd reason, only on> CentOS and Linux VM's such as in use by travis-ci. You can see the failed> build output here:> >> > https://travis-ci.org/mobiusinversion/hbase> >> > Recall also that I opened a travis-ci ticket and the travis support was> able to reproduce success on Mac OSX and failure on Linux.> >> > https://github.com/travis-ci/travis-ci/issues/1240> >> > I started a bounty on SO:> >> >> http://stackoverflow.com/questions/17625938/hbase-minidfscluster-java-fails-in-certain-environments> >> >> > St.Ack - what do you think the relative priority of this issue might be?> >> >> >> >> >> >> >> > On Jul 14, 2013, at 10:47 AM, Ted Yu wrote:> >> >> Here is one way of figuring out whether hdfs experiences the same issue> is the following:> >>> >> check out> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-1> >> use the command to find out which tests create MiniDFSCluster: find .> -name '*.java' -exec grep 'new MiniDFSCluster(' {} \; -print> >> run one of the tests: ant test-core -Dtestcase=TestCopyCommitter

+

Gary Helmling 2013-07-15, 17:25

NEW: Monitor These Apps!

All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by Sematext