Objective

This how-to will focus on creating a testcase making use of the Openbravo test base classes. The testcase will check that our system has at least one User with password. For this, we'll use the new DAL approach to access the database.

In computer programming, unit testing is a software design and development method where the programmer gains confidence that individual units of source code are fit for use. A unit is the smallest testable part of an application. In procedural programming a unit may be an individual program, function, procedure, etc., while in object-oriented programming, the smallest unit is a method, which may belong to a base/super class, abstract class or derived/child class.[1]

Preparing development environment

First of all you need to import src-test components of the Openbravo ERP. Follow the instructions described below.

Import into Eclipse IDE

Launch Eclipse.

After Eclipse has started go to Project menu and disableBuild Automatically option there.

Now one new project need to be imported in the workspace (by menu File=>Import and then General=>Existing Projects into Workspace). Here they are:

OpenbravoTest XXX\opensource\openbravo\erp\devel\main\src-test

Now, you are ready to work with test cases.

Creating the testcase

Just before starting

Test cases in OpenbravoTest

OpenbravoTest provides a set of unit tests, often called 'test cases' for things such as: runtime model consistency, data access layer features, webservices features, etc. This test cases are based on JUnit testing framework.

The set of tests you can find and study them in the project OpenbravoTest:

Inheriting from OB BaseTest

All the core testcases are subclasses from OBBaseTest (org.openbravo.test.base.OBBaseTest). This class handles all the necessary steps to initialize the Data Access Layer, takes care of transaction handling and provides a set of utilities (methods) for working with the Openbravo context (OBContext).

Execution order of test methods

Until now, the methods were simply invoked in the order returned by the reflection API. However, using the JVM order is unwise since the Java platform does not specify any particular order, and in fact JDK 7 returns a more or less random order. Of course, well-written test code would not assume any order, but some does, and a predictable failure is better than a random failure on certain platforms.

Creating the Java class

Open your Eclipse IDE.

Create a new folder structure under the modules folder: modules/org.openbravo.test.examples/src-test/org/openbravo/test/examples.

Add the newly created src-test folder to the Java sources on the project.

Create a new Java class on the org.openbravo.test.examples package with the following content:

Transaction Handling

A question which might pop-up when looking at the above code: where is the database transaction handling done? The answer is that this is handled by the OBBaseTest class and the Openbravo data access layer:

a transaction is automatically started at first database access in the test cases. This is done by the Data Access Layer.

a transaction is either committed (when no exception happened) or rolled-back (when an exception happened).

The OBBaseTest class detects automatically if an exception happened or not.

There are certainly cases whereby it makes sense to have more control over the database transactions. There are a number of relevant methods which can be useful then:

OBBaseTest.commitTransaction: a convenience method which commits the transaction for you. This can be useful if you want to check if certain database actions result in exceptions in the database.

OBDal.getInstance().flush(): flushes the update/insert queries in hibernate to the database.

OBDal.getInstance().commitAndClose(): commits the transaction and closes the session. A new session/transaction is automatically started at the next database access.

OBDal.getInstance().rollbackAndClose(): rolls back and closes the transactions. A new session/transaction is automatically started at the next database access.

DAL event observers are not triggered within test cases extending OBBaseTest class. They to work require of test cases extending WeldBaseTest. See this section for more information.

Side-Effect Free

A test case will often change the data in the underlying database. Most of the time it is not feasible to setup a completely new test database for each test run. Therefore test-cases should be developed such that they are side effect free. This means:

When the test-case changes data then it should have a test method which is run as the last test method which cleans up/repairs the data.

This clean-up method should also clean up data which is left from previous test runs.For this common issue should be used @AfterClass notation. This method runs automatically at the end of the class. More info in: AfterClass-Notation.

This last point is important because there can be always reasons why during a test the clean-up step is not performed. For example because the test run is stopped before the clean-up is done.

Approach to new features of JUnit 4.11

Parameterized Tests

Rules

Assertions and Hamcrest 1.13

Hamcrest is a framework for writing matcher objects allowing 'match' rules to be defined declaratively. There are a number of situations where matchers are invaluble, such as UI validation, or data filtering, but it is in the area of writing flexible tests that matchers are most commonly used.

When writing tests it is sometimes difficult to get the balance right between overspecifying the test, and not specifying enough (making the test less valuable). Having a tool that allows you to pick out precisely the aspect under test and describe the values it should have, to a controlled level of precision, helps greatly in writing tests.

Ant Test Tasks

Openbravo has a number of ant tasks which run the test cases:

run.tests: the default, it runs the suite: org.openbravo.test.AntTaskTests. These tests are side effect free and can be run multiple times, after the run the database should be in the same state as before.

run.quick.tests: this task runs test cases which are fast and which test the most important parts of the system. It runs the test suite: org.openbravo.test.AllQuickAntTaskTests.

run.all.tests: runs the suite org.openbravo.test.AllAntTaskTests. This suite contains all the test cases, also tests which can change the database.

All the test cases are based on the Small Bazaar default data.

When adding new test classes to Openbravo ERP the developer has to always add the test class to the AllAntTaskTests test suite and if it is side effect free and quick to the AllQuickAntTaskTests and if it is side effect free but takes a bit more time to the AntTaskTests test suite.

Skipping test cases

It's possible to define a list of test cases to be skipped. This is done by creating a file named disabled-tests in config directory. This file can contain a list of either fully qualified class names to be completely skipped and/or fully qualified class names followed by a "." and method name to skip individual test cases.

The Result

To be able to execute your testcases:

Right click on the ExampleTest class.

Select Run AS > JUnit Test (Eclipse recognizes the class as a JUnit test because inherits from the JUnit OBBaseTest class).

You can check the result of the test case on the JUnit view:

And the output of your tests in the Console view:

Testing Requests

In general unit tests don't require of an Openbravo instance running in Tomcat to be executed. But in some cases, how requests work is wanted to be tested. Depending on the request to be tested, different classes should be extended:

REST Webservices. BaseWSTest should be extended, it deals with authentication and provides methods to execute requests, parse xml results, etc.

Other Requests (such as datasources). BaseDataSourceTestNoDal or BaseDataSourceTestDal classes can be extended (depending if the test case requires or not DAL). Similarly to webservices it provides authentication handling as well as utility methods to perform requests.

Testing CDI

This feature is available since PR15Q4

Default test cases extending org.openbravo.test.base.OBBaseTest class cannot make use of dependency injection. In order to use it org.openbravo.base.weld.test.WeldBaseTest class needs to be extended instead. This is also a subclass of OBBaseTest, so it makes available all DAL infrastructure.

Parameterization

Because CdiInfrastructure class uses org.jboss.arquillian.junit.Arquillian runner, it is not possible to use other runners, which also includes org.junit.runners.Parameterized runner.

This limitation can be workarounded by adding a field annotated as @Rule with org.openbravo.base.weld.test.ParameterCdiTestRule type created with the list of the values for parameters and another field annotated as @ParameterCdiTest which will take those values. In this case each test case will be executed as many times as number of items the parameter list contains each of them the parameter field will take a different item.

In this example test1 test case will be executed 3 times having parameter field "param1", "param2" and "param3" value in each of these executions.

Unlike when using Parameterized.class runner, all these 3 executions are seen as a single execution (Parameterized.class would show 3 independent executions), this causes that if, for example, first execution fails the rest will not be run.

DAL event observers

Because DAL event observers make use of CDI to work, they are not executed in standard test cases extending OBBaseTest.

This limitation does not apply when using WeldBaseTest tests.

Run test located in external module locally

When a test is created in an external module (external of OpenbravoTest project) some problems are found to execute the testcase in Eclipse. See an example of a test located in org.openbravo.client.myob module.

As we can see in the previous picture, it is not possible to execute MyOpenbravoTest.java. The following actions will be done to be able to execute in local your testcase located in other module (external module of OpenbravoTest project):

First of all, OpenbravoTest project should be configured properly. Steps: