Phase 1. Download the Test Suite

The test cases are organized by database.
Each database has its own folder. The folder's name includes a code (e.g., D001) and description of the database (e.g., D000-1table0rows).
Within each folder we have:

a manifest.ttl file that contains a description of the database, direct graph, r2rml mappings, and outputs.

a create.sql file that contains the sql script for the creation of the database.

a directGraph.nt that contains the direct mapping for the given database.

one or more r2rml.ttl files that include the r2rml mappings for the database.

one or more mapped.nq files that contain the resultant graph for the corresponding r2rml.ttl file.

Phase 2. Run the engine over the TS

Once the implementors have the TS, it is time to run the engine over the test cases.

R2RML

R2RML implementors should scan all the directories included in the TS and do the following for each one of them:

load the sql script (create.sql) in the given DBMS.

load the r2rml mapping (r2rml.ttl) file.

execute the r2rml mapping over the database loaded.

generate the output RDF dataset and include the content in N-quads format in the mapped-<yourtoolname>.nq, for example, mapped-d2r.nq

DM

DM implementors should do the following:

load the sql script (create.sql) in the given DBMS

generate the direct mapping for the database and include the output in TURTLE format in directGraph-<your-tool-name>.ttl, for example directGraph-morph.ttl

Phase 3. Download the Test Harness software

The Working Group is developing a Test Harness (TH) that allows comparison of test results from a given implementation against the official test results.
The TH software is available here.

Phase 4. Run the TH software against your Test Results

After you have downloaded the TH software, you have to do the following

Unzip it to the local file system.

Modify the ts.ttl file, including the description of your tool, developer , the dbms used in the tests, and the location where the Test Suite with test results are stored, for example