Contents

Overview

Test Informant is a tool designed to report on the state of tests at Mozilla. For each test suite and platform combination, it can display the total number of tests being run, as well as the total number of tests that are skipped or disabled. It can also show how many tests have been added/enabled or removed/disabled over a given period of time.

The goal of Test Informant is to provide a higher level of visibility into the current state of our tests. When someone asks questions like "How many reftests are we running on linux64 debug builds?" or "What percentage of mochitests are skipped on android?" we should be able to answer them by directing them towards a Test Informant report.

Implementation

Test informant uses ActiveData to query which tests have run on the given branch on the given days. It then uses the data to generate an HTML formatted report. The entire tool is written in JS and is executed on the client side, anyone can host and use a static copy of test-informant. It uses JQuery, bootstrap and handlebars to format the reports.

Submitting Changes

The preferred way of contributing code to Test Informant is via github pull requests. If you are unfamiliar with pull requests, please read the official documentation. Once you have created a pull request, you'll need to ask for review in the bug you are currently working on. To do this:

Create a new attachment in the bug by clicking 'Add an attachment'.

Click 'paste text as an attachment'.

Copy the link to the github pull request into the text box.

Fill out the description, reviewer and comment as normal and submit.

Bugzilla will automatically detect that a pull request was pasted and create a link to it for you. Once you have an r+, you may need to remind the reviewer to merge your pull request for you!