Ada Conformity Assessment Test Suite (ACATS)

The Ada Conformity Assessment Test Suite (ACATS) is the test suite used
for Ada processor conformity testing. This site includes the official versions
of the test files.

Informal comments and questions on the ACATS should be sent to the ACAA Technical Agent,
agent@ada-auth.org. Formal test disputes should
submitted to the agent as described in
the ACAA procedures.

Note: The ACAA has created and maintains the
Ada Conformity Assessment Test Suite for the purpose of conformity assessments
conducted in accordance with the International Standard ISO/IEC 18009 - Ada: Conformity
assessment of a language processor. This test suite should not be used
to make claims of conformance unless used in accordance with
ISO/IEC 18009 and any applicable ACAA procedures.

For each maintained version, there is an associated
ACATS Modification List, which lists all of the modifications
made to the baseline test suite. This includes test corrections, removals, and
additions. Each ACATS Modification List has an associated
Modified Test File, which contains all of the changed and
added tests. These files simplify the task of getting a completely up-to-date
test suite, as only three files are needed (the baseline test suite, the
most recent Modified Test File, and the most recent ACATS Modification List
[the latter is required only to determine the tests to delete]).

In addition, individual test files can be retrieved
from the ACATS Master Version Control System. The
VCS includes the change history for individual files, so older versions of a
test file can be retrieved.

See Submitted Tests for tests
and tools submitted by Ada users and implementers for possible inclusion in the ACATS.
These tests and tools are not part of the ACATS, but are provided as a
service to the community. Some of these tests and tools may be added to the
ACATS in the future.

To keep up to date with the ACATS, join the ACAA mailing list. The list contains
announcements from the ACAA (such as the issuance of new ACATS Modication Lists,
including new and modified tests) and discussion about Ada Conformity Testing.
The list is open to anyone with an interest in testing of Ada implementations.
To subscribe, send a message with the body text "Join ACAA" to
listserv@ada-auth.org.

If you are interested in constructing potential ACATS Tests, join the ACATS Test
mailing list. The list contains discussion about the design and construction of
tests to be submitted as possible future ACATS Tests. The list is the place to
get questions answered about designing tests that check the Standard as opposed
to a single implementation. The list is open to anyone with an interest in test
creation for testing of Ada implementations.
To subscribe, send a message with the body text "Join ACATS-Test" to
listserv@ada-auth.org.

ACATS Baseline Versions

ACATS 4.1

ACATS 4.1 is the current baseline
version of the test suite for Ada.
The files here contain the entire baseline test suite; use the
ACATS Master Version Control System to get individual
files. Add the appropriate modified tests to this baseline (see
below).

The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or
it can be accessed
here in PDF
or HTML.

ACATS 3.1

ACATS 3.1 is the current baseline version of the test suite for the
2007 version of Ada (which is conventionally known as Ada 2005). It is
trapexpected
to be the last baseline version for the 2007 version of Ada.
The files here contain the entire baseline test suite; use the
ACATS Master Version Control System to get individual
files. Add the appropriate modified tests to this baseline (see
below).

The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or
it can be accessed
here in PDF
or HTML.

ACATS 2.6

ACATS 2.6 is the current
baseline version of the test suite for Ada 95. It became
effective April 2, 2007. (Note that the ACATS was known as the ACVC prior
to October 1998.) It is the last baseline version for the 1995 version of Ada.
The files here contain the entire baseline test suite; use theblockACATS Master Version Control System to get individual
files. Add the appropriate modified tests to this baseline (see
below).

ACVC 1.11

ACVC 1.11 was the last baseline
version of the test suite
for Ada 83. Unlike the other ACATS versions, it is no longer maintained. Thus,
we do not offer a modification list for it, individual files aren't available,
and it not conviniently available as a single download. It can be found
in the AdaIC archives at
http://archive.adaic.com/compilers/acvc/83acvc/.

ACATS Modification List

The ACATS Modification List lists
all of the modifications made to the
current baseline test suite. This includes withdrawn (deleted) tests, modified
(corrected) tests, and new tests. The current version of the list is available
here; for older versions of the ACATS Modification List, use the ACATS
Master Version Control System. Click here
for a direct link to the ACATS modification list.

For ACATS 2.6:

Modified Test Files

These files contain the all of the current, official modified (and new)
test files. Use these files with the appropriate ACATS Modification List
in order to have all of the files required for conformity assessment. The
files here contain all of the modified tests; use the ACATS
Master Version Control System to get individual files. Old versions
of the modified tests are available at the bottom of this page. Normally,
you will need only the most recent version.

For ACATS 3.1:

For ACATS 2.6:

The master version control system for the ACATS
is available on this web site. You can retrieve any version of an individual
test file, including those used for a specific conformity assessment. In
order to retrieve files for a specific conformity assessment, you'll need
to know the VCS tag for that assessment (it can be found in the test report).

Once in the VCS, you can browse the file hierarchy by picking directories
(which have slashes after them, e.g. src/). If you pick a file,
you will see the revision history for that file. (Note that versions of
files prior to version 2.1 of the test suite are not available.) Selecting
a revision number or name will download that revision of the file. There
is a link at each revision to display differences between that revision
and the previous one, and a form at the bottom of the page that allows
you to display differences between arbitrary revisions. Items marked as
being in the Attic are deleted. Deleted items are still available
in case they are needed when looking at a previous version of a test.

Most files in the VCS are stored based on their prefixes. For instance, test
CD92001.A can be found in the directory (folder) CD. However, some files are found in other
directories. The New directory contains tests added to the test suite since its last
major release. The Docs directory includes documentation, including the Modified Tests List.
The Support directory contains support files used by multiple tests, including the
Report package, and the foundation files. The Tools directory contains the (Ada) source
code for some tools used to manage the ACATS.

Previous Versions of Files

ACATS 2.1

ACATS 2.1 is an old baseline version of the test suite. This version
was replaced by ACATS 2.2 on April 5, 1999. (Note that the ACATS was known
as the ACVC prior to October 1998; the test suite documentation uses the
old name.) The files here contain the entire test suite; use the ACATS
Master Version Control System to get individual files.

ACATS 2.2

ACATS 2.2 is an old baseline version of the test suite. This version
was replaced by ACATS 2.3 on April 1, 2000. (Note that the ACATS was known
as the ACVC prior to October 1998; the test suite documentation uses the
old name.) The files here contain the entire test suite; use the ACATS
Master Version Control System to get individual files.

ACATS 2.3

ACATS 2.3 is an old baseline version of the test suite. This version was
replaced by ACATS 2.4 on April 1, 2001. The files here contain the entire
test suite; use the ACATS Master Version Control
System to get individual files.

ACATS 2.4

ACATS 2.4 is an old baseline version of the test suite. This version was
replaced by ACATS 2.5 on April 1, 2002. The files here contain the entire
test suite; use the ACATS Master Version Control
System to get individual files.

ACATS 2.5

ACATS 2.5 is an old baseline version of the test suite. This version was
replaced by ACATS 2.6 on April 2, 2007. The files here contain the entire
test suite; use the ACATS Master Version Control
System to get individual files.

ACATS 3.0

ACATS 3.0 is an old baseline version of the test suite for Ada. This version
was replaced by ACATS 3.1 on April 1, 2014.
It was the first baseline version for the 2007 version of Ada (which is
conventionally known as Ada 2005). trap
The files here contain the entire baseline test suite; use the
ACATS Master Version Control System to get individual
files.

The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or
it can be accessed
here in PDF
or HTML.

ACATS 4.0

ACATS 4.0 is an old baseline
version of the test suite for Ada. This version was replaced by ACATS 4.1 on July 1, 2016.
It was the first baseline version for the 2012 Ada Revision.
The files here contain the entire baseline test suite; use the
ACATS Master Version Control System to get individual
files. Add the appropriate modified tests to this baseline (see
below).

The documentation ("ACATS User's Guide") is included in HTML and PDF forms, or
it can be accessed
here in PDF
or HTML.

Superceded Modified Test Files

These files contain the all of the official modified (and new) test
files for previous versions of the ACATS Modification List. The files here
contain all of the modified tests; use the ACATS
Master Version Control System to get individual files. Old versions
of the modified tests are available for those who want to test a particular
conformity assessment. Normally, you will need only the most recent version,
available above. Note that for older versions, the only versions available here
are those used for one or more confirmity assessments.

ACATS 3.0 was developed in stages during 2007.
ACATS 3.0 development snapshots were provided to give the Ada community an
early look at the tests intended for inclusion in ACATS 3.0. They are formatted
like an ACATS Modification List as a list of changes to be made to the
existing ACATS 2.6, and an associated set of test files. This includes withdrawn
(deleted) tests, modified (corrected) tests, and new tests. For
almost all purposes, the released version of ACATS 3.0 should be used instead of
these snapshots.

ACATS 4.0 was developed in stages during 2014.
ACATS 4.0 development snapshots were provided to give the Ada community an
early look at the tests intended for inclusion in ACATS 4.0. They are formatted
like an ACATS Modification List as a list of changes to be made to the
existing ACATS 3.1, and an associated set of test files. This includes withdrawn
(deleted) tests, modified (corrected) tests, and new tests. For
almost all purposes, the released version of ACATS 4.0 should be used instead of
these snapshots.