GCC 2.95 regression test strategy

Regression Testing

One of the critical steps in making releases is regression testing. For
GCC 2.95 regression tests have been performed against EGCS 1.1.2.

Since it is impossible to test every platform, several popular platforms
were selected for regression testing. The goal is for GCC 2.95 to have zero
regressions relative to EGCS 1.1.2 for gcc, g++, g77, objc, libstdc++,
libio, and libg++.

Regression Testing Status

Platform

build

regressions

libg++ tests

fast-fixinc

alpha-dec-osf4.0

OK

OK

OK

OK

alphaev5-unknown-linux-gnu

OK

OK

OK

N/A

hppa1.1-hp-hpux10.20

OK

OK

OK

OK

i386-pc-freebsd2.2.6

OK

OK

OK

OK

i386-pc-freebsd3.0

OK

OK

OK

OK

i586-pc-linux-gnu

OK

OK

OK

N/A

i686-pc-linux-gnulibc1

OK

OK

UNTESTED

N/A

i686-pc-linux-gnu

OK

OK

OK

N/A

i686-pc-sco3.2v5.0.5

OK

libstdc++
typename8.C
sig13.C
new3.C

OK

N/A

m68k-hp-bsd4.4

OK

OK

OK

OK

mips-sgi-irix6.5

OK

OK

OK

OK

{rs6000,powerpc}-ibm-aix4.2

OK

OK

OK

OK

powerpc-ibm-linux-gnu

OK

OK

OK

N/A

sparc-sun-solaris2.5

OK

OK

OK

OK

sparc-sun-solaris2.7

OK

OK

OK

OK

sparc-sun-sunos4.1

OK

OK

OK

OK

sparc-sun-linux-gnu

OK

OK

OK

N/A

Package/Feature Testing

Platform

linux-2.2.10

glibc-2.1.1

redhat-6.0

lapack

alphaev6-unknown-linux-gnu

OK

FAILS

hppa1.1-hp-hpux10.20

N/A

N/A

N/A

-O2 OK
-O3 -funroll-loops fails

i586-unknown-linux-gnu

OK

OK

i686-unknown-linux-gnu

OK

OK

compat-binutils
compat-egcs
kdelibs
korganizer
python
sgml-tools

OK

powerpc-unknown-linux-gnu

2.2.6 OK

OK

OK

sparc-sun-solaris2.5

N/A

N/A

N/A

-O2 OK

sparc-unknown-linux-gnu

OK

Package testing notes

Note the linux kernel, modules and related code must be compiled
with -fno-strict-aliasing as the linux kernel violates ANSI/ISO C standards
used to perform type based alias analysis

.

In addition to performing regression testing we want to test major
software packages with GCC 2.95. This list is not complete (I would like
to add at least one major C++ and Fortran package).

C++ package(s)

Fortran package(s)

For questions related to the use of GCC,
please consult these web pages and the
GCC manuals. If that fails,
the gcc-help@gcc.gnu.org
mailing list might help.
Comments on these web pages and the development of GCC are welcome on our
developer list at gcc@gcc.gnu.org.
All of our lists
have public archives.

Copyright (C)
Free Software Foundation, Inc.
Verbatim copying and distribution of this entire article is
permitted in any medium, provided this notice is preserved.