The Eclipse release engineering team will update the org.eclipse.sdk.examples-feature to include the new tests. They will also update org.eclipse.releng.eclipsebuilder/all/publishing/templateFiles/testManifest.xml to indicate the zip that should get a red X if there are compile errors associated with that plug-in on the build page.

The Eclipse release engineering team will update the org.eclipse.sdk.examples-feature to include the new tests. They will also update org.eclipse.releng.eclipsebuilder/all/publishing/templateFiles/testManifest.xml to indicate the zip that should get a red X if there are compile errors associated with that plug-in on the build page.

+

+

==Testing the 4.2 build on build.eclipse.org==

+

+

Just documenting the current issues here (March 21, 2012)

+

+

The builder to build the 4.2 primary build is the R4_2_primary branch of

+

org.eclipse.releng.basebuilder and org.eclipse.releng.eclipsebuilder

+

+

The branch of the map files with the bundles to build are R4_HEAD. There are a

+

few weeks out of date. This is just for testing.

+

+

e4Build@build:/shared/eclipse/e4> pwd

+

/shared/eclipse/e4

+

e4Build@build:/shared/eclipse/e4> ls masterBuildKim.sh

+

masterBuildKim.sh

+

+

Is the script that invokes the build. It needs to be refactored a bit. Also,

+

the bits that tag the repos have been commented out because I don't want to

+

pollute the the 4.2 maps until we have the other issues worked out.

+

+

In our regular 3.8 stream builds we have scripts in the bootstrap script that

eclipsebuildserv (build machine) Linux machine on far back table of the room

The linux machines should be logged in as kmoir. The windows machines should be logged in as the default user. If the build machines don't have the correct user logged in, the ui tests will fail. All the test machines have 2 x 3.00Ghz processors and 3GB of memory.

Is the Eclipse platform build process completely automated?

Yes, the Eclipse build process starts with a cron job on our main build machine that initiates a shell script that checks out the builder projects.

org.eclipse.releng.eclipsebuilder -> scripts to build each type of drop

org.eclipse.releng.basebuilder -> a subset of eclipse plugins required to run the build.

we also use several small cvs projects on an internal server that store login credentials, publishing information and jdks

Fetch and build scripts are generated automatically by the org.eclipse.pde.build bundle in org.eclipse.releng.basebuilder. Fetch scripts specify the version of code to retrieve from the repository. Build scripts are also generated automatically to compile all java code, determine compile order and manage dependencies. We create a master feature of all the non-test bundles and features used in the build. This feature is signed and packed, and the we create a p2 repo from the packed master feature. Metadata for the products is published to the repository. We then use the director application to provision the contents of the SDKs etc to different directories and then zip or tar them up. We also use custom build scripts that you can see in org.eclipse.releng.eclipsebuilder.
After the SDKs are built, the automated junit and performance testing begins. Tests occur over ssh for Linux machines, and rsh for Windows machines. Each component team contributes their own tests. Once the tests are completed,the results are copied back to the build machine. Also, the images for the performance tests are generated.

What's the difference between an integration and nightly build?

With integration builds, we specify a version of the plug-in to retrieve in the map files. (org.eclipse.releng/maps). With nightly builds, we retrieve the plug-ins specified in the map files from the HEAD stream. The types of builds we run are described here http://download.eclipse.org/eclipse/downloads/build_types.html.

How do I use the releng plugin?

The RelEng Plug-in is included in the Eclipse builds and is available at the bottom of the download page.

This plug-in provides features that will help with the Eclipse development process. Installing the plug-in will add the following actions. The source is contained in the *.jar files so please feel free to submit patches for features or bug fixes. To install simply unzip the file into root of your eclipse install and restart Eclipse.
Please use the Release feature of this plug-in to do your build submissions.

Release to the Team menu. This action will Tag selected projects with the specified version and update the appropriate loaded *.map files with the version. The user must have the *.map files loaded in their workspace and the use must commit the map file changes to the repository when done.

'Load Map Projects to the Team menu. Select one or more *.map file and this action will load the projects listed in the *.map file into your workspace. Naturally the versions specified in the *.map file will be loaded.

Tag Map Projects to the Team menu. Select one or more *Map files and this action will tag the projects listed in the *Map files with a tag you specify.

Compared with Released to the Compare menu. Compare the selected projects with the versions referenced in the currently loaded map files.

Replace with Released to the Replace menu. Replace the selected projects with the versions referenced in the currently loaded map files.

Fix Copyright to the Resource Perspective Projects context menu. Select one or more projects in the Resource Perspective. This action will sanity check the copyright notices in all the *.java and *.properties files. Copyrights will be updated automatically where the tool deems appropriate. A copyright.log file will be written to the workspace directory noting odd conflicts that need to be looked at.

How do I run a build using the scripts in org.eclipse.releng.eclipsebuilder?

What is the latest version of org.eclipse.releng.basebuilder?

How do I automate my builds with PDE Build?

How do I contribute a JUnit Plug-in Test to the build?

The tests need to be contributed as one or more plugins that use the org.eclipse.test automated testing framework. JUnit tests can also be written as performance tests. Click here for the latest instructions.

Open bug for for PMC approval for new plug-in projects on dev.eclipse.org:/cvsroot/eclipse. CC webmaster on the bug once the plug-ins are created. Or you may want to include the new plug-ins under an existing project and in this case, the webmasters don't need to get involved.

Add the new test plugin to the org.eclipse.releng project in the appropriate map file for your component.

Install the org.eclipse.releng tools plug-in, and use the "Release" action in the context menu of the test plug-in project to update and commit map file.

Open a bug against platform releng to add the plugins to the build process. Include the following information:

the plug-in id(s)

the plug-ins that contain a test.xml

update the build.properties to include the test.xml

additional steps to setup the tests outside of installing the test plugins and framework in an Eclipse SDK

The Eclipse release engineering team will update the appropriate feature and scripts to build and run the new tests.

How do I contribute an example plug-in to the build?

Once you have your plug-in ready and available in CVS, install the org.eclipse.releng.tools plug-in, and use the "Release" action in the context menu of the test plug-in project to update and commit the map file.

Next, open a bug against platform releng with the plug-in's id.

The Eclipse release engineering team will update the org.eclipse.sdk.examples-feature to include the new tests. They will also update org.eclipse.releng.eclipsebuilder/all/publishing/templateFiles/testManifest.xml to indicate the zip that should get a red X if there are compile errors associated with that plug-in on the build page.

Testing the 4.2 build on build.eclipse.org

Just documenting the current issues here (March 21, 2012)

The builder to build the 4.2 primary build is the R4_2_primary branch of
org.eclipse.releng.basebuilder and org.eclipse.releng.eclipsebuilder

The branch of the map files with the bundles to build are R4_HEAD. There are a
few weeks out of date. This is just for testing.

Is the script that invokes the build. It needs to be refactored a bit. Also,
the bits that tag the repos have been commented out because I don't want to
pollute the the 4.2 maps until we have the other issues worked out.

In our regular 3.8 stream builds we have scripts in the bootstrap script that
update the tags in the map files repo. The
eclipse.platform.releng.maps\org.eclipse.releng\tagging\repositories.txt file
lists the appropriate branches to look for each repo.

These scripts update the maps with a timestamp in the tags field of the
appropriate project. This is disabled for now for testing purposes.

Anyways, the issues and notes
1) The current 4.2 stream org.eclipse.platform.doc.isv bundle copies over some
content from the 3.x stream of this same bundle. This needs to be deleted once
we move to 4.2 build primary
2) update.core has been added added to sdk.tests feature because some of the
tests still depend on it.
3) update.tests.core has been removed for org.eclipse.sdk.tests feature because
these tests aren't relevant anymore
4) The 4.2 versions sdk and platform features have parts commented in their
build.properties that are commented out. These need to be uncommented and
released when we move to the 4.2 build primary so the appropriate source
bundles are produced. I've temporarily uncommented them and tagged them for
the R4_HEAD version of org.eclipse.releng.
5) The e4 build part doesn't run yet, I just build the e4 bundles needed for
the platform.
6) Need to add the 4.2 stream tests to the sdk.tests feature and run them,
right now it just includes the 3.8 stream tests.
7) The test results page generation also needs to be updated to include all the
tests.
8)I use a hudson token to invoke the tests via JSON. This needs to be stored
somewhere secure. Right now, I just add it to the command.txt when hacking the
build.
9) The build isn't copied to the correct location, signed or mirrored into the
correct repo because it's just a test build.

I would like to recompile eclipse on a platform that is not currently supported. What is the best approach to this? How can I ensure that the community can use my work?

The best approach is use the source build drop and modify the scripts to support that you are interested in. Then open a bug with product Platform and component Releng attaching the patches to the scripts that were required to build the new drop. If you are interested in contributing a port to eclipse, here is the procedure.

How do you run the source build for 3.5 builds?

How does the platform team sign their builds?

How long does the build take to complete?

It takes three hours and 20 minutes for all the drops to be produced. JUnit (eight hours) and performance tests (twelve hours) run in parallel after the windows, mac, linux and sdk tests drops have been built. It takes another two hours for the performance results to be generated.

I noticed that you promoted an integration build to a milestone build. The integration build had test failures but the milestone builds doesn't show any. Why is this?

The component teams are always trying to fix their tests but unfortunately they are still some issues. When we promote a build to a milestone, we rerun the tests that failed. Many pass on the second time because the tests initially failed due to a timing issue or intermittent condition. Or a team will have a broken test that doesn't warrant a rebuild for a milestone. In that case, the releng team sprinkles pixie dust over the build page to erase the red Xes, but leaves the appropriate build failures intact.

Copy child repo to appropriate milestone or release repo. Update compositeArtifacts.jar and compositeContent.jar to include properties to point to the child repo. Update the child repo's artifacts.jar to include the correct link the the p2.mirrorsURL property.

I'd like to run a build with the version of the code that was used for build X? How do I know what versions of code in the repository were used?

There are several ways to approach this issue.

Look at the directory.txt linked from the top of every build page. The directory.txt concatenates all the map files used in a build into a single file. Please note that every nightly build runs from HEAD. Therefore it is impossible to replicate a nightly build.

In addition, with every maintenance and integration build, the dev.eclipse.org:/cvsroot/eclipse org.eclipse.releng project, which contains the map files for each project, is tagged with a version corresponding to that build. For instance, the version I20051018-0932 corresponds to the integration build of the same name. Please note that the builder projects, (org.eclipse.releng.eclipsebuilder and org.eclipse.releng.basebuilder) are also tagged during an integration build with the corresponding build name, but are not reflected in the directory.txt because they are not included in the eclipse distribution itself.

Finally, after each release the releng team tags all projects from the map files used in the release. So, all the projects used to construct version 3.1.1 are tagged R_3_1_1.

I'm looking for an older build but can't find them on the download page?

How do I run a test build on the hudson install at eclipse.org ?

On the left hand side, select "Build Now". Your test nightly build will be available in about three hours, depending on the load average on the eclipse Hudson slaves. This build isn't signed or packed to save time. Once the build is finished, select "Build Artifacts" to to look at the SDKs etc (/builds/transfer/files/bogus/download/drops/${buildId}) or p2 repo (/builds/transfer/files/repo/).

This build will also run tests on three platforms (Windows 7, Linux, and Mac OS X10.6). These take six to eight hours to complete. There are still a few remaining issues respect to running several test suites on a some platforms. For more details, see bug https://bugs.eclipse.org/bugs/show_bug.cgi?id=295393

How do I run the JUnit tests used in the build?

With every build, there is a eclipse-Automated-Tests-${buildId}.zip file. You can follow the instructions associated with this zip to run the JUnit tests on the platform of your choice.

How do you run the tests on the Windows machine via rsh

Where do you find the Java SDK for the Mac (This is required to run the JDT debug JUnit tests)

The default Mac install only includes a JRE, not a JDK. The JDK is listed under Apple Connect under J2SE 5.0 Release 5 Developer Documentation.
Once the .dmg is installed, you should see a src.jar under /System/Library/Frameworks/JavaVM.framework/Versions/1.5.0/Home

The process needs to be executed using at or cron if you are logged in remotely because the swt libraries are needed to run the generation. If you run the process while logged in remotely via ssh, the process will fail with "No more handles". The output logs for this process are in the posting directory under buildlogs/perfgen*.txt.

The user that's running the tests on the build machine needs run "xhost +" in a terminal on the build machine.

How to regenerate performance results from build artifacts

This assumes that the artifacts used to run the build and the resulting build directory itself still exist on the build machine.

The process needs to be executed using at or cron if you are logged in remotely because the swt libraries are needed to run the generation. If you run the process while logged in remotely via ssh, the process will fail with "No more handles". The output logs for this process are in the posting directory under buildlogs/perfgen*.txt.

The user that's running the tests on the build machine needs run "xhost +" in a terminal on the build machine.

How performance tests are invoked in the build

Performance tests run if the -skipTest or -skipPerf parameters isn't passed to the build when running it. Both JUnit and performance tests are invoked in the build by the testAll target in the org.eclipse.releng.eclipsebuilder/buildAll.xml

This invokes the tests in parallel on the performance test machines. In this case, there is a machine.cfg file in the same directory as the above file that maps the "cfgKey" value written above to the hostname of the machine. The tests are invoked on the windows machines via rsh and on the linux machines via ssh.

This invokes all the tests in the org.eclipse.releng.eclipsebuilder\eclipse\buildConfigs\sdk.tests\testScripts\test.xml on each machine. If the test bundle has a performance target in the test.xml, the performance tests for that machine will run. The test scripts use the values in the (for example when running on window xp) org.eclipse.releng.eclipsebuilder\eclipse\buildConfigs\sdk.tests\testConfigs\win32xp2-perf\vm.properties which specifies the database to write to as well as the port, and url of that database.

How can I run the update manager from a command line to mirror a remote site?

Refer to running update manager from command line in Eclipse Help for the latest information. It copies the appropriate versions of features and associated plugins you specify and generates the site.xml. For instance, if you wanted to create an update site for the platform feature.

I have questions about PDEBuild - where should I go for answers?

Debugging pde build with missing dependancies

Breakpoint in BuildTimeSite class, in missingPlugins method, set breakpoint
In display view,
state.getState().getResolverErrors(state.getBundle("org.eclipse.ui.workbench", null, false))
print the errors for the bundle in question.

Are there RSS feeds for builds?

If I add a new plugin to a build, how do I ensure that javadoc will be included in the build.

Troubleshooting test failures

If tests pass in a dev workspace but fail in the automated test harness, check to make sure that your build.properties is exporting all the necessary items; check that plug-in dependencies are correct, since the test harness environment will only include depended-upon plug-ins; and check that file references do not depend on the current working directory, since that may be different in the test harness.

To debug tests in the context of the automated test harness, add the following element to the test.xml file in your plug-in's directory in the test harness.

launch the tests from the command line, using the -noclean option to preserve the modified test.xml

launch the debug target

I would like a plaform releng committer to comment on a bug assigned to another component. What mailbox do I add to the cc list in bugzilla?

Please cc the generic mail alias platform-releng-inbox@eclipse.org. Please do not just cc your favourite release engineer using their individual email address. They might be on a beach somewhere enjoying a sunny vacation and therefore unable to comment.

Linux/Mac

ensure that correct mozilla/xulrunner libraries are installed in the build and match those defined in the build test scripts for SWT tests

update /etc/hosts to include localhost

disable iptables in chkconfig and stop the service

Process to release builds to Simultaneous Release

Check out org.eclipse.indigo.build or org.eclipse.juno.build from /cvsroot/callisto.

For eclipse platform, update versions in ep.b3aggrcon, for equinox equinox.b3aggrcon

Copy child repo from integration build site or maintenance build site into the appropriate milestone or release site. Update compositeContent.jar and compositeArtifacts.jar to reflect the new child repo.

Where are the p2 update sites for the Eclipse Project?

How do I use the p2 zipped repos on the build page to provision my install or a pde target?

Where can I download foundation libraries?

Anyone can get access to the foundation 1.1 jar from the OSGi R4.1 specification at http://www.osgi.org/Download/Release4V41. They do not need to be a member, but they must fill out a form so an e-mail can be sent with special links to download the jars from OSGi.

Overview of JUnit4 changes released to Eclipse test framework in Eclipse 3.6M4

How to avoid breaking the build

Submitting content to the Helios build

The helios build files are in org.eclipse.helios.build in /cvsroot/callisto. We update the ep.build and equinox.build files to reflect the versions of the components each milestones. This is the location of the milestones directory on the build machine.

/builds/transfer/files/updates/3.6milestones/

I just ls the features directory of the current milestone, update the build files, then commit.

Are the Eclipse and Equinox projects converting from CVS to git?

Here is the umbrella bug 345479 that was used to coordinate the migration.

How do you incorporate the p2MirrorURL into your repo at build time

See this excellent document p2.mirrorsURL written by Stephan Herrmann.

The p2.mirrorsURL should be added to your metadata so that p2 will see the list of available mirrors to choose during installation. Mirrors = less eclipse.org
bandwidth utilization = happy Eclipse.org webmasters. Always try to keep the sysadmins happy is my motto.