Sugar 6 Test Fest Begins… NOW!

Last summer, as we were getting into the beta phases of our 5.5 release, Matt rounded up a group of users and developers to participate in a “Test Fest”. The goal of Test Fest was to rally around field-testing of the product, seeing what you can find that we missed in our QA cycles. A group effort to really pound on the beta release, shake out those corner cases that we simply don’t know you need us to test beforehand.

Green are for bugs found by the field during beta phases; Red are for bugs found by the field after GA

We’ve had some success with field-testing during the beta phases in the past, but when I look at the results compared to what the field is reporting to us after GA, it looks something like the chart to the right.

It looks nicer in a Sugar Pro reports chart, trust me… but I like scribbling :-)

The number of bugs found by the field, and submitted to http://bugs.sugarcrm.com, during the beta phases of a release pales is much lower than what’s found after we’ve already gone GA. This isn’t terribly surprising, but still not where any of us want it to be. I think it’s safe to speak for our user community when I say we want to shake out more and more bugs before GA than after GA. Agreed?

So. I throw down the gauntlet to you — we think we’ve raised our game with the quality of our releases, I challenge you to prove us wrong.

What is Test Fest?

A collection of end-users, developers, and SugarCRM employees who work closely together to validate new features and bug fixes in Sugar components that are important to their business.

You (the tester) will try out various features in a particular component of Sugar 6. You should test what’s important to YOUR business. Bugs should be submitted through http://bugs.sugarcrm.com. With our new public SVN repository, you can check out the daily updates to Sugar 6 to verify your bugs when they’ve been fixed.

Please let me know if you are willing to participate in Test Fest by adding your name to this forum thread. The most prolific testers will receive fame and glory and my undying admiration… or maybe something shiny :-)

Check out the Sugar Developer Guide

Wanting to learn how to customize your Sugar instance or integrate your application with the Sugar platform? Check out the Sugar Developer Guide for complete API details, examples, and tips for developing with Sugar.