The heroes of Fedora 19 Beta testing

Fedora 19 Beta was released last week. As usual, here are some interesting statistics from different areas of our testing efforts. No matter how large your contribution was, if you’ve helped us, thank you.

Fedora 19 Beta – wiki matrices

This is the list of people who filled in our release validation wiki matrices (Install, Desktop and Base), which are posted for every test compose (and release candidate) that we create. The purpose is to see which areas have been thoroughly tested and which were not.

1 This is a list of bug reports linked to the wiki results. They don’t have to be reported by that concrete person.

The two titans waged a battle, and in the end, Bob Lightfoot (boblfoot) prevailed, for the first time! :-) Congratulations, Bob. Andre Robatino (robatino) very closely followed. After them, there is Vojtěch Boček (tassadar), a high school student who spent two weeks on internship in Red Hat, and then nonamedotc with nearly exactly the same score. The number one Red Hatter became Adam Williamson (adamwill), closely followed by a few other Red Hat employees and Thomas Gilliard (satellit). Great job, guys, thank you! Of course, everyone else’s help is fully appreciated as well.

Fedora 19 Beta – Bugzilla

This is a trimmed list of people who reported bugs into Bugzilla against Fedora 19 in the specified time period. Compared to Fedora 19 Alpha statistics, the already high numbers went even higher – the number of reporters went up by 50%. Nice to see.

…and also 380 other reporters who created less than 5 reports each, but 611 reports combined!

1 The total number of new reports (including “excess reports”). Reopened reports or reports with a changed version are not included, because it was not technically easy to retrieve those. This is one of the reasons why you shouldn’t take the numbers too seriously, but just as interesting and fun data.2 Excess reports are those that were closed as NOTABUG, WONTFIX, WORKSFORME, CANTFIX or INSUFFICIENT_DATA. Excess reports are not necessarily a bad thing, but they make for interesting statistics. Close manual inspection is required to separate valuable excess reports from those which are less valuable.3 This only includes reports that were created by that particular user and accepted as blockers afterwards. The user might have proposed other people’s reports as blockers, but this is not reflected in this number.

The gold crown in the number of bug reports is won by our famous “community monkey”, Red Hatter Adam Williamson. Dhiru Kholia continues to report packaging issues, as before. Mikhail and Reartes Guillermo lead the community efforts in standard bug reporting, together with Chris Murphy, vinesh teotia, Andre Robatino, Robert Lightfoot and others. Chris and Andre were very successful in proposing Beta blocker bugs.

It’s always nice to see how many people participate in bug reporting, the numbers are breathtaking. I hope it doesn’t mean that our quality is really low :-) I believe this indicates the opposite – we have an amazing number of people trying to ensure the quality is as high as possible. Thank you.

Fedora 19 Beta – updates testing

This is a trimmed list of people who provided feedback in Bodhi for all updates proposed into Fedora 19 in the specified time period. The purpose is to make sure that broken updates do not enter the stable repository and the release continuously stabilizes.

…and also 114 other reporters who created less than 3 reports each, but 140 reports combined!

1 If a person provides multiple comments to a single update, it is considered as a single comment. Karma value is not taken into account.

When compared to F19 Alpha statistics, the number of reporters increased by half and the number of comments increased more than 3 times. Nice. This is one of the easiest way how to contribute to Fedora quality and I’m very glad that the numbers soared so much. Our hero is, as usual, Robert C. Lightfoot (boblfoot)! The other high-profile community contributors include misc, Piotr Drąg (raven), Igor Gnatenko (ignatenkobrain), bitlord, T.C. Hollingsworth (patches), Ankur Sinha (ankursinha) and others. The most active Red Hatter was, once again, Adam Williamson. Great job, everyone.

Summary

I’m very glad to see a visible increase in test activities since F19 Alpha. Surely, the officially released milestone composes (i.e. Alpha, Beta) help to attract more testers than just the regular contributors base. It will be interesting to see how the picture changes between Fedora 19 Beta and Final.

If you are interested in raising the Fedora quality up, help us out. Read QA/Join, follow the announcements and talk to us in #fedora-qa on IRC and test list. We will love to see you!

When reading the statistics, please take it with a grain of salt. The numbers are not directly comparable. People might see some reports as more valuable than others. Some people tested a lot of components, but haven’t found many problems (but that also helps). Some people used their skills in other areas than those mentioned. This is not meant to be a comparison chart, but a well-meant “thank you” letter.
The statistics were generated by these scripts.