The heroes of Fedora 19 Alpha testing

1360095720_PrizeFedora 19 Alpha has been released. I would like to thank everyone who contributed to testing it. Here are some interesting numbers from different quality verification areas. No matter how small or large your contribution is (or whether it is listed at all), if you helped Fedora 19 Alpha quality to improve, you have our thanks.

Fedora 19 Alpha – wiki matrices

This is the list of people who filled in our release validation wiki matrices (Install, Desktop and Base), which are posted for every test compose (and release candidate) that we create. The purpose is to see which areas have been thoroughly tested and which were not.

Test period: Fedora 19 branch time – Fedora 19 Alpha release
Testers: 23
Reports: 1001
Unique referenced bugs: 69

Name Reports submitted Referenced bugs1
robatino 316 919374 924138 924244 924248 924251 924254 924255 924256 924258 924260 926913 926916 929050 929054 929177 946964 951801 (17)
boblfoot 187 922558 929373 929403 929421 946906 946951 947536 947538 948615 949906 951766 957486 957554 957783 (14)
satellit 95 923951 928287 929289 947538 948921 949761 949802 950510 951842 952250 (10)
Wutao85 91 926926 927178 947028 947031 952512 952950 (6)
nonamedotc 57 892178 (1)
adamwill 47 858270 863592 928982 947558 953329 (5)
lnie 45 951269 952950 (2)
spstarr 34 949831 951259 (2)
jskladan 27 928228 928279 948250 948719 949761 (5)
mkrizek 21 928296 948615 951039 (3)
kparal 20 928279 928287 928339 950504 950510 (5)
lkardos 17
lbrabec 10
pschindl 9 947142 950504 950510 (3)
cra 7 907058 949761 950504 (3)
tflink 5
patches 3
jsedlak 3 950641 951449 953337 (3)
mbriza 3
wolnei 1 947285 (1)
boblfoor 1
pwnall 1
jdulaney 1

1 This is a list of bug reports linked to the wiki results. They don’t have to be reported by that concrete person.

As usual, Andre Robatino (robatino) is the king of the hill 🙂 Bob Lightfoot (boblfoot) continues to be the second most active person, as in Fedora 18 Final cycle. Many thanks, guys.

I’m very glad that there are a number of community contributors at the top. Besides robatino and boblfoot, namely Thomas Gilliard (satellit), nonamedotc and Shawn Starr (spstarr) provided an amazing number of test results. The number one Red Hatter is Tao Wu (Wutao85). Great job! Of course, even the smaller numbers in the ladder are greatly appreciated and help Fedora a lot. Thank you.

Fedora 19 Alpha – Bugzilla

This is a trimmed list of people who reported bugs into Bugzilla against Fedora 19 in the specified time period. The numbers are pretty high as usual, Bugzilla is our most visible QA tool.

Test period: Fedora 19 branch time – Fedora 19 Alpha release (2013-03-12 – 2013-04-23)
Reporters: 323
New reports: 1234

Name Reports submitted1 Excess reports2 Accepted blockers3
Dhiru Kholia 103 0 (0%) 0
Adam Williamson 54 1 (1%) 7
Reartes Guillermo 29 2 (6%) 0
Andre Robatino 27 10 (37%) 12
Stef Walter 27 1 (3%) 0
Kamil Páral 25 0 (0%) 3
Jens Petersen 25 1 (4%) 0
Daniel Walsh 19 1 (5%) 0
Ľuboš Kardoš 19 1 (5%) 0
sangu 17 0 (0%) 0
John Reiser 15 0 (0%) 0
Jeff Bastian 13 1 (7%) 0
Mark Hamzy 13 1 (7%) 0
Tim Waugh 13 1 (7%) 0
Robert Lightfoot 12 4 (33%) 2
Mike FABIAN 12 1 (8%) 1
Ales Kozumplik 12 0 (0%) 0
Jan Stodola 12 0 (0%) 0
Branislav Náter 11 1 (9%) 0
Dawid Zamirski 10 0 (0%) 0
Flóki Pálsson 10 0 (0%) 0
Karsten Hopp 10 0 (0%) 0
Leslie Satenstein 10 1 (10%) 0
Vladimir Benes 10 1 (10%) 0
Zbigniew Jędrzejewski-Szmek 10 1 (10%) 0
A S Alam 9 0 (0%) 0
Jan Safranek 9 0 (0%) 0
Martin Banas 9 3 (33%) 0
Mikolaj Izdebski 9 0 (0%) 0
mussadek 9 0 (0%) 0
Tanner Doshier 9 0 (0%) 0
Alex Murray 8 0 (0%) 0
Matthew Miller 8 1 (12%) 0
Michael Schwendt 8 0 (0%) 0
Orion Poplawski 8 0 (0%) 0
Patrik Kis 8 0 (0%) 0
satellit at bendbroadband.com 8 2 (25%) 0
Petr Schindler 7 0 (0%) 2
Ankur Sinha (FranciscoD) 7 2 (28%) 0
Hans de Goede 7 1 (14%) 0
Jiří Martínek 7 0 (0%) 0
Joachim Backes 7 1 (14%) 0
Peter Robinson 7 0 (0%) 0
Peter Trenholme 7 0 (0%) 0
Brian C. Lane 6 1 (16%) 1
Alexei Panov 6 0 (0%) 0
Artem Artemov 6 0 (0%) 0
Dan Waleke 6 0 (0%) 0
Ed Greshko 6 1 (16%) 0
Elad Alfassa 6 1 (16%) 0
Harald Hoyer 6 0 (0%) 0
Jakub Dorňák 6 0 (0%) 0
Jakub Filak 6 0 (0%) 0
Jiri Popelka 6 0 (0%) 0
T.C. Hollingsworth 6 1 (16%) 0
Tao Wu 6 2 (33%) 0
Vadim Rutkovsky 6 0 (0%) 0
Shawn Starr 5 1 (20%) 1
Dan Horák 5 0 (0%) 0
Dan Mashal 5 1 (20%) 0
Dennis Gilmore 5 0 (0%) 0
Gustavo Luiz Duarte 5 0 (0%) 0
Miroslav Grepl 5 3 (60%) 0
Mr-4 5 1 (20%) 0
Ondrej Hudlicky 5 2 (40%) 0
Remi Collet 5 0 (0%) 0
Rex Dieter 5 1 (20%) 0
…and also 256 other reporters who created less than 5 reports each, but 437 reports combined!

1 The total number of new reports (including “excess reports”). Reopened reports or reports with a changed version are not included, because it was not technically easy to retrieve those. This is one of the reasons why you shouldn’t take the numbers too seriously, but just as interesting and fun data.
2 Excess reports are those that were closed as NOTABUG, WONTFIX, WORKSFORME, CANTFIX or INSUFFICIENT_DATA. Excess reports are not necessarily a bad thing, but they make for interesting statistics. Close manual inspection is required to separate valuable excess reports from those which are less valuable.
3 This only includes reports that were created by that particular user and accepted as blockers afterwards. The user might have proposed other people’s reports as blockers, but this is not reflected in this number.

The most visible person here is Dhiru Kholia, who mass-reported over 100 bugs about packaging guidelines violation. When it comes to standard bug reports, the shining star here is a Red Hatter Adam Williamson. We also have quite a few community people at the top, namely Reartes Guillermo, Andre Robatino, sangu, John Reiser, Mark Hamzy, Dawid Zamirski, Flóki PálssonLeslie Satenstein and Zbigniew Jędrzejewski-Szmek. And of course there are hundreds of others, who reported just a few bugs each, but it all sums up in an amazing number of bug reports. Thank you all!

Fedora 19 Alpha – updates testing

This is a trimmed list of people who provided feedback in Bodhi for all updates proposed into Fedora 19 in the specified time period. The purpose is to make sure that broken updates do not enter the stable repository and the release continuously stabilizes.

Test period: Fedora 19 branch time – Fedora 19 Alpha release (2013-03-12 – 2013-04-23)
Testers: 98
Comments1: 278

Name Updates commented
patches 47
misc 19
akurtakov 16
raven 16
adamwill 16
kevin 15
kalev 13
pbrobinson 5
kparal 4
petersen 4
spstarr 3
mfabian 3
ankursinha 3
sharkcz 3
miketc302 3
bruno 3
deanhunter 3
robatino 3
mschwendt 3
jerboaa 2
maners 2
elad 2
twaugh 2
adomurad 2
bellet 2
ajax 2
gustavold 2
egreshko 2
mkrizek 2
boblfoot 2
yelley 2
bruce89 2
satellit 2
dwa 2
kraman 2
nucleo 2
…and also 62 other reporters who created less than 2 reports each, but 62 reports combined!

1 If a person provides multiple comments to a single update, it is considered as a single comment. Karma value is unimportant.

The top contributor is T.C. Hollingsworth (patches), who provided feedback to the most updates by far. Also from the community Piotr Drąg (raven) and Kalev Lember (kalev) were near the top as well. The most active Red Hatter was Michael Scherer (misc). There are dozens of other people who tested an update or two. Thank you all. This type of testing is very useful and very easy to participate in. It’s the best place to start if you want help Fedora QA out a bit.

Summary

The testing seems to be going well and Fedora 19 seems to go much smoother than Fedora 18 had. Thanks all contributors!

If you are interested in raising the Fedora quality up, help us out. Read QA/Join, follow the announcements and talk to us in #fedora-qa on IRC and test list. We will love to see you!


When reading the statistics, please take it with a grain of salt. The numbers are not directly comparable. People might see some reports as more valuable than others. Some people tested a lot of components, but haven’t found many problems (but that also helps). Some people used their skills in other areas than those mentioned. This is not meant to be a comparison chart, but a well-meant “thank you” letter.
The statistics were generated by these scripts.

The heroes of Fedora 19 Alpha testing

4 thoughts on “The heroes of Fedora 19 Alpha testing

Leave a Reply (Markdown syntax supported)

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s