I shortened these to: game was fun, mod overall, vote counts, problems, flavor, balance, mechanic, and play in another.
I have received about a 70% response rate last I counted. I really appreciate this, and I hope you all will continue to give such valuable feedback.
Right now I have 12 games in the bank, with a roughly 70% response rate.
As you can see, balance is the lowest metric as well as the metric that shows the most deviation (1.26 std deviation for those that care).
Keep in mind that just because someone answered that they thought balance was a problem doesn't make it so. There are really too few games to make any definite judgments based on the correlation between factors, but as it stands the mafia winning and players saying that the balance was good is strongly correlated. This is at first surprising (you'd think the more people who lose, the worst the balance gets rated), but it's not a stretch to say our players and mods tend to think games are more town-sided than they are.
Some of the strong correlation between factors are:
Play in Another-Mod Overall. Hardly a surprise. These two are two sides of the same coin.
Balance-Play In Another
Vote Counts-Mod Overall. This is like the quintessential "are you modding well" test. Interestingly, play in another and vote counts only have a moderate correlation.
The highest correlation for "Fun" is actually the Mechanic. Beyond that, most are only slight or moderately correlated with fun.
Again, there have only been a dozen or so games played and rated so far, so these numbers will likely change.
As you may have seen, I don't just ask for people to rate games. I ask them for their comments too. This has been
1.
2.
Moderators may PM me to get a summary report (with letter grades) by category of what their players said. This will only be used in aggregate, and confidentiality will be maintained. These letter grades are roughly curved with a B as average.
Please keep in mind that almost without exception I think that moderators are performing to a "good enough to mod" standard. But I think we can all strive to do better with what we do. So a sub-average rating does not necessarily mean I or anyone else thinks you're a failure (in fact, even games that are below average still have more people agreeing with the "I'd play in another" statement than not). So take the reports in the manner they're intended: to give guidance on how to improve your players' experience next time.
Also, keep in mind that
Overall, mods are doing pretty well. The marks are relatively high on an absolute basis. We could do better, of course, but we're not doing badly at all.