Spoiler: Statements
I shortened these to: game was fun, mod overall, vote counts, problems, flavor, balance, mechanic, and play in another.
I have received about a 70% response rate last I counted. I really appreciate this, and I hope you all will continue to give such valuable feedback.
Results So Far
Right now I have 12 games in the bank, with a roughly 70% response rate.
Raw Totals
As you can see, balance is the lowest metric as well as the metric that shows the most deviation (1.26 std deviation for those that care).
Keep in mind that just because someone answered that they thought balance was a problem doesn't make it so. There are really too few games to make any definite judgments based on the correlation between factors, but as it stands the mafia winning and players saying that the balance was good is strongly correlated. This is at first surprising (you'd think the more people who lose, the worst the balance gets rated), but it's not a stretch to say our players and mods tend to think games are more town-sided than they are.
Other Correlations
Some of the strong correlation between factors are:
Play in Another-Mod Overall. Hardly a surprise. These two are two sides of the same coin.
Balance-Play In Another
Vote Counts-Mod Overall. This is like the quintessential "are you modding well" test. Interestingly, play in another and vote counts only have a moderate correlation.
The highest correlation for "Fun" is actually the Mechanic. Beyond that, most are only slight or moderately correlated with fun.
Again, there have only been a dozen or so games played and rated so far, so these numbers will likely change.
Qualitative Analysis
As you may have seen, I don't just ask for people to rate games. I ask them for their comments too. This has been
extremely
helpful in getting a handle on what player common complaints are and what they wish we, as mods, would do better. A sampling:1.
Vote counts.
Even some highly rated games have come in with these complaints. We've also had complaints from a few people that feel mods are waiting too long to edit in a vote count into their posts.2.
Taking too long to post day and night scenes
. This one I've seen in a number of games. I think everyone understands it can take a while to put together a good scene when you're dealing with flavor, but it's important to know that excited players can become less excited when they have to wait a day (or in some cases as many as 3) after the supposed deadline to get a flip.Mod Ratings
For moderators of Large Theme Games
Moderators may PM me to get a summary report (with letter grades) by category of what their players said. This will only be used in aggregate, and confidentiality will be maintained. These letter grades are roughly curved with a B as average.
Please keep in mind that almost without exception I think that moderators are performing to a "good enough to mod" standard. But I think we can all strive to do better with what we do. So a sub-average rating does not necessarily mean I or anyone else thinks you're a failure (in fact, even games that are below average still have more people agreeing with the "I'd play in another" statement than not). So take the reports in the manner they're intended: to give guidance on how to improve your players' experience next time.
Also, keep in mind that
this is completely optional.
You are not required to see your results as a moderator, and I will not think less of you if you do not do so.Conclusion
Overall, mods are doing pretty well. The marks are relatively high on an absolute basis. We could do better, of course, but we're not doing badly at all.
PLEASE KEEP IN MIND THAT ALL RESPONSES ARE CONFIDENTIAL. I WILL ONLY USE THE AGGREGATE RESULTS OF SURVEYS.
