Without having to read every single vote post (which is as excessively subjective as it is time-consuming), we can still take into account as much as recommended without too much extra work things like vote timing, competing wagons, "momentum", and so forth. And we can even check to see if things like experience, gender, or usual activity make any difference. We can connect voting patterns with players' likelihood to get mislynched and so forth.
One interesting idea for also poking at the more subjective features of voteposts (ie the tone) would be to collect (or just index so that they can be collected on demand) every vote in the data set and program a survey that gives a participant 10 of them randomly picked out to rate on dimensions like tone, depth, and whatever as well as their confidence on these measures. In enough trials (which could be challenging to make happen), we'll have multiple quantized appraisals of every/enough vote post and can take them into account statistically, too.
Lots will be missed by just showing someone a single vote post (ex someone votes in one post and explains in another), but hopefully just focusing on voteposts that result in identical high confidence assessments won't give us a too-skewed understanding of the data set.
But then again, if there are no patterns in the final votecounts of D1, I'm sort of pessimistic about what we'll see in general. Does anyone here with a confident belief about an interesting result that a study of the variables described above might produce?
Surely there are
some
things that scum do more often than town that a study avoidant of subjectivity could identify?