As I've said before, this is part of the reason why I think people may be townreading Gentleman 6, or opposed to his being left out. I personally think he's much better spoken and less abrasive than either Gentleman 2 or Gentleman 7, and I imagine that everyone else would agree.
It's really easy to convince yourself that someone who isn't great at speaking, who has truly unorthodox thought patterns, or who is otherwise just awkward is scum. It's why the same people get eliminated early game after game. It's very easy to understand what I'm saying, but I think it's a lot harder to truly internalize that we all have biases against getting rid of people we like interacting with and recognize how that might shape your opinions. I don't claim to be much better than anyone else at it, but I think that recognizing it is an important first step.