Originally Posted by ChainedOne
Punishments are not set by Tribunal Judges, they are set by Riot, so in that I will agree that Riot sets the stage.
As for fair reports, I believe that we can do that well enough ourselves. Right now there is not much we can do about unfair reports, and I agree that Riot needs to implement some process to fix this problem. However, we have to accept what we have at the moment and do our part.
The problem with your particular solution is, how do we determine which reports were unfair?
That wasn't really the point I was making. I'm saying Riot has to take the lead on setting a tone for how the community perceives "punishable behavior", and especially in evaluating the veracity of tribunal judges' verdicts against that standard.
The idea has been put forward many times, not just by me, that some kind of "poison pill" tribunal cases, cases that are clearly "pardon"s with absolutely no wrongdoing which - if a judge "punishes" them - would result in losing the ability to do tribunal for some amount of time, would go a long way toward reassuring the community that Riot considers false punishment to be a real problem.
How many times have you heard, in this thread alone even, that there is a presumption of guilt just because someone ended up in tribunal? Riot can break down these prejudices by implementing systems which encourage honest and accountable tribunal verdicts. Then, extend this "poison pill" idea to less clear-cut cases, and seed the community with Riot's standards through evaluating judges on an individual basis against cases designed to test those standards.
The problem with "justice rating" and such is that it is only evaluating your conformity to the herd, a herd which by almost any account tends to overwhelmingly "punish." Riot can guide this by giving individual feedback against test cases, and using those to establish the standards, again, preferably by restricting participation to users who have demonstrated judgment in line with what Riot wants to see.
Lyte is a smart dude, I'm sure this makes sense to him. Why nothing like this has been done I don't know. Maybe development resource constraints. But I sincerely hope they recognize there are serious problems with the Tribunal as-is, today.