Since we released The Justice Review a few months ago, we’ve been monitoring The Tribunal and would like to share a few changes we’ve made that are subtle, but critical. These changes are aimed at improving accuracy, providing voters more relevant information, and helping to identify the most toxic players even faster. I want to quickly highlight these changes and explain the logic behind them:
- Previously, our Player Support team reviewed every Tribunal case before approving punishments and pardons. After reviewing the past 12 months of data, we’ve seen that cases that are unanimously pardoned or punished tend to be extremely accurate—Player Support rarely overturns these decisions. In light of this data, we’re now going to focus our attention on the cases that are more ambiguous—the slight majorities and split decisions. This should improve The Tribunal’s accuracy by focusing on the cases that need the most attention.
- We’ve tweaked how The Tribunal builds cases: Instead of 100% random sampling, The Tribunal will attempt to find the games that ultimately sent each player to The Tribunal. By selecting recent games that had a big impact in sending the player to The Tribunal, you should see the average number of reports against a player increase per game.
- The Tribunal system is a constant balance between speed and accuracy. In the past, we were concerned that forcing The Tribunal to find more games per case meant that toxic players were left unchecked for longer than necessary. However, we realize that more information for our judges means more accurate verdicts, and recent optimizations have allowed us to change The Tribunal so that every case will have at least two games to review instead of one.
- Players have often said they forget how many cases they’ve done on a given day—we’ve added a progress bar that will outline how close you are to maxing out your daily case limit.
These changes are already live, so go check them out and let us know what you think! We’re confident that these changes will improve the accuracy of The Tribunal system without compromising on speed.
Visit the Tribunal today and help us make a difference in the community!
