Better consistency - Estonian case study

As Estonia has been using RefPal for the longest time in Full analysis mode then it is the best league to subtract data from. The yearly comparison starting from 2019 shows a clear improvement of referees consistency year after year when it comes to theoretical knowledge.

What is the RefPal rating?
It measures the difference of the user´s answers compared to the Committee official mark. The lower the RefPal rating is, the closer the user is to the official answers. The average user rating has gotten better (gone lower) year by year since it started to be measured from the 2019 season. This shows that consistency inside the refereeing group has grown and the understanding of refereeing has become more unified.

The best of 2019 & 2020 would not have made it to the Top 20 in 2023. All seasons include 2000+ answers per user about incidents in their own leagues games. The learning takes place every round, through the whole season.

The RefPal Games module is in a way a continuous self-test which makes the users voluntarily participate in the learning process every week.