After going almost the whole of S1 without hitting a 20, I decided to record what the dice roll in the Horn and what I am seeing is deeply disturbing.
This topic was brought up at the end of S1 but we were told that there is nothing wrong and the system used is a "pure RNG system". Well, I am here to give evidence that it is not.
Disclaimer: I am not here to argue that the system necessarily needs to change. I am not doing a comparison on the drops rates within each level of the rewards.
My point: If the system is "pure RNG" then there is a programming error. If the system is "working as intended", then the description (when hitting the !) needs to change to publish the chance of rolling any given bracket. As it is right now, this is a gambling system that could be construed as illegal in some regions of the world.
My methodology:
Both my brother and i have recorded all our rolls from about 20 days remaining in S1 as well as all the rolls done in S2 with the results averaged together. These numbers are compared to the averages of rolling 3 different physical d20's and the average of 3 refreshes of the google search random number generator. This gives a comparison to a physical die and the comparison to a different electronic RNG system.
I then split the rolls into 6 categories: 1, 2-4, 5-9, 10-14, 15-19, 20. Other than splitting the "1" off on its own, this mimics the reward brackets published in the game.
What I expect:
In a pure RNG system, each individual number has a 1 in 20 chance of appearing each time the die is rolled. This could result in all 1's or all 20's but those are statistical outliers. As the number of rolls increases, I expect that the average of rolls would get closer and closer to the following percentages:
1 - 5%
2-4 - 15%
5-9 - 25%
10-14 - 25%
15-19 - 25%
20 - 5%
These %'s match the probability of rolling in each of the ranges. (5-9 = 5 numbers therefore 5/20 = 0.25 = 25%)
TBC...