A9 Predict · Track record
Does A9 actually beat the market?
What this means · Market is better
The market is better: across 1396 settled questions the market's odds were closer to what happened. A9 has no edge here yet.
The fair test is "Made at least 24h before close" . The real question is the "Researched questions" row : that is where paying for research has to prove itself against the market.
| Group | Settled | A9 | Jev raw | Market | A9 vs market | Verdict |
|---|---|---|---|---|---|---|
| All settled forecasts | 1396 | 0.228 | 0.114 | 0.226 | +0.002 (+0.000 to +0.003) | Market is better |
| Made at least 24h before close | 113 | 0.095 | 0.117 | 0.085 | +0.010 (+0.004 to +0.016) | Market is better |
| Current method (a9-predict-0.3.0) | 89 | 0.104 | 0.133 | 0.103 | +0.002 (-0.000 to +0.004) | No clear difference |
| Researched questions | 1306 | 0.237 | 0.135 | 0.236 | +0.001 (-0.000 to +0.002) | No clear difference |
| Market-efficient questions | 90 | 0.096 | 0.105 | 0.084 | +0.012 (+0.006 to +0.017) | Market is better |
Scores are Brier scores : lower is better. In "A9 vs market", a negative number means A9 was closer to what actually happened.
When A9 said...
~6%happened 3%n=30
~14%happened 3%n=32
~26%happened 17%n=29
~36%happened 32%n=104
~46%happened 45%n=453
~53%happened 52%n=590
~64%happened 64%n=101
~73%happened 91%n=32
~85%happened 87%n=15
~93%happened 100%n=10