Archive / Prediction markets / E816
Film-score long shots showed no sign of overpricing
Buying NO on film-score contracts priced 3 to 40 cents for YES, a day before settlement, lost 11.3 cents per contract after costs on 14 films; the interval (-29.8 to +6.1 cents) cannot rule out either sign.
A US event-contract exchange lists contracts on a film's critic score, such as "score above 80", on the Monday after release. The idea tested: fans overpay for the high-score side. We bought the opposite side (NO) 24 hours before settlement whenever the YES price was between 3 and 40 cents. Only 28 films had settled contracts available, and 14 films produced a qualifying trade. The 15 trades lost 11.3 cents per contract after spread and fee. NO won 80% of the time but cost 91 cents on average. The interval, -29.8 to +6.1 cents, is far too wide to call the effect zero.
The idea tested: fans overpay for the high-score side of film review score contracts, so the YES side of high thresholds is overpriced.
Why people believe it
The belief is that fans of a film expect a high critic score and buy YES on the high thresholds without checking how rarely a score clears them. If so, high-threshold YES contracts would trade above their true chance, and the opposite side would collect the difference.
Why it would persist The argument, as stated before testing
The belief is that the contracts are many, settle every week and draw small retail stakes, so a professional trader may not find it worth the effort to correct each one.
Each film has a ladder of contracts: "score above 60", "above 70", and so on, settled on the Monday after wide release from the aggregator's published score. 24 hours before settlement we looked at the bid and ask of every rung. Where YES cost 3 to 40 cents (the long-shot side) we simulated buying NO at the price a taker would pay and holding to settlement. We counted the exchange fee. We also compared prices with outcomes in broad price bands, without a trading rule, using the mid price (the midpoint of bid and ask). Intervals are "film-clustered": each film counts as one unit, because the contracts of one film share one score.
At least 40 distinct films, mean net at least +1.5 cents per contract, film-clustered bootstrap 95% interval lower bound above 0, mean above 0 without the 3 best films, and the same sign in both chronological halves.
Any pass condition not met.
Net per contract = 1 if the result is NO, minus the NO price, minus the exchange taker fee 0.07 x series multiplier x p x (1 - p), with p the NO price.
No trading control. A descriptive calibration table compares the YES mid price with the outcome in five price bands, at 24 hours and at 72 hours before settlement (the release Friday).
Only 14 films produced a trade, not the 40 required; the mean after costs was -11.3 cents, and the interval (-29.8 to +6.1 cents) does not exclude zero.
- 28 films had settled contracts; 15 contracts from 14 films met the rule (YES ask 3 to 40 cents, spread at most 10 cents).
- Buying NO lost 11.3 cents per contract after spread and fee, with a film-clustered 95% interval from -29.8 to +6.1 cents.
- NO won 80% of the time, while the average NO price was 91 cents. The NO side did not win often enough to cover its price, so the long-shot side showed no sign of being overpriced in this sample.
- In the calibration table at 24 hours, all 10 contracts priced 70 to 90 cents and all 29 priced 90 to 100 cents (17 films) resolved YES. At the cells' own average prices, 10 of 10 would happen about 8% of the time and 29 of 29 about 44% (approximate, from 0.78^10 and 0.972^29), so both are consistent with ordinary chance; the comparison is gross of spread and fee and has no trading rule.
- At 72 hours before settlement, prices were within sampling error of outcomes in every band.
No sign the long-shot side was overpriced
Mean net result of buying NO on contracts priced 3 to 40 cents for YES, after spread and fee, with a film-clustered 95% interval. The pass bar was +1.5 cents with the interval above zero; the interval spans zero because only 14 films qualified.
Chart data (cents per contract)
| Mean | 95% low | 95% high | |
|---|---|---|---|
| Buy NO, 24 h before settlement | -11.3 | -29.8 | 6.1 |
NO won less often than it cost
How often the NO side won against the average price paid for it, on the 15 contracts. The price (0.91) is above the win rate (0.80), the gap behind the -11.3 cents.
Chart data (share / price in dollars)
| Value | |
|---|---|
| NO hit rate | 0.8 |
| Average NO price paid | 0.91 |
Far fewer films than the rule required
Films with settled contracts, films that produced a qualifying trade, and the number the pass rule required.
Chart data (films)
| Films | |
|---|---|
| Required by the pass rule | 40 |
| Films with settled contracts | 28 |
| Films with a qualifying trade | 14 |
Why it failed Interpretation · not established
The sample was too small to say much: 14 films and 15 contracts, with an interval wider than the effects usually looked for. What it does show is that the opposite side lost money, so the belief that fans overpay did not appear in this sample. Prices on these ladders were within sampling error of outcomes at 72 hours.
Lesson
A pre-set sample size is part of the rule: a market with a short history of settled contracts cannot produce 40 independent events, and a result from 14 can be killed by its mean without proving that no mispricing exists. A spotless record such as 29 of 29 is also ordinary chance at those prices, so it says little about a rare miss.
Scope of this result
Covers settled critic-score contracts of one US event-contract exchange available through October 2026 (28 films), the quotes 24 hours and 72 hours before settlement, and a taker strategy held to settlement. It does not cover audience scores, films whose contracts were archived, or any quote outside the hour candles used.
A rejected experiment applies to the tested conditions and does not prove an idea can never work. bp = basis point, 0.01%.
1. Test design
Pre-registeredDataUniverseSignalExecutionCostsControlsSample splitPass criterionKill criterionPower2. Result
ObservationsInstrumentsNet mean95% intervalMedianWorstFinding 1Finding 2Finding 3Finding 4Finding 53. Interpretation
Why it failedLessonScope4. Reproducibility
StepsGrade