Overfit
32 trend variants: the timing was real, picking the winner was not
The idea
Hold each ETF while its trend is up (price above its 200-day average, or positive 12-month momentum), otherwise cash. Variants add a market-wide regime gate, a per-fund volatility target, dual momentum (top-k by past return, with cash if it doesn't beat T-bills), and two rebalance speeds. 32 variants.
What happened
| Training years 2006–2016 | Sharpe | Yearly return | Worst drop |
|---|---|---|---|
| Best variant (200-day, vol target 10%, monthly) | 0.70 | 4.35% | 5.3% |
| SPY buy and hold | 0.41 | 7.50% | 55.2% |
| SPY at the strategy's own day-by-day invested level | 0.63 | 4.90% | 10.2% |
The best variant beat every benchmark at default and doubled costs. Costs barely mattered (0.03–0.24% a year).
The full results
All 32 variants, at default costs, on the 2006–2016 training window (2005 is warm-up for the 200-day and 252-day signals). Sharpe, yearly return and worst drop credit idle cash at the 3-month T-bill rate, the same basis as the headline numbers above. Nothing here was run on later years.
| Variant | Sharpe | Yearly return | Worst drop | Time invested | Cost drag a year |
|---|---|---|---|---|---|
| 200-day average · vol target 10% · monthly Best | 0.70 | 4.35% | 5.3% | 43% | 0.04% |
| 200-day average · SPY gate · vol target 10% · monthly | 0.69 | 4.25% | 5.3% | 41% | 0.04% |
| 200-day average · vol target 10% · every 10 days | 0.67 | 4.01% | 5.0% | 42% | 0.05% |
| 200-day average · SPY gate · vol target 10% · every 10 days | 0.66 | 3.86% | 5.6% | 40% | 0.05% |
| 12-1 month momentum · SPY gate · vol target 10% · monthly | 0.65 | 4.16% | 5.9% | 39% | 0.03% |
| 12-1 month momentum · vol target 10% · monthly | 0.62 | 4.31% | 6.2% | 43% | 0.03% |
| 200-day average · monthly | 0.60 | 5.73% | 12.2% | 62% | 0.05% |
| 12-1 month momentum · SPY gate · monthly | 0.60 | 5.43% | 11.3% | 55% | 0.04% |
All 32 variants, best first
| Variant | Sharpe | Yearly return | Worst drop | Time invested | Cost drag a year |
|---|---|---|---|---|---|
| 200-day average · vol target 10% · monthly Best | 0.70 | 4.35% | 5.3% | 43% | 0.04% |
| 200-day average · SPY gate · vol target 10% · monthly | 0.69 | 4.25% | 5.3% | 41% | 0.04% |
| 200-day average · vol target 10% · every 10 days | 0.67 | 4.01% | 5.0% | 42% | 0.05% |
| 200-day average · SPY gate · vol target 10% · every 10 days | 0.66 | 3.86% | 5.6% | 40% | 0.05% |
| 12-1 month momentum · SPY gate · vol target 10% · monthly | 0.65 | 4.16% | 5.9% | 39% | 0.03% |
| 12-1 month momentum · vol target 10% · monthly | 0.62 | 4.31% | 6.2% | 43% | 0.03% |
| 200-day average · monthly | 0.60 | 5.73% | 12.2% | 62% | 0.05% |
| 12-1 month momentum · SPY gate · monthly | 0.60 | 5.43% | 11.3% | 55% | 0.04% |
| 200-day average · SPY gate · monthly | 0.59 | 5.45% | 10.5% | 58% | 0.05% |
| 200-day average · SPY gate · every 10 days | 0.57 | 5.15% | 8.6% | 57% | 0.08% |
| 200-day average · every 10 days | 0.57 | 5.34% | 12.2% | 62% | 0.08% |
| 12-1 month momentum · vol target 10% · every 10 days | 0.57 | 4.03% | 6.4% | 43% | 0.03% |
| 12-1 month momentum · monthly | 0.56 | 5.75% | 13.7% | 62% | 0.04% |
| Dual momentum, top 5 by 252-day return · SPY gate · monthly | 0.53 | 7.21% | 18.1% | 83% | 0.13% |
| 12-1 month momentum · every 10 days | 0.53 | 5.45% | 12.5% | 62% | 0.05% |
| Dual momentum, top 5 by 126-day return · SPY gate · monthly | 0.52 | 7.18% | 16.8% | 82% | 0.15% |
| Dual momentum, top 5 by 126-day return · SPY gate · every 10 days | 0.51 | 6.76% | 16.8% | 79% | 0.24% |
| Dual momentum, top 5 by 126-day return · monthly | 0.51 | 7.26% | 26.4% | 89% | 0.15% |
| Dual momentum, top 3 by 126-day return · SPY gate · every 10 days | 0.51 | 6.69% | 15.8% | 76% | 0.23% |
| Dual momentum, top 3 by 252-day return · SPY gate · every 10 days | 0.49 | 6.22% | 16.4% | 78% | 0.21% |
| 12-1 month momentum · SPY gate · vol target 10% · every 10 days | 0.49 | 3.18% | 5.8% | 37% | 0.04% |
| Dual momentum, top 5 by 252-day return · monthly | 0.46 | 6.75% | 20.3% | 91% | 0.12% |
| Dual momentum, top 3 by 252-day return · SPY gate · monthly | 0.46 | 6.17% | 17.8% | 79% | 0.14% |
| Dual momentum, top 5 by 252-day return · SPY gate · every 10 days | 0.46 | 5.91% | 16.3% | 80% | 0.19% |
| Dual momentum, top 5 by 252-day return · every 10 days | 0.44 | 6.38% | 19.0% | 89% | 0.17% |
| Dual momentum, top 5 by 126-day return · every 10 days | 0.44 | 6.25% | 30.6% | 87% | 0.22% |
| Dual momentum, top 3 by 252-day return · every 10 days | 0.43 | 6.00% | 19.3% | 80% | 0.18% |
| 12-1 month momentum · SPY gate · every 10 days | 0.41 | 3.77% | 10.4% | 52% | 0.06% |
| Dual momentum, top 3 by 126-day return · SPY gate · monthly | 0.39 | 5.44% | 19.5% | 77% | 0.16% |
| Dual momentum, top 3 by 126-day return · monthly | 0.39 | 5.54% | 22.9% | 80% | 0.15% |
| Dual momentum, top 3 by 252-day return · monthly | 0.33 | 4.60% | 19.3% | 80% | 0.12% |
| Dual momentum, top 3 by 126-day return · every 10 days | 0.30 | 4.27% | 32.4% | 79% | 0.22% |
This search did not include a scrambled-data run. Its overfitting checks were the deflated Sharpe (0.945 against a 0.95 bar) and the probability of backtest overfitting (0.619 against the rule's 0.50 ceiling). At default costs, 18 of the 32 variants had a higher Sharpe than both matched-SPY comparisons (same invested days, same volatility).
Why it failed
The rule we wrote beforehand said the best variant must also keep the family's probability of overfitting (how often a search winner is only average later) at or below 0.50. It came in at 0.619: in 62% of re-splits, the in-sample winner landed below the later median. The deflated Sharpe was 0.945 against a 0.95 bar.
The honest reading: trend timing is real in the search years (SPY held on the same days reaches a Sharpe of 0.63 with a 10% worst drop), but the 32 versions are close substitutes, and choosing the “best” one among them is mostly noise. Per the rule, nothing went on to later years. The plain, untuned version of this idea has its own page.
Receipts: the strategy family, the sweep, and the credibility rule were written down before the run. 32 trials plus 64 cost-sensitivity runs.