Designing an honest backtest

Expert levelLevel 4 · Module 1 · Lesson 118 min read

By the end of this lesson you can

  • Write rules that a backtest can follow without judgement
  • Avoid look-ahead, survivorship and curve-fitting bias
  • Include realistic costs

A backtest applies fixed rules to historical data to estimate how a system would have performed. Done carelessly, it produces beautiful numbers that disappear in live trading.

Also in this lesson

  • The three biases that ruin backtests
  • Costs
  • In-sample and out-of-sample
  • A demo drill: Run a 100-trade manual backtest
  • A 2-question graded check
Academy plan

Continue this lesson in the Academy

The full Expert level, and every other level, is included in the Academy plan for $100, or in Deluxe for $199 with mentorship and live sessions. Start free with the Beginner course.