Reading Results Without Fooling Yourself

    Module 17 · Lesson 3 of 3

    Reading Results Without Fooling Yourself

    18 min readUpdated

    Interpret a complete set of backtest results, distinguishing which metrics indicate genuine edge from which indicate noise.

    Goal

    Develop the skill of reading a full backtest results report and making an informed go/no-go decision for forward testing.

    Mistake This Prevents

    Seeing 55% win rate and 1.8 profit factor, deciding the strategy is "good enough," and deploying it live without noticing the maximum drawdown is 35%, which would likely cause you to abandon the strategy during the drawdown.

    Profit Factor: The Most Useful Summary MetricProfit Factor = Total Gains ÷ Total LossesCombines win rate AND average R:R into a single numberProfit Factor = 2.0, GOODPF 2.0For every ₹1 lost, you earn ₹2Total gains = ₹2,000Total losses = ₹1,000Strategy keeps ₹1 for every ₹1 lostProfit Factor = 0.8, LOSINGPF 0.8For every ₹1 lost, you earn only ₹0.80Total gains = ₹800Total losses = ₹1,000Strategy loses ₹200 for every ₹1,000 risked
    Profit factor is the single most useful backtest summary metric because it combines both win rate and average R:R. A profit factor of 2.0 means for every rupee lost, the strategy earns two. Anything below 1.0 is a losing strategy. Target a minimum of 1.5 before considering live deployment.

    Core Concepts

    The Seven Metrics and What Each Tells You

    1. Total Trades

    • < 30: Results are statistically unreliable (too few)
    • 30–100: Reasonable but low confidence
    • 100+: High statistical confidence Guideline: Never deploy based on fewer than 30 trades.

    2. Win Rate

    • Context-dependent: A 40% win rate with 3:1 average winner is profitable; a 60% win rate with 0.5:1 average winner is not.
    • More useful when combined with average winner R.

    3. Average Winner (R)

    • R = ratio to stop distance. Average winner of 2.0R means winners average 2× the stop distance.
    • Target: Average winner R × win rate > Average loser R × loss rate

    4. Profit Factor

    • The single most useful summary metric
    • Acceptable: 1.2–1.5
    • Good: 1.5–2.0
    • Excellent: 2.0+
    • Below 1.2: Strategy barely profitable, and transaction costs and slippage may erase it

    5. Maximum Drawdown

    • The hardest metric to handle emotionally in live trading
    • Ask: "Could I hold through this drawdown in real life without abandoning the strategy?"
    • If the answer is no, the strategy is not suitable for you regardless of long-term performance

    6. Maximum Consecutive Losses

    • Determines your Level 2 and Level 3 risk framework triggers
    • If the backtest shows 7 max consecutive losses, your 5-loss Level 3 trigger will fire frequently. Is that sustainable?

    7. Sharpe Ratio

    • Return relative to volatility. > 1.0 = good risk-adjusted return; > 1.5 = excellent
    • Less commonly used for simple crypto strategies but valuable for comparison

    The Go/No-Go Decision Proceed to forward testing if ALL of the following:

    • Trades ≥ 30
    • Profit factor ≥ 1.3
    • Max drawdown ≤ 25%
    • Positive performance in both bull and bear market phases
    • Walk-forward efficiency ≥ 0.5
    5-Criteria Go / No-Go Decision✓1. Profit Factor > 1.5Strategy earns substantially more than it loses✓2. Max Drawdown < 20%Psychologically survivable losing streak✓3. Minimum 50 trades in sampleStatistical significance threshold met✓4. Profitable across both bull and bear regimesStrategy not limited to a single market phase✓5. Walk-forward efficiency ratio > 0.7Parameters generalise beyond training dataALL 5 CHECKEDGOANY UNCHECKEDNO-GO
    All five criteria must be satisfied before proceeding to forward testing. One criterion failing is a no-go, not a warning. The framework prevents deploying strategies with statistical insufficiency, single-regime bias, excessive drawdown risk, or parameter fragility.

    Checklist

    • All seven metrics calculated and recorded
    • Go/no-go decision documented with specific metric values
    • Maximum drawdown assessed for personal psychological tolerance

    Common Mistakes

    • Making go/no-go based on win rate alone
    • Not assessing max drawdown against your own psychological tolerance
    • Not checking performance across market phases

    Fedha Tool Tie-in

    FedhaAcademy's results report displays all seven metrics with colour-coded thresholds (green/yellow/red) and an automatic Go/No-Go recommendation with the specific failing criteria highlighted.

    Key takeaways

    What to remember

    1. Profit factor is the single most useful summary metric, because it combines win rate and average R:R.
    2. Maximum drawdown must be assessed for personal psychological tolerance, not just the absolute number.
    3. The Go/No-Go decision requires all five criteria, not just one or two.
    4. Below 30 trades: the results are statistically unreliable regardless of how good they look.
    Lesson quiz

    Quiz

    Question 1 of 15

    Pass: 11 of 15 correct

    Question 1 of 15

    Backtest shows 65% win rate but profit factor of 0.95. The strategy is:

    Keep your place

    Save this lesson and continue tomorrow.

    Create an account to mark lessons complete, build a daily practice streak, and use paper trading with $10,000 in virtual capital.

    Free forever No card required Continue from any device

    Up Next

    What a Paper Bot Is, and Coding Your Rules

    Continue