How To Identify Overfit Trading Strategies

In this post, we describe the main features and behaviours of overfit trading strategies, and the risks they pose to both traders and DARWIN investors.

Overfit trading strategies typically perform well in backtesting environments, creating the illusion that they exploit the market inefficiency being targeted, really well.

However, when deployed in a live trading environment, their performance is disproportionately different to what was observed in backtesting, due primarily to their modeling historical data too closely.

This prevents such strategies from generalizing well to unseen data in future, to the detriment of both the traders (launching them live with capital) and DARWIN investors (backing them with capital).

For your convenience, this post is organized as follows:

Types of Overfit Trading Strategies

Typical Features & Behaviours

How Traders Can Address Overfitting

How Investors Can Avoid Overfit DARWINs.

Types of Overfit Trading Strategies

We can generalize them into two main categories:

Model-focused – where the strategy fits historical data too closely, and exhibits high variance when tested on unseen data.

Risk-focused – where the performance of a weak model is compensated for with an unrealistic, loss averse risk management rationale.

In the former (model-focused), a trading strategy will typically perform very well in backtesting, but either stagnate for lengthy periods of time (or fail entirely) in live testing.

Overfit Trading Strategies (model-focused)

From both a trader and investor’s perspective, such strategies are easy to identify visually; returns will at some point reach a point of inflexion where they no longer appear similar to historical performance.

In the latter (risk-focused), a trading strategy will demonstrate smooth, very consistent returns in backtesting as well as in live testing for a period of time, making such strategies more dangerous than the former as they are difficult to identify from looking at just returns charts.

Typical Features & Behaviours

Model-focused

It is usually quite straight-forward to identify trading strategies that overfit to historical data.

Compared to training phases in backtests, their test phases and live performance may demonstrate:

Excess stagnation,

Larger drawdowns, and/or

An overall reversal in forecast returns.

Of the 12 DARWIN investment attributes available, this behaviour is captured best by the evolution of the following:

Experience (Ex)

Performance (Pf),

Risk Stability (Rs),

Positive/Negative Returns Consistency (R+/R-),

Duration Consistency (Dc),

Capacity (Cp),

Loss Aversion (La),

Open/Close Strategy (Os/Cs).

Low scores or unstable evolution of scores in these attributes (especially in live trading) can serve as a useful indicator in identifying a strategy as being overfit in backtests or otherwise.

When a strategy is overfit to training data, the evolution of its scores for the above attributes is likely to demonstrate high variance when subjected to test data and/or in live trading.

Typically, three combinations of scores for the above attributes demonstrate consistent performance between backtests and live trading (when accompanied by High Ex, High Mc, High Rs scores):

(Low Cp | High Os/Cs | High Pf | High R-) – Once a strategy with good scores for these in the backtest is launched live, if scores for Os/Cs and R- progressively decline over time, the likelihood of the strategy being overfit increases.

(Moderate Cp | High La | High Pf) – If high scores for La and Rs progressively decline upon launching live, the likelihood of the strategy being overfit increases.

(High Pf | Very High R+/R- or Dc | Moderate La) – A strategy with this combination of scores in the backtest is the least likely to be overfit, and quite difficult to find. However, the same rules for monitoring declines in scores applies here too, when launched live.

Traders can therefore benefit from uploading trading strategy backtests to the Darwinex platform for analysis.

Examining the evolution of scores received provides a valuable layer of insight into how symmetric performance is likely to be in backtesting vs live trading.

For example, if steady evolution is observed over training data, but high variance in test data, the likelihood of the strategy generalizing well to unseen data in live trading is low.

Stable Evolution of Risk & Duration Consistency

Risk-focused

In trading strategies where loss averse risk management compensates for poor timing (and generates unrealistic returns in backtesting), one or more of the following behaviours can be observed:

Poorly timed trades are not closed for lengthy periods of time,

Additional orders are opened in the same direction as poorly timed ones in an attempt to recover the position at incrementally better prices,

Excess leverage is employed per trade in an attempt to recover losing positions at incrementally better prices.

Of the 12 DARWIN investment attributes available, this behaviour is captured best by the following:

Loss Aversion (La)

Combination of low La and high Capacity (Cp)

Risk Stability (Rs)

Market Correlation (Mc)

The evolution of scores received for these investment attributes, provides valuable insight into whether a strategy will compensate for inferior timing by employing loss averse risk management practices.

Additionally, poor scores for Rs and Mc in particular add strong confirmation that risk-focused overfitting is likely the case with a strategy.

In this article, we are going to make use of the professional trader’s calculator to find out how much capital you need to earn a 6-figure salary ($ 100,000). This may vary depending on your trading style, time horizon, leverage, the mathematical expectancy of your strategy but, above all, of an aspect that you may […]

This post sheds light on the new Capacity Management tool, designed from the ground up to give traders more control over the capital invested in their DARWINs, while offering total transparency to investors. What does a Trader need to make a living off his passion? There is no easily applicable magic formula to achieve this, […]

This post describes some of the shortcomings of the Sharpe Ratio, that render it a non-optimal tool for measuring the performance of a trading strategy. For your convenience, the remainder of this post is organized as follows: What is the Sharpe Ratio and what is it used for? Where and how does the Sharpe Ratio […]

In this post, we are going to explain the 3 main advantages of becoming a DARWIN provider. But before you start reading it, let me ask you 3 simple questions: Are you a trader? Are you even a talented trader? Do you dream of living off your trading talent but have no assets under management […]

Subscribe to our newsletter to stay up to date with Darwinex news, we promise we won’t spam you!

Email

The Darwinex® trademark and the www.darwinex.com domain are owned by
Tradeslide Trading Tech Limited, a company duly authorised and regulated by the Financial Conduct Authority
(FCA) in the United Kingdom with FRN 586466. Our Company number is 08061368 and our registered office is Acre
House, 11-15 William Road, London NW1 3ER, UK.

The Darwinex® trademark and the www.darwinex.com domain are owned by
Tradeslide Trading Tech Limited, a company duly authorised and regulated by the Financial Conduct Authority
(FCA) in the United Kingdom with FRN 586466. Our Company number is 08061368 and our registered office is Acre
House, 11-15 William Road, London NW1 3ER, UK.

This website stores cookies on your computer. These cookies are used to collect information about how you interact with our website and allow us to remember you. We use this information in ord$
Privacy Policy.

If you decline, your information won't be tracked when you visit this website. A single cookie will be used in your browser to remember your preference not to be tracked

CFDs are complex instruments and come with a high risk of losing money rapidly due to leverage.
71 % of retail investor accounts lose money when trading CFDs with this provider. You should consider whether
you understand how CFDs work and whether you can afford to take the high risk of losing your money.