Trading glossaryMethodology

Out-of-Sample Testing

Out-of-sample testing checks a strategy on data that was not used to develop or optimise it, to see whether its edge is real or the product of fitting the past.

Explained

A common approach reserves the last 20–30% of data. Walk-forward analysis repeats this across rolling windows. A big drop out of sample signals overfitting.

Example

A strategy earns 25% a year in 2010–2019 (in sample) and 4% in 2020–2024 (out of sample).

The gap suggests much of the backtest was overfit.

Common mistakes

01

Peeking at out-of-sample data during development.

02

Re-optimising after a poor out-of-sample result.

03

Using too short an out-of-sample period.

Questions traders ask

How much data to hold out?

Often 20–30%, covering different conditions.

What is walk-forward testing?

Rolling optimisation and out-of-sample testing across many periods.

We (www.marketpedia.eu) and selected third parties (1) collect personal information as specified in the privacy policy and use cookies or similar technologies for technical purposes and, with your consent, for measurement and “marketing (personalized ads)” as specified in the cookie policy.

With respect to advertising, we and 1237 selected , may use precise geolocation data, and identification through device scanning in order to store and/or access information on a device and process personal data like your usage data for the following : personalised advertising and content, advertising and content measurement, audience research and services development.

You can freely give, deny, or withdraw your consent at any time by accessing the preferences panel. Your choices apply only to this domain. Denying consent may make related features unavailable.

Use the “Accept” button to consent. Use the “Reject” button to continue without accepting.