What is a good back testing period/sample size in your opinion

Viewing 6 posts - 1 through 6 (of 6 total)
  • Author
    Posts
  • #115315 quote
    J.
    Participant
    Average

    I’ve developed a strategy for the 15 minute time frame of the GBP/JPY. I back tested it on as many units as possible (100000). This gives me approximately 2 years worth of back testing data with 116 trades carried out and a 69,26% time in market statistic.

    The strategy carries out both short and long trades and the long signal has the opposite entry conditions as the short signal so that it wouldn’t matter if the market is bullish or bearish in the entire back testing period, it should be able to be profitable either way.

    Is this enough data to say something about the trustworthiness of this strategy in the Forex market, or would one need more years to back test this on to say something about that?

    PRT is great, the only thing I don’t like about it is that the data to back test on in the lower time frame models is quite limited.

    #115318 quote
    robertogozzi
    Moderator
    Master
    #115328 quote
    J.
    Participant
    Average

    Thank you Robert, do you have any information on when v11 will come out?

    #115337 quote
    robertogozzi
    Moderator
    Master

    For manual trading it is available (even for free with end-of-day data) at https://www.prorealtime.com/nl/,

    As to IG… well it depends when they will have finished updating their interface for the new version. We all hoped it would have been made available before the end of this year, but rumors say we’ll have to wait a few more months.

    I have found this youtube channel which could be of some interest https://www.youtube.com/channel/UCIu1dQIvIwVJ1K9_hVfXgTA.

    J. thanked this post
    #115461 quote
    jebus89
    Participant
    Master

    from my own experience i would say 5-10 years is alot better than 2 years.

    In theory you could make a very robust and profitable system with 1 week or 1 day data even. But I would argue that the chances that your system is actually robust and profitable in the future get smaller and smaller the less data you have! Even if you had 100% of the data it might still not be what you need to create a robust enough system for future results.

    In my opinion: More data = easier to make a robust system because you obviously have more data to look at and test against. But depending on how and what your system is trying to do, you can also test it against similar products (similar pairs f example) and get some extra “data”. But if your system is all about trading between 12.00-16.00 in eurusd, it might not be a very similar fit to test against usd/jpy for example. Something to think about.

    Also another think to have in mind is that (again my opinions only) the more trades you see in a backtest system, the less data is needed for confidence. Lets say you have a 10 year backtest with 300 trades in total, vs a 2 year backtest with 2000 trades, I would probably be looking more into the 2 year backtest than the 10 year backtest for further investigation.

    #115975 quote
    J.
    Participant
    Average

    Good point @jebus89. My strategy is on the 15 minute chart, has 113 trades for backtest and works on the GBP/JPY.

    Unfortunately I can only backtest 100k units, but Nicolas said this will go to 1M for IG users soon.

Viewing 6 posts - 1 through 6 (of 6 total)
  • You must be logged in to reply to this topic.

What is a good back testing period/sample size in your opinion


General Trading: Market Analysis & Manual Trading

New Reply
Author
author-avatar
J. @j_slowly Participant
Summary

This topic contains 5 replies,
has 3 voices, and was last updated by J.
6 years, 2 months ago.

Topic Details
Forum: General Trading: Market Analysis & Manual Trading
Language: English
Started: 12/20/2019
Status: Active
Attachments: No files
Logo Logo
Loading...