WF testing rising price indices.

Viewing 7 posts - 1 through 7 (of 7 total)
  • Author
    Posts
  • #74259 quote
    Vonasi
    Moderator
    Master

    I’ve been thinking (yes I know I probably shouldn’t) about walk forward testing following my comments here:

    Back testing strategies

    If an index steadily rises over time then the average bar range will also increase and also 1% of closing price at a higher price will obviously be bigger than 1% at a lower price. If a strategy has exits based on % of price or bar range then a walk forward test on this kind of market should see an improvement in performance with each OOS period compared to the IS as the test gets closer to the current day and price is increasing.

    We have all been taught to look for consistent results across a WF test when in reality on a rising price index we should be looking for improving results. This improving OOS performance would normally be considered a sign of possible curve fitting whereas in fact a steady improvement in line with a rising price is what we actually should be looking for if using % of price or range based exits.

    Just had to put my thoughts out there….. comments welcome.

    GraHal thanked this post
    #74313 quote
    Vonasi
    Moderator
    Master

    I thought I would provide an example of what I mean. This is a strategy on the DJI which is what i would refer to as a rising price index with a 50/50 x 5 not anchored WF test:

    [attachment file=74314]

    ….and each out of sample period gain plotted in Excel:

    [attachment file=74315]

    This in my mind is a good WF result even if we would normally be taught to consider an overall WF efficiency ratio of 200% to be a bad result and non level gains to be bad.

    Screenshot_2-7.png Screenshot_2-7.png Screenshot_3-9.png Screenshot_3-9.png
    #74319 quote
    GraHal
    Participant
    Master

    Looks all good stats to me Vonasi!

    You’re an all round genius! 🙂

    #74320 quote
    Vonasi
    Moderator
    Master

    You’re an all round genius!

    Not yet but I am working on it. It has been a very long project so far……

    #74341 quote
    Nicolas
    Keymaster
    Master

    So you only want to prove that a percentage of price exit make more profits nowadays than in the past? Sorry but I read many times your first post and I’m still not sure of what you are explaining here 😉 too much sun on my bold head I presume..

    #74344 quote
    Vonasi
    Moderator
    Master

    I’m trying to show that level OS WF gains in a market such as the DJI where prices and range historically increase are actually the sign of a failing strategy and increasing gains in each OS period is what you should be looking for. This is obviously only if the strategy has exits based on percentage of price or exits connected to range or highs and lows.

    #74530 quote
    Vonasi
    Moderator
    Master

    Another issue that we should be aware when WF testing is the inaccuracies when testing any strategy with a filter in it that stops the strategy trading in for example bear markets. This filter means that some IS and OSS periods may actually be not trading at all for large parts of the sample being tested. On these sort of strategies getting anything meaningful from WF testing can be virtually impossible.

    Here is an example also on the DJI. there are four periods where the strategy was not on the market at all and they are not of equal size or spread evenly throughout the test and so WF test results are pretty meaningless.

    [attachment file=74531]

    Nicolas and GraHal thanked this post
    Screenshot_7-2.png Screenshot_7-2.png
Viewing 7 posts - 1 through 7 (of 7 total)
  • You must be logged in to reply to this topic.

WF testing rising price indices.


General Trading: Market Analysis & Manual Trading

New Reply
Author
author-avatar
Vonasi @vonasi Moderator
Summary

This topic contains 6 replies,
has 3 voices, and was last updated by Vonasi
7 years, 7 months ago.

Topic Details
Forum: General Trading: Market Analysis & Manual Trading
Language: English
Started: 06/24/2018
Status: Active
Attachments: 3 files
Logo Logo
Loading...