In sample/Out of sample of live strategies inside!

Forums ProRealTime English forum General trading discussions In sample/Out of sample of live strategies inside!

Viewing 9 posts - 16 through 24 (of 24 total)
  • #69451

    @Jebus: I actually think you are wrong. Seeing the performance on all data before you are finished with the algo will give you an impression of what might work and what not and you will (even if it is subconsciously) adapt the strategy accordingly.

    #69454

    If the strategy looks like the one in the picture, i throw it away 10/10 times.

    I never throw anything away! 🙂

    As that looks to be a very steep gain over the IS period then surely you just need variable / parameter  values that are less IS curve fitted so that gain is good over the whole period? Then Forward Test on Live Demo for a month or two or three?

    Do you ever optimise using the PRT Walk Forward tool over 5 x IS and 5 x OS periods? It can be very revealing and useful.

    #69455

    @Jebus: I actually think you are wrong. Seeing the performance on all data before you are finished with the algo will give you an impression of what might work and what not and you will (even if it is subconsciously) adapt the strategy accordingly.

    But if you have 50% of the data and u make system A that looks decent enough to work with.
    Ur gonna start optimizing that on the 50% of the data and then when ur done u check on 100% to see whats gonna happen.

    That same System A, whether its made on 10%, 20% 80% or 100% of the data, if u make it the same way, with the same variables, it wont matter at all, because its the same exact code?

    Let me also go through my process of making strategies

    Part 1: “The trade”
    I cherry-pick a fantastic piece of data (I choose a wonderful perfect trade setup in the chart) and i create my strategy based on that single trade. (this is like >1% of the data)
    If i get a good entry/exit and it dosnt look like shit just before/just after that trade, i check the 100% of the data. If it all looks good on the 100% i go into part 2 (i dont wanna spend hours optimizing and fixing my strategy if it looks like shit in 100%.. i dont wanna polish a turd, if u get what im saying..)

    Part 2: “The optimization”
    I pick 30-50% of the data (usually the first 30-50% of the data provided) and i optimize that system, everything thats going into the code is already in there, i just optimize the variables from say RSI 14 to RSI 12..

    Part 3: “The flippening”
    I call this the flippening cus its when i flip my optimized system, onto 100% of the data to see what happens.

     

    I guess ur right that im gonna have a bias that says “This might work”, but i wouldve had that bias if i had only the 50% data to check.. i would never optimize an entire system based on data worth 1 trade. Does this make sense?

     

    @Grahal MAYBE you could take the system and start tweaking and forming it into something that might work.. but in my eyes i have already curvefitted that system, and its not robust at all. To make it more robust i would have to “fit the model” again, but it is already fitted for 50% and turned out as not robust at all..

    This to me is a big red flag and optimizing this even more would seem like a very dangerous thing to do!

    “Anyone can make money in the markets, but only the very best is able to keep that money” – Someone

     

    Meaning i would rather be safe then sorry! And curvefitting in this game is suicide! Better to stay away is my philosophy

    Edit 2: @Despair when i optimize the strategy i only optimize with variables within a short range from the original values. (If i used RSI 14 for my code i wont ask for RSI between 2-100, i would ask for RSI between 11-16 just to check if its much better or much worse when i change some values up/down.

    #69456

    I cherry-pick a fantastic piece of data (I choose a wonderful perfect trade setup in the chart) and i create my strategy based on that single trade.

    Aha I think I’m right in saying this is the first time you have said that?

    Interesting method!

    #69457

    i have already curvefitted that system, and its not robust at all.

    But maybe you have curve fitted for a trend and then price level reaches / consolidates in  a plateau / base / range (or vice versa) and so your System has no place in that structure?

    If you were to add filters to prevent trades during market structures that your System is/ was not designed for then you may not throw so much shit away  (you may in fact be throwing the baby out with the bathwater! 🙂 🙂 )

    That’s why I never bin anything as I can always come back later with fresh eyes / knowledge??

    #69458

    I cherry-pick a fantastic piece of data (I choose a wonderful perfect trade setup in the chart) and i create my strategy based on that single trade.

    Aha I think I’m right in saying this is the first time you have said that?

    Interesting method!

    This might be the first time im saying this!

    When i go into “creation mode” i usually think about 1 way to get money out of the markets, be it a trend following thought, or a mean reverting plan. (for me its trend following 9/10 times, “sadly” hehe would love more diversification for my systems..)

    So i think about “how can i enter the start of a good trend as early as possible, and how can i exit as close to the “top of the trend” as possible? without taking too many false signals/bad trades.

    So i dive into the chart at any random point of time, and i search for a trade i would consider a great trade, a very fine looking “swing up” or whatever. Then i just create something out of my theory to match that 1 spesific trade, and as i said, if it dosnt look like shit just before/after that trade is done, i check 100% and if its not a big fat turd, i go into part 2 and optimize!

     

    And yes ofc i do walk forward leaving all/most of my variables up for change, and im looking for good walk forward % (between 60-100%) and i look at the variables chosen for each period, obviously wanting them to be as close to my optimized values as possible.

     

    Edit: “But maybe you have curve fitted for a trend and then price level reaches / consolidates in  a plateau or base and so your System has no place in that structure?” If i have optimized a system for 10 years (as i had in that example) and it looks like shit the next 10 years (out of sample) then i have curvefitted the strategy too hard on the first 10 years. This is obvious. MAYBE i could go back to other values, MAYBE i could fit the model for ALL the data, MAYBE im drowning a baby hehe… BUT if it looks good on 100% then im gonna be confident that its more robust. Confidence is key. If i tkae a curvefitted strategy and start to well.. curvefit it some more, im not gonna be as confident and im probably gonna turn that strategy off during the drawdowns…

     

    Maybe this is just me hehe

    1 user thanked author for this post.
    #69465

    @GraHal I think that if you optimize a strategy and it turns out to be curvefitted then your strategy might be shit  but if u optimize and the OOS is good, then that means ur strategy might be something robust.

     

    I like to stress-test my algos. If its robust it should work (profitable, not beautiful) on other timeframes and other similar markets. Ive included the 1h DAX strategy “Poirot” on other markets and timeframes. A couple of hard tests are Italy and Spain index. They have seen some SHIT lol. If its profitable and OK-looking in other markets, on other timeframes, i feel like the foundation of the system is not curvefitted. (i wouldnt trade it on the other markets, unless i fitted it for that data and it would as good as the original.. DAX index is worth like 12K and Wall st is worth like 25K (the index i mean), so a stop loss 60 pips might not be a good stop loss in every market.. BUT if its ish-similar and profitable, then my foundation would not be shitty (i think and hope)

     

    As i said, all the EQ curves in the photo is the EXACT SAME algo optimized for 1h dax.

    1 user thanked author for this post.
    #69471

    Nice job Jebus!

    Wasn’t too long ago you joined our beautiful forum, and all help i’ve given you, seems to have given some sort of reward!

    Nice to see son, keep it up! 🙂

    #69474

    Nice job Jebus!

    Wasn’t too long ago you joined our beautiful forum, and all help i’ve given you, seems to have given some sort of reward!

    Nice to see son, keep it up! 🙂

    Nice joke lol.

Viewing 9 posts - 16 through 24 (of 24 total)

Create your free account now and post your request to benefit from the help of the community
Register or Login