CKWParticipant
Veteran
If I understanding the most recent variable from WFA report, it does not include the market behaviour between 30/7/18 – 9/1/19.
30/7/18 – 9/1/19 is an OOS period, so variables set / optimised in the IS period (27/11/17 to 30/7/18) are applied (without any further optimisation) to prices in the OOS period.
Hope that helps?
Agreed but my doubt is the variable to be used on live (i know this has been asked for many times). Let me illustrate it for better understanding.
I read the WFA related Guideline / Post from this forum that we should use the most recent variable from WFA analysis (which is variable C). But this is contradict with my understanding of WFA result-> “In order to have a similar gain as shown in historical OOS (s), I should find the best performance variable from last 8 months of data (from today) and use it on the next 5 months. After 5 months, i must repeat this process.”
If i use variable C to live, this meant i am expecting variable C will work for 10 months (OOS(3) + Current Live). This is the main doubt i have when i started to apply WFA for my systems. By the way (from my observation), i don’t expect a good system to have major change from variable C & variable D. If it does, it’s risky for me.
i think this is somehow related to conclusion from Gianluca: “In this little confrontation of those strategies my conclusion are that the atomatic algos doesn’t need a too long and overfitted optimizazion but they nee a constant an monitorated update every 6 months”.
May i have your opinion, shall we use variable C for live or variable D? (if variable C & why?)
br,
CKWParticipant
Veteran
I think Variable value D is more logical?
Yes. It’s more logical. But from Nicholas guideline, he recommended variable C if I am not wrong. Hope to get his view
But isn’t your 5 month OOS arbitary anyway … simply because you chose 3 Repetitons of the WFA?
Should there not be more iterations of the WFA (with, for example 5 WFA Repetitons) in order to determine the most logical period to reoptimise? (I’m not saying I do all this … just what we should do! )
For sure we should always pick best WFA result among different level of repetitions (5 which is the max for my platform), I got 3 repetitions w best perf for above example. This example was simulated based on 30m time frame, WFA 70%/30%, 100k bars so 5 months OOS.
br,
Nicholas guideline, he recommended variable C if I am not wrong
I would only go with Variable Value C (most recent IS period) if the period looked typical as far as price movement / fluctuations.
For example if there was a massive spike or fall then I would not use Variable Value C on Forward Test as the optimiser will have chose best value for Variable C to give max profit for that (not typical) most recent IS period and so likely will not give the best performance going forward.
Also to then further optimise over the period including the most recent OOS period and so end up with variable values for (your) period D has to better than period C alone (more data from very recent) … provided of course that the variable values don’t differ wildly from period C WFA optimisation values.
In my opinion … there will always be a element of subjective judgement when deciding on which IS period WFA optmisation values to go forward with and Nicolas recommendations are for guidance and not rigid adherence?
Please feel free to offer alternate views anybody?
CKWParticipant
Veteran
I would only go with Variable Value C (most recent IS period) if the period looked typical as far as price movement / fluctuations. For example if there was a massive spike or fall then I would not use Variable Value C on Forward Test as the optimiser will have chose best value for Variable C to give max profit for that (not typical) most recent IS period and so likely will not give the best performance going forward. Also to then further optimise over the period including the most recent OOS period and so end up with variable values for (your) period D has to better than period C alone (more data from very recent) … provided of course that the variable values don’t differ wildly from period C WFA optimisation values.
Agreed. It’s Case by case. .
In my opinion … there will always be a element of subjective judgement when deciding on which IS period WFA optmisation values to go forward with and Nicolas recommendations are for guidance and not rigid adherence?
no, no, Nicholas recommendation is perfect. This discussion is just counter check if anyone doing the same or advice not do it
no, no, Nicholas recommendation is perfect.
Wow not even a smiley there, @Nicolas has to see this! 🙂
Use variable D for the next live trading period. Through different topics and explanations about WFA across the website, I might have made a confusing English explanation somewhere, let me know where and I’ll fix it 😉
CKWParticipant
Veteran
It’s clear now. Thanks Nicholas !
