Dear Reiner,
Thank you for your positive response, appreciated! First of all, please allow me to clarify that I have no indications that Pathfinder will not be successful, rather I have some doubts that the backtest is robust, in other words that the available backtest data is too limited to be able to say anything about probabilities for future results.
What I did was this: I looked at the code and what I saw was 7 basic parts (definitions as in the code):
- Go long if signal crosses over monthly high
- Go long if signal crosses over weekly high
- Go long if signal crosses over daily high
- Go long if signal crosses over monthly low
- Go short if signal crosses under monthly high
- Go short if signal crosses under monthly low
- Go short if signal crosses under daily low
On top of that some trades are filtered using MA50 or MA250, and depending on what time of year shorts or longs are boosted (seasonality)
In order to test the core of the system, I removed all seasonality and then proceeded to make one system for each signal, meaning one system that trades signal no. 1 in the above list, then another system that trades signal no. 2, etc for all signals up to no. 7. Applicable filters (MA50, MA250) and exit parameters (max length, SL, TP) were inserted into each system. This allowed me to backtest and evaluate results for each signal in isolation. What I saw was this;
Even though the result are positive for most subsystems, for several of the subsystems there were very few positions over the entire backtest period. To me that means that in isolation it is difficult to say if the result is by chance, it is the result of curve-fitting or if it is likely to repeat. When I evaluate my own systems that I write myself, I want to see the result of at least 100 trades, in order to make my mind up if it is a trustworthy system.
The fact that all the 7 sub-systems above are based on the same smoothed signal does not in itself mean that it is likely that they will all contribute to similar results in the future. It could in fact be an advanced form of curve-fitting, and the profitability of the combination of 7 systems into one with seasonality boosting on top would then just be an illusion. My point is not that “This will not work!”, rather my point is “I do not have enough observations to draw any informed conclusions on if this combined system will generate profits going forward”. It is possible that it will work and generate positive results and it also possible that it will not. It is relatively easy to see situations where it will work less well, and even generate losses, for example in a market that is range-bound and oscillates around monthly low. How likely is that and how often will that happen? I don’t know. But it is one situation that will not suit the system, and there could be others. We just don’t have enough data to be (close to) sure.
I hope my findings may help contribute to future profits for fellow forum members. Happy trading!
Kind regards,
Wilko