Ensuring statistical significance when optimising intra-day systems

Viewing 4 posts - 1 through 4 (of 4 total)
  • Author
    Posts
  • #184399 quote
    borderlineJim
    Participant
    Senior

    If optimising over 200k bars: what amount of trades would be considered statistically significant?

    How many trades are required to ensure robustness testing is effective?

    Obviously a few hundred trades is not going a good indication of well a startegy performs in the future.  When traditional WFA is taken into consideration, using 5 iterations for example ( IS and OOS), this means even less trades are utilised for extracting optimial parameter values.  I’m struggling to find answers…

    Are there any ways to increase statistical significance that experienced traders use ( for example, testing on different markets, adjusting parameter ranges to check for ‘sensitivity’ etc etc)

    thanks

    Jim

    #184414 quote
    nonetheless
    Participant
    Master

    this is worth a look if you haven’t seen it already:

    Strategy Robustness Tester

    borderlineJim thanked this post
    #184838 quote
    borderlineJim
    Participant
    Senior

    ahhh interesting!

    May be just what I am looking for.  Thank you Sir!!

    #184843 quote
    nonetheless
    Participant
    Master

    this is the version that most people seem to use: #106992

    then you need the excel template to analyse the results: #107211

    be sure to read all the instructions as it’s a bit fussy, but worth it once you understand how it works and what it’s doing.

    borderlineJim thanked this post
Viewing 4 posts - 1 through 4 (of 4 total)
  • You must be logged in to reply to this topic.

Ensuring statistical significance when optimising intra-day systems


ProOrder: Automated Strategies & Backtesting

New Reply
Author
Summary

This topic contains 3 replies,
has 2 voices, and was last updated by nonetheless
4 years, 1 month ago.

Topic Details
Forum: ProOrder: Automated Strategies & Backtesting
Language: English
Started: 01/03/2022
Status: Active
Attachments: No files
Logo Logo
Loading...