Optimize Report – feature request

Viewing 3 posts - 1 through 3 (of 3 total)
  • Author
    Posts
  • #147564 quote
    Maz
    Participant
    Veteran

    Sorting optimisation results by overall gain makes little sense, not least because overall resulting gain may have resulted randomly. Similarly, sorting by number of trades, or by hit rate alone gives little benefit. These are not metrics one would use to make choices based on strategy “robustness” or risk management considerations.

    Sadly, there is no ability to add custom fields to this list, fields which may directly correlate between their value and the robustness or reliability of a strategy. One would have to screen shot the window, export it to an OCR tool, dump the results in excel, and attempt to derive meaningful metrics from a limited set of fields.

    I would like to see alpha (α) and beta (β) fields in the optimize report, along with sharpe ratio and sortino ratio in particular, to help determine not “where the backtest ended up“, but “how it got there“, which is obviously the most important factor.

    1. How did the equity curve compare to a straight line between the start and the end?
    2. How did the equity curve compare to the underlying instrument’s returns in the same period?

    These calculations are used to measure real world fund performance, particularly against a benchmark (or underlying instrument) and tell you how smoothly, or with what volatility the results were produced. Was the theoretical equity curve chaotic, volatile, or predictable? Gain, number of trades, and hit rate do not tell you that alone.

    This feature (custom fields, and above mentioned ratios) would allow PRT back testing features to be taken more seriously.

    #147567 quote
    Nicolas
    Keymaster
    Master

    Are you still using v10.3?

    #147570 quote
    Maz
    Participant
    Veteran

    Hello Nicolas, long time, hope you are well.

    v10.3 in this case. I see v11 offers graphical 2d/3d representation, and the following fields:

    • Gain
    • Nbr positions
    • % Winning positions
    • Max drawdown
    • Max runup
    • Average gain per position

    …which is of course better than 10.3…

    I beleive the ratios mentioend above would be very helpful, and the ability to add custom fields, from various statistics. As a bonus, the ability to add fields with formulas derrived from other stats would be fantastic, a bit like a spreadsheet (in lieu of an export function) – for example, “=Nbr positions * %Winning positions”.

    Do you have a preferred method of determining which backtest variable combination produces the best curve, not the best gain, using the tools available?

Viewing 3 posts - 1 through 3 (of 3 total)
  • You must be logged in to reply to this topic.

Optimize Report – feature request


Platform Support: Charts, Data & Broker Setup

New Reply
Author
author-avatar
Maz @eqmaz Participant
Summary

This topic contains 2 replies,
has 2 voices, and was last updated by Maz
5 years, 4 months ago.

Topic Details
Forum: Platform Support: Charts, Data & Broker Setup
Language: English
Started: 10/16/2020
Status: Active
Attachments: No files
Logo Logo
Loading...