Evaluating strategies

This is a discussion on Evaluating strategies within the Trading Systems forums, part of the Methods category; Hi all, I am opening this thread because I want to build up a constructive discussion of how people evaluate ...

Reply
 
LinkBack Thread Tools Search this Thread
Old Nov 19, 2016, 12:10pm   #1
Joined Oct 2015
Evaluating strategies

Hi all,

I am opening this thread because I want to build up a constructive discussion of how people evaluate their trading strategies, wether they are manual or automated strategies.

The reason I bring this up, is that I recently started toying with some automated strategies and want to figure out how I can analyze the results coming out of a backtest better. I am building a spreadsheet for this purpose and I'm looking for improvements. Just curious how you guys tackle this problem.

I've attached snaps of the spreadsheet. It's WIP, since I need to add a whole list of things (including changing winners to green and losers to red in the chart hehe).
Attached Thumbnails
dashboard.jpg   trading-times.jpg  
Belligerent_Drunk is offline   Reply With Quote
Old Nov 19, 2016, 2:46pm   #2
 
malaguti's Avatar
Joined Nov 2009
Quote:
Originally Posted by Belligerent_Drunk View Post
Hi all,

I am opening this thread because I want to build up a constructive discussion of how people evaluate their trading strategies, wether they are manual or automated strategies.

The reason I bring this up, is that I recently started toying with some automated strategies and want to figure out how I can analyze the results coming out of a backtest better. I am building a spreadsheet for this purpose and I'm looking for improvements. Just curious how you guys tackle this problem.

I've attached snaps of the spreadsheet. It's WIP, since I need to add a whole list of things (including changing winners to green and losers to red in the chart hehe).
I generally have an overview and all the detail behind it. I dont think there is too much difference in what you are calculating and what I get..
largest win, largest loss, average win/loss etc
Hit rate, length in trade etc are all important, along with largest drawdown

the equity curve itself is often misleading, as you will rarely if ever be able to trade every signal given. Its all dependent on your allocation of capital at the time.
stats of course are also misleading for the same reason above, however it helps at least identify what to look at, and factors affecting these.

not sure if this is what you were after
Attached Thumbnails
overview.jpg   detail.jpg  
malaguti is offline   Reply With Quote
Old Nov 19, 2016, 3:14pm   #3
Joined Oct 2015
Belligerent_Drunk started this thread
Quote:
Originally Posted by malaguti View Post
I generally have an overview and all the detail behind it. I dont think there is too much difference in what you are calculating and what I get..
largest win, largest loss, average win/loss etc
Hit rate, length in trade etc are all important, along with largest drawdown

the equity curve itself is often misleading, as you will rarely if ever be able to trade every signal given. Its all dependent on your allocation of capital at the time.
stats of course are also misleading for the same reason above, however it helps at least identify what to look at, and factors affecting these.

not sure if this is what you were after
Yeah this is kinda what I was looking for. But do you for example look at trading time? To see what times work best for the strategy, or if it perfoms during news releases etc or during low volatility periods.

And do you have certain benchmarks for types of strategies?
Belligerent_Drunk is offline   Reply With Quote
Old Nov 19, 2016, 3:23pm   #4
 
malaguti's Avatar
Joined Nov 2009
Quote:
Originally Posted by Belligerent_Drunk View Post
Yeah this is kinda what I was looking for. But do you for example look at trading time? To see what times work best for the strategy, or if it perfoms during news releases etc or during low volatility periods.

And do you have certain benchmarks for types of strategies?
actual times, no. with regard to best times for the strategy I would test under up trend only, down only and then build an adaptive trend filter to recognise market and sector state.
also was the relative strength against the broader market

the only benchmark i have is the base strategy without any filters mentioned above
so basically I might start with no trend filter, gradually build components into the strategy
then throw in a neural network to possibly identify other variables.
I rarely use a NN to trade off though, but just identify additional criteria
Also I never optimise
malaguti is offline   Reply With Quote
Old Nov 19, 2016, 7:25pm   #5
Joined May 2016
What about testing on out of sample and across multiple instruments, if that provides good results then you 'probably' have something.
Signalcalc is offline   Reply With Quote
Old Nov 29, 2016, 3:55pm   #6
 
1 Posts
Joined May 2014
Hi everyone,

Going back to the initial post… it is a very important discussion…. because strategy evaluation is a huge big subject.

Well, here you have my two cents…

I believe that the evaluation should start even before we get the first simulation results. I mean, we need to make sure that the logic behind the strategy is sound and that it has a good chance of holding up in the future. Then we also need to make sure our historical data is complete and clean. You know, the results won’t matter if we start with shaky logic and bad data.

After these initial steps, and still before we even start coding our strategy, we need to focus on real-time data and execution details. Here we need to make sure that it is possible to get the data we need, when we need it, and that it is possible to reasonably execute the trades as soon as we get our signals.

Then we still have to crunch all strategy stats, etc…
RicardoRibeiro is online now Commercial web site   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Similar Threads
Thread Thread Starter Forum Replies Last Post
Evaluating NIFTY 50. shakeel ahmed Trading Journals 6 Dec 18, 2015 4:38pm
Actionable advice for evaluating biotech ETFs Darun Educational Resources 1 Oct 5, 2015 2:16pm
Evaluating the efficienсy of the ATC 2010 participants' strategies Lenar Forex 0 Nov 3, 2010 3:13pm
Conducting and Evaluating a Forward Test selfmade Trading Systems 4 Jul 28, 2009 8:23pm
discretionary strategies vs systematic strategies trendisyourfriend First Steps 5 Aug 19, 2008 12:54am

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)