Manual backtesting

This is a discussion on Manual backtesting within the Futures & Options forums, part of the Markets category; Hey guys, I am hoping that some of the members might be able to help me with a bit of ...

Reply
 
LinkBack Thread Tools Search this Thread
Old May 4, 2016, 2:42pm   #1
Joined Mar 2016
Manual backtesting

Hey guys, I am hoping that some of the members might be able to help me with a bit of a research I am doing.

I am working on a tool for manual backtesting that enables you to observe your trade in the past. What I would like to know is what are the biggest problems and obstacles that you face regarding manual backtesting right now?
runmael is offline   Reply With Quote
Old May 4, 2016, 3:24pm   #2
 
dbphoenix's Avatar
Joined Aug 2003
Quote:
Originally Posted by runmael View Post
Hey guys, I am hoping that some of the members might be able to help me with a bit of a research I am doing.

I am working on a tool for manual backtesting that enables you to observe your trade in the past. What I would like to know is what are the biggest problems and obstacles that you face regarding manual backtesting right now?
The chief difficulties that newcomers to manual backtesting encounter are (1) not knowing how to observe, (2) not knowing how to formulate a hypothesis that is based on those observations, (3) not knowing how to test the hypothesis. Unless and until one develops these skills, manual backtesting becomes chiefly an exercise in random notation and curve-fitting, and there are all sorts of biases that come into play.

Db
__________________
Trading Price
The Wyckoff Method
dbphoenix is offline Training literature vendor (e.g courses / spreadbetting guides / eBooks)   Reply With Quote
Thanks! The following members like this post: runmael , options-george , mckaldey , jjames69
Old May 4, 2016, 6:17pm   #3
Joined Feb 2002
PM sent.
Tom
tomorton is offline   Reply With Quote
Thanks! The following members like this post: runmael
Old May 8, 2016, 9:25am   #4
Joined Jan 2006
Quote:
Originally Posted by dbphoenix View Post
The chief difficulties that newcomers to manual backtesting encounter are (1) not knowing how to observe, (2) not knowing how to formulate a hypothesis that is based on those observations, (3) not knowing how to test the hypothesis. Unless and until one develops these skills, manual backtesting becomes chiefly an exercise in random notation and curve-fitting, and there are all sorts of biases that come into play.

Db
Hi dbphoenix - thanks for your post - would it be possible for you to elaborate a bit further on your three points? [if you have the time]

I am currently doing a lot of manual backtesting (in ForexTester), and am thinking I could benefit (in terms of better return from my time invested in the testing) from insights you might be willing to share.

Many thanks in advance!
__________________
Check out my FX trading blog - updated 5-8 times a month - entertaining and educational!

And for a honest look into trading, check out my T2W member profile (published Dec2015)
options-george is offline   Reply With Quote
Old May 8, 2016, 12:07pm   #5
 
dbphoenix's Avatar
Joined Aug 2003
Quote:
Originally Posted by options-george View Post
Hi dbphoenix - thanks for your post - would it be possible for you to elaborate a bit further on your three points? [if you have the time]

I am currently doing a lot of manual backtesting (in ForexTester), and am thinking I could benefit (in terms of better return from my time invested in the testing) from insights you might be willing to share.

Many thanks in advance!
The following are from my book, so there are of course references to the book. However, all that can be ignored. The process of observing and formulating & testing hypotheses is the same whether one is interested in price movement, indicators, patterns, whatever. A description of this process begins at the end of page 2 and continues through page 9. If one knows and understands the scientific method, this will be familiar territory. Otherwise, it may provide a means of becoming unstuck.

I'm also attaching something which elaborates on the topic of observation.

There is also Chapter 11 in Trading in the Zone.

Db
Attached Files
File Type: pdf Developing A Plan 2016.pdf (354.3 KB, 221 views)
File Type: pdf How To Do It.pdf (148.2 KB, 216 views)
__________________
Trading Price
The Wyckoff Method
dbphoenix is offline Training literature vendor (e.g courses / spreadbetting guides / eBooks)   Reply With Quote
Thanks! The following members like this post: options-george , runmael , mckaldey
Old May 8, 2016, 7:23pm   #6
Joined Apr 2016
Quote:
Originally Posted by runmael View Post
What I would like to know is what are the biggest problems and obstacles that you face regarding manual backtesting right now?
The biggest problem is definitely that it doesn't work. This why there are so many vendors, trainers, and tool sellers. If it works, they wouldn't have to scrape for a living from the beginners. They could just make a living from the market.
EnlightenedJoe is offline   Reply With Quote
Old May 8, 2016, 11:16pm   #7
Joined Jan 2006
Quote:
Originally Posted by dbphoenix View Post
The following are from my book....
Thanks a bunch for providing all this info dbphoenix. I'll take a good look at these materials.

__________________
Check out my FX trading blog - updated 5-8 times a month - entertaining and educational!

And for a honest look into trading, check out my T2W member profile (published Dec2015)
options-george is offline   Reply With Quote
Old May 15, 2016, 6:07pm   #8
Joined Jan 2006
Quote:
Originally Posted by options-george View Post
Thanks a bunch for providing all this info dbphoenix. I'll take a good look at these materials.


Hi again dbphoenix. I managed to work my way through your two PDF's as well as Trading in the Zone Chapter 11 during my flight to the US yesterday. Great reading - many thanks again! I think it has helped me to clarify the picture on testing to some degree.
__________________
Check out my FX trading blog - updated 5-8 times a month - entertaining and educational!

And for a honest look into trading, check out my T2W member profile (published Dec2015)
options-george is offline   Reply With Quote
Old Oct 6, 2016, 4:52pm   #9
Joined Jan 2006
Bump.

Am in the process of doing a strategy refinement - revolves around the idea of entering trades earlier than I currently do.

The first step in doing that was to come back to this thread and re-read some of the material that dbphoenix posted earlier here. It will help me to stay on the path in terms of testing and developing the refinement.

Thanks again!
__________________
Check out my FX trading blog - updated 5-8 times a month - entertaining and educational!

And for a honest look into trading, check out my T2W member profile (published Dec2015)
options-george is offline   Reply With Quote
Old Oct 9, 2016, 10:51am   #10
Joined May 2013
Quantopian has free one minute data where you can program you systems in Python and run backtests.

Also this article touches on the problem of noise in backtests when using different data and timeframes.

They plan to have futures and forex data in future so it's a good idea to start learning the platform.
Solas0077 is offline   Reply With Quote
Old Oct 16, 2016, 3:58pm   #11
 
Windlesham1's Avatar
Joined Jul 2003
please see our website-early days but we want to help http://optionsinvesting.co.uk/before...-were-options/
Windlesham1 is offline   Reply With Quote
Old May 1, 2018, 8:23pm   #12
Joined Apr 2018
A good idea is to export 1 minute data from Tradestation and copy into Excel. You now have data going back to 1997 futures ES market with 1 minute open, high, low, close. From this excel sheet you can attempt slot of analysis.

Excel for me works really well especially when volatility modelling.
Bradtex is offline   Reply With Quote
Old May 30, 2018, 7:50pm   #13
 
6 Posts
Joined May 2018
Home Made Software

Spend 30 year trying to write software like I Did. You can do it in Visual Basic
create a data Type with technicals like RSI And Stochastics associated with each plot
which you can screen at any point. Attach is a screenshot of my option software
which can backtest on about 5 different technical one after another in seconds from 1 to 180 days
CajunFarmer is offline   Reply With Quote
Old Jun 12, 2018, 11:25am   #14
Joined Apr 2018
Quote:
Originally Posted by CajunFarmer View Post
Spend 30 year trying to write software like I Did. You can do it in Visual Basic
create a data Type with technicals like RSI And Stochastics associated with each plot
which you can screen at any point. Attach is a screenshot of my option software
which can backtest on about 5 different technical one after another in seconds from 1 to 180 days
Don't do what this guys did, don't waste time developing your own software - there is plenty of retail software which can be used and if you want complex functions they can be created with .NET version of Multicharts or even NinjaTrader.

These guys who want to create their own software do not want to trade and make money, they simply want to feel intellectually validated and create software. Having great software is not going to make you find an edge.

Manual backtesting is not a great idea, the same time could be spent learning to code. However, if you don't want to do that then use excel.
Bradtex is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Similar Threads
Thread Thread Starter Forum Replies Last Post
Has anyone tried marketsmastered.com manual? FactualVinay First Steps 78 Jul 12, 2013 11:40pm
Manual Stuff Hotch Trading Journals 12 Aug 25, 2011 11:16am
Manual trading simulation bdp003 First Steps 6 Jul 3, 2011 9:57pm
Where's the manual ??? pedro01 Trading Software 1 Jul 15, 2008 11:09am

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)