Wednesday, November 16, 2011

Real Time vs Back Testing

There is a significant distinction between real time performance results and those derived from back testing.  The distinction lies in the probability that future performance will be consistent with the past results.

Real time results are predicated on using the data available at the time that the results are calculated.  Back testing often relies on data such as actual earnings (not available at the time) vs estimated earnings.

Real time also requires a logical hypothesis as the basis for the criterion selection.  Back testing often is based on correlations found in data without a supporting logical framework.

Corequity has conducted its screens in real time from the outset in 2004.

The primary criteria throughout is the Valuation Return or Risk (VR).  This is the degree to which the valuation of an equity, based on its normalized estimated earnings, is out of line with its own history of relative Payback.

Also, we included Payback rank in our screens as another criteria.  The logical assumption here was that equities with low Paybacks (equivalent to a high discount rate in a Discounted Cash Flow Model) would outperform equities which had a high Payback.

Another assumption in our screens was that Value Line Timeliness Rank would enhance the selection of under- and overvalued equities.

Finally, in 2005 we introduced a measure to enhance probability that the VR was correct by using  the ratio of Estimated Earnings (EPS) divided by Normalized Earnings (MPEPS).  The logical assumption was that an undervalued stock with estimated earnings of X but normalized earnings of X-y would have a higher probability of success than one with X/X+y.   In the real time screens we used a cut off of 1.1 or greater for the Undervalued and .9 or less for the Overvalued.

With the benefit of our current data set of 7 years of data (46,000 records), and the ability to analyze it using Excel Pivot Tables,  it is easy to see which assumptions were correct and which were not.

Payback: We could find little advantage or disadvantage in the 7 years of data in using Payback rank as a criteria.  This suggests that the market assignment of a Payback is “efficient”.

Value Line Timeliness:  This criteria significantly detracted from the Undervalued performance but proved to be of value in improving the negative results for the overvalued screen (quite dramatically). 

As shown at the very top in the 7 years graph and tables of results, what worked as hypothesized were VR and EST/MPEPS:  the spread between Undervalued and Overvalued screens was 9.2% annually
.
Therefore we would argue that the result presented are substantially derived in real time.

No comments:

Post a Comment