Insights and opinions from an internationally recognized authority on investment performance measurement

Thursday, July 1, 2010

Wrong index or active management?

I taught our Introduction to Performance Measurement course yesterday and one student asked how one might know whether, if the tracking error is high, it is because of (a) active management or (b) the wrong index being used?

I don't believe there's a simple way of knowing this. If the tracking error is exceptionally high (e.g., 15%), then the manger either obliterated the index or is doing something entirely different. So perhaps some levels make it clear that it's probably the wrong index. Style analysis could be a tool that can be used to analyze the portfolio and see if it aligns with the index, at least to some extent. A review of the holdings, sectors, market caps may also be in order. If it's a blended index, does the blend include all sectors in which the manager is investing?

We occasionally see managers use broad indexes, such as the S&P500, when their strategy involves a single style (e.g., growth) or market cap (e.g., mid cap). In this case, it's pretty clear that we have the wrong index.

4 comments:

I think that you are exactly right in suggesting that a thorough style analysis is required to determine the source of tracking error. And I think it's a useful insight that you provide in distinguishing the possible source of tracking error being something other than active management. It is often the case that tracking error is caused by 3 factors: a) permanent style differences from the benchmark, and/or b) tactical style differences (a sort of "allocation" effect) and finally c) individual issue selections and trading. A typical style analysis is quite limited because it only finds a permanent allocation to market segments that produce an index that is highly correlated to the manager's performance. It does not distinguish between long term and short term allocation and style differences. (I had proposed a method of using both long term and short term style analysis to make this important distinction between these two manager decisions in an article published in the Journal of Performance: "Long Term Risk Adjusted Performance." I'm reminded that Carl Bacon noted correctly that this might have been better titled "Long Term STYLE Adjusted Performance.) In the article we break out the tracking error and "allocate" it long term structural differences, tactical differences and active management within the "stock picking" dimension.

There is also value in understanding the PATTERN of the tracking error, because not all tracking error is bad. We know that tracking error simply means that the manager is making active decisions and that these decisions are the source of the risk-adjusted alpha we seek. As an example, consider a manager with a superior "upside/downside" capture ratio. This manager will lose money less frequently than the benchmark, and will experience losses that are less severe. Frankly, I'll take that type of tracking error all day - "back up the truck" - because this is a source of BOTH higher returns and a greater ability to preserve capital, especially for portfolios that are spending money regularly.

I believe that it is relatively simple to both know the sources of tracking error and whether the tracking error forms a favorable volatility pattern relative to the benchmark. It does require some effort and some insight, but that's part of the value added by experienced and knowledgeable performance staff.

Spaulding, David Spaulding

About David Spaulding

is an internationally recognized authority on investment performance measurement. He's the founder and Chief Executive Officer of The Spaulding Group, Inc. (www.SpauldingGrp.com), and founder and publisher of The Journal of Performance Measurement. He's the author, contributing author, and co-editor of several investment books. He's actively involved in the investment performance industry, serving on numerous committees and working groups.
Dave earned his BA in Mathematics from Temple University, his MS in Systems Management from the University of Southern California, an MBA in Finance from the University of Baltimore, and a doctorate in Finance and International Economics from Pace University.
For more information please visit www.spauldinggrp.com/the-company/david-spaulding.html

Friends, colleagues, associates: by signing up, you'll be notified of new postings

Follow by Email

Dave is available...

Dave Spaulding is available for keynotes, corporate seminars, conferences, user groups, and interviews with well established media outlets. To schedule or discuss, please contact Chris Spaulding at (732) 873-5700 or via email CSpaulding@SpauldingGrp.com.

Important Performance Links

Are you truly a Performance Measurement Professional?

Two important indicators of you truly being a Performance Measurement Professional:

#1 - That you subscribe to The Journal of Performance Measurement. This publication has been the "bible" of performance measurement for over a decade. It's where new ideas are presented, debates are held, information shared. To learn more about the journal and to receive a complimentary copy, visit www.SpauldingGrp.com or contact Patrick Fowler (PFowler@SpauldingGrp.com) or Chris Spaulding (CSpaulding@SpauldingGrp.com).Subscribe now!

#2 - That you dress like a performance measurement professional. For the latest in fashion contact Patrick Fowler (PFowler@SpauldingGrp.com) or Chris Spaulding (CSpaulding@SpauldingGrp.com)

TSG's Guide to the Performance Presentation Standards

Our latest book is now available: TSG's Guide to the Performance Presentation Standards. This is a revision of an earlier book, that has been significantly enhanced. To learn more contact Christopher Spaulding (CSpaulding@SpauldingGrp.com).

Ask how you can get a free copy!

Don't miss out ... sign up for our newsletter

The Spaulding Group's critically acclaimed, complimentary monthly newsletter, Performance Perspectives, is in its 9th year. Each issue contains more in-depth analysis and ideas than can typically be provided in a Blog post. If you're not already a recipient, please sign up today. Contact Patrick Fowler at PFowler@SpauldingGrp.com.