Assessing Performance of Morningstar’s Star Rating System ...
Assessing Performance of Morningstar's Star Rating System for Stocks
Paul J. Bolster1 Northeastern University
p.bolster@neu.edu
Emery A. Trahan Northeastern University
Pinshuo Wang Northeastern University
Abstract: Morningstar is one of the most prominent providers of stock ratings. This is the first study evaluating the performance of portfolios formed using Morningstar's Star rating system for stocks. Our results provide evidence that this rating system allows an investor to build a portfolio that outperforms the market average over a long period of time. This outperformance is reduced, but not eliminated, after adjusting for risk and style factors. We show that this outperformance is also robust to modest transaction costs. Overall, the results are consistent with Morningstar analysts providing value to investors who rely on their ratings.
1. Introduction Professional investors employ vast quantities of capital to access equity analysis in the quest
to enhance performance of their portfolios. If such analysis can distinguish the relative performance among equities to an extent that exceeds the cost, then this makes perfect sense. On the other hand, there is a rich and varied literature in academic finance indicating that markets are essentially efficient in the semi-strong form sense. Regardless of the market efficiency question, some of the larger providers of equity analysis can serve as benchmarks for relative performance of investment strategies with particular style characteristics.
And what about the retail investor? He or she has an extraordinary array of choices when it comes to stock recommendations. In addition to recommendations provided by sell side analysts, there are numerous national financial publications, independent newsletters and established corporations that evaluate individual equities. One of the most prominent among these stock raters is Morningstar. This well-regarded company provides a wide range of services that assist individual investors in the assessment of individual U.S. equities and at a very modest cost.
In this study, we employ the historical record of all Morningstar stock ratings over a period of approximately eleven years. We construct five portfolios, corresponding to the five "star" categories employed by Morningstar's stock rating system. Our analysis shows that the Morningstar stock rating system is able to effectively distinguish between the most overvalued (1-star) and undervalued (5-star) stocks. Based on risk-adjusted returns, a portfolio of 5-star
1 Corresponding author
stocks outperformed a portfolio of 1-star stocks in 8 of 12 years from 2001 to 2012 and by 173.42% in unadjusted cumulative returns over our entire period of analysis.
We employ a Fama-French model to further assess sources of returns for the five portfolios. This analysis shows that the style characteristics of the five portfolios, particularly the 1-star and 5-star portfolios, vary widely during the 11 years of our study.
2. Review of Literature There is an extensive literature assessing the value of investment advice in general and stock
ratings systems in particular. Several studies provide examples of the former. Metrick (1999) evaluates the performance of 153 investment newsletters and finds no case for outperformance. Dewally (2003) reports that stock recommendations distributed by major newsgroups through internet discussion forums produce no abnormal performance in the short or long term. Bolster, Trahan and Venkateswaran (2012) evaluate a large sample of stock recommendations made by the popular investment guru, Jim Cramer and conclude that his performance is in line with the risk level of his picks.
There is also considerable prior work examining the value of stock rating systems. Among the earliest studies, Black (1973) found that a portfolio formed from the top rated stocks on Value Line produced significant excess returns over a five year period from 1965 to 1970 even when adjusting for transaction costs. However, a study of Value Line rankings by Hall and Tsay (1988) found that top rated stocks did not provide significant excess returns during the period from 1976 to 1982. The disappearance of a Value Line premium is consistent with the major conclusion of a recent study of 95 pricing anomalies by McLean and Pontiff (2014). They find that returns attributed to most pricing anomalies are significantly reduced after their presence is reported in a publication.
Another common approach among studies of stock ratings exploits the system used by analysts where ratings of 1 to 5 represent strong buy, buy, hold, sell, and strong sell, respectively. Barber, Lehavy, McNichols and Trueman (2001) find that a strategy of shorting the lowest rated stocks generates superior returns. However, they also report that these returns may be eliminated by transaction costs. A more recent study, also by Barber, Lehavy, McNichols and Trueman (2010), shows that a portfolio that is long all buy and strong buy stocks and short all sell and strong sell stocks will produce positive and significant abnormal returns. If this portfolio was further conditioned to focus on only stocks being upgraded to buy or strong buy or downgraded to sell or strong sell, the abnormal returns would be materially higher.
While there has been little published analysis of Morningstar's stock rating system, there are many studies of their mutual fund ratings. Examples of these studies include Blake and Morey (2000) who find predictive power in ratings, especially for the lowest rated funds, and DelGurico and Tkac (2001) who document a strong relationship between fund flows and changes in a fund's Morningstar rating. We believe our study is the first to comprehensively examine the efficacy of Morningstar's 5-star stock rating system.
3. About Morningstar Morningstar was founded in 1984 by Joe Mansueto to provide individual investors with
mutual fund analysis and commentary. Its first product was The Mutual Fund SourcebookTM, a quarterly publication containing performance data, portfolio holdings, and other information on approximately 400 mutual funds. Today, Morningstar claims to be one of the most recognized
2
and trusted names in the investment industry, serving more than 7.4 million individual investors, 270,000 financial advisors, and 4,300 institutional clients.
On its website , Morningstar, Inc. touts itself as a "leading provider of independent investment research in North America, Europe, Australia, and Asia; offering an extensive line of products and services for individuals, financial advisors, and institutions." The company provides data on more than 380,000 investments, including stocks, mutual funds and other types of funds, along with real-time global market data on more than eight million equities, indexes, futures, options, commodities, precious metals, foreign exchange, and Treasury markets. Morningstar also offers investment management services, with over of $190 billion assets under management or advisement and operations in 27 countries.
Morningstar offers products and services to advisors, institutions and individual investors. Much of their service is targeted toward providing independent information and advice to individual investors. Their website states that "individuals use Morningstar to make educated investment decisions. These investors want all the pertinent facts, as well as the assurance that their information source is completely independent." The company lists various attributes that relate to its ability to deliver world-class investment research and services. These attributes include, investor focus (maintaining an independent view and designing products to help investors make well-informed investment decisions); depth, breadth, and accuracy of data (employing 270 analysts worldwide and providing information on approximately 330,000 investment offerings); innovative, proprietary investment tools (e.g., Morningstar RatingTM, Morningstar Style BoxTM, Morningstar Ownership ZoneTM, and a proprietary sector classification system for stocks); and finally, research and technology expertise (striving to rapidly adopt new technology and providing a flexible technology platform allowing products to work together). The primary tool for individual investors is ?, which Morningstar claims consistently ranks among the best investment sites on the web.
In 1985, shortly after its founding, Morningstar released its now famous Morningstar RatingTM for mutual funds, using the familiar rating of from one to five stars. In 1988, the company expanded into analysis of individual stocks, launching its Morningstar? StockInvestorTM newsletter. In 2001, Morningstar launched its Morningstar rating for individual stocks. Similar to its ratings of mutual funds, the Morningstar rating for stocks assigns each stock a rating of from one to five stars. A stock's rating is driven by its level of expected return, with 5-star stocks being those expected to offer investors returns well above a company's cost of capital.
4. Data and Methodology Morningstar analysts cover over 1800 companies in more than 100 industries, including more
than 85% of the market value of the Wilshire 5000 Index. Morningstar evaluates each company as a business and conducts a fundamental analysis valuation considering how much capital a company invests and its return on capital, free cash flow, growth, and sources of competitive advantage and the likely fade in returns as competitive advantages erode over time. It examines each company using a discounted cash flow model and computes the value as the present value of the company's expected future free cash flows discounted at its cost of capital.
Morningstar analysts compare each company's fair value estimate to its market value and assign a rating of from one to five stars. Stocks trading at large discounts to fair value receive higher (4 or 5) star ratings, while those trading at large premiums to fair value estimates receive lower (1 or 2) star ratings. Stocks trading close to fair value receive 3-star ratings. Risk is also factored into the rating so that the greater the uncertainty of the stock, the greater its discount to
3
fair value needs to be to earn a 5-star rating. A 5-star rating can be interpreted as a "consider buying" recommendation, i.e., the price of the stock is below the fair value by a sufficient margin to be purchased. Morningstar also advises individuals to consider their circumstances, including diversification, risk tolerance, and tax considerations.
Ratings are updated daily and therefore may change daily. Ratings can change due to: 1) a movement in the stock's price, 2) a change in the analyst's estimate of the stock's fair value, 3) a change in the analyst's assessment of a company's business risk, or 4) a combination of these factors. It should be noted that the Morningstar stock ratings are fundamentally different than the star ratings for mutual funds. The mutual fund ratings are descriptive, backward-looking, based on historical performance, strictly quantitative, calculated once a month, and rank funds according to a fixed distribution (i.e., only 10% of the funds in each category can receive 5-star ratings). The ratings for stocks are based on forward-looking estimates, adjusted for uncertainty, based on quantitative and qualitative inputs, calculated daily, and do not rank stocks according to a fixed distribution. Dorsey (2008) provides a more complete description of the Morningstar rating system for stocks.
Table 1 shows the number and proportion of stocks in each rating category at the end of each year from 2001 to 2012. We note that the number of stocks rated climbs from a low of 469 in 2001 to a high of 2107 in 2008 before tapering off to 1897 in 2012. But the most interesting element of this table relates to the proportion of stocks in each star category. Three-star stocks comprise the greatest proportion of the sample of rated stocks in every year, ranging from 33.75% to 56.09%. Stocks in this category are considered "fairly valued", a neutral rating. The proportion of 5-star stocks ranges from a low of 3.74% to a high of 24.82%. The high proportion occurs at the end of 2008, a fantastically bad year for the U.S. equity market. Conversely, the proportion of 1-star stocks is at its lowest point, 2.18% in 2008. This suggests that the depressed values for stocks at this time indicated a disproportionate number of bargains and relatively few overvalued securities.
Insert Table 1 here.
Our main source of data is assembled from daily reports of stock ratings for Morningstar's entire sample of rated stocks. The data begins on June 26, 2001 and ends on October 1, 2012. The number of rated stocks varies over time and is 1897 at the end of our period of analysis. This data set allows us to identify (1) whether a stock is rated, (2) a stock's rating on a particular trading day, and (3) the day of a change in a stock's rating. Using this data we are able to identify 144,083 individual rating changes. After merging this database with CRSP to obtain stock returns, we retained 139,636 useable rating changes.
The CRSP data we employ measures daily total returns for individual stocks using closing prices. We create portfolios comprised of stocks with a specific rating using two different approaches. The first approach derives a simple arithmetic average, or equal weighted (EW) return for stocks assigned to a particular star portfolio for each of the 2,835 trading days in our sample period. Analysis of these returns should give us insight into whether the rating system is an effective discriminator on average.
But what if all ratings are not equal? For example, what if some 5-star stocks perform incredibly well while most perform just a bit better than average? In this scenario, the EW return would underreport the effectiveness of the 5-star rating from an investor's perspective. Alternatively, maybe most 5-star stocks do a bit better than average but a minority perform poorly. In this case, the EW return would exaggerate the return that an investor who maintained
4
a consistent portfolio of 5-star stocks would actually achieve. Furthermore, an EW portfolio would not be investable in any practical way. To adjust for possible asymmetry in performance and to create a more investable portfolio, we create a series of dollar weighted (DW) returns for each of our five portfolios.
To create the vector of DW returns, we invest $1 in a stock as it initially enters its designated portfolio at the close of the market on the day Morningstar releases the new information. We believe the closing price incorporates any short-term information effects of the disclosure of the rating change itself and better focuses the analysis on the continued performance of the portfolio. The stock remains in its designated portfolio until Morningstar assigns it a different rating. When a stock is reassigned to a new portfolio, we remove all accumulated value the original $1 investment has produced from the old portfolio and invest $1 in the new portfolio.
Here is a more concrete explanation of the rebalancing process for the DW portfolio. Morningstar announced an upgrade of Comcast from 4-star to 5-star on the morning of April 10, 2008. We invest $1 in Comcast at the market close on that day. We then use CRSP daily returns to revalue our investment in Comcast at the end of each subsequent trading day. On April 30, 2008, Comcast was downgraded from 5-star to 4-star. As of the close of the market on that day, our original $1 investment had grown to $1.0296. At this point, we calculate the aggregate value of all securities in the 5-star portfolio and the daily return for April 30. We then deduct $1.0296 from the aggregate value of the 5-star portfolio and also adjust for any other entries into or exits from the portfolio. The resulting adjusted aggregate value becomes the beginning value used to calculate the May 1, 2008 daily return.
In addition to evaluating raw returns, we also use the 4-factor Fama-French model to create risk-adjusted returns for both EW and DW approaches. This approach allows us to examine differential performance among the five portfolios formed from Morningstar's ratings and also to observe differences in style, or factor exposures across the portfolios and over time.
5. Results 5.1 Portfolio Performance
Table 2 provides basic data on average daily returns by star rating for both EW and DW portfolios. For the EW portfolios, shown in Panel A, the 5-star portfolio outperforms the 1-star portfolio in 9 of 12 years. This difference is positive and significant in 2003 and 2010 and negative and significant in 2007. Across all 2835 days in our sample, the 5-star portfolio outperformed the 1-star by an average of 2.05 bps per day. This difference is not statistically significant. Overall, the 5-star portfolio provided the highest daily average return of 7.00 bps. However, the 4 and 1-star portfolios nearly tied for second place with 5.00 and 4.95 bps per day respectively.
Panel B shows returns for the DW portfolios. While the figures are different, the results are quite similar in a relative sense. The 5-star portfolio outperforms the 1-star portfolio in 8 of 12 years. The difference is positive and significant in 2003 and negative and significant in 2007. Over the entire sample, the average difference in daily returns was 1.12 bps higher for the 5-star, again not statistically significant. Again, the overall return for the 5-star portfolio produced the highest average, 4.67 bps per day. The performance of the five portfolios was nearly monotonic overall.
Insert Table 2 here.
5
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
Related searches
- morningstar 5 star funds list
- fidelity morningstar 5 star funds
- morningstar 5 star rated stocks
- morningstar 5 star dividend stocks
- morningstar 5 star funds vanguard
- morningstar 5 star bond funds
- morningstar 5 star funds
- morningstar 5 star etf funds
- morningstar 5 star stock list
- morningstar 4 star rated stocks
- morningstar rating system explained
- morningstar 5 star stocks