Setup and Methodology:
Up vs Down:
Changing Correlations in Portfolio Optimization
BA 453: International Investment Assignment 1
James Barber
Geb Berry
Marco Ongaro
George Rupp
Introduction
In this work we will attempt to assess the validity of the following hypothesis that the correlation between markets changes as a function of the general trends of the moment in dominant economies:
Dominant economies like the US will have differing correlation to other markets depending on the direction of its movement (e.g. a market with low correlation to the US in a bull market will show a higher correlation in a market downturn), the effect being: in a domestic bull market, returns of a diversified portfolio are dampened, while in a domestic bear market, due to higher correlation, the diversified portfolio returns are amplified in bear market.
Using this underlying premise, we built a model to perform active asset allocation in a portfolio of 5 countries (Belgium, Hong Kong, Japan, US, Venezuela) using a Markowitz optimization with differing correlation variables depending on the predicted direction of the US market. We found that this recognition of changing correlation resulted in an improvement of between 250 and 800 basis points depending on the level of risk and short selling permitted.
Data
Initial Findings for 65-country Sample
Our initial analysis clearly reflects a difference in correlation between country dollar returns when the US market moves upwards versus when it moves downwards. This initial research took a cross-section of the indices for 65 countries from the MSCI and IFC data for developed, emerging and frontier markets, and then calculated a correlation table for all 65 markets. We then compared the covariance of the 65 markets with the US to confirm there was a basis for our thesis. Initially we found that the covariance in down markets was greater than the covariance in positive markets 85% of the time. Further analysis indicated that the markets which did not support this initial thesis were markets for which we had less than two years of data. Reworking this analysis we found 96% of the situations the “negative” covariance was greater than the “positive” covariance, with Zimbabwe and Pakistan being the only exceptions to the rule. The covariance matrices are based on the last 60 periods of data, conditional on positive and negative markets.
Predictive Regressions and Index Returns
Our model used five asset classes for the internationally diversified portfolio. These assets were forecasted by predictive linear regressions for the equity indexes for five countries (US, Japan, Hong Kong, Belgium, Venezuela) from which we made our baseline portfolio. The five countries were chosen to give worldwide exposure to several regions with different levels of economic development. Return information for these five indexes was based on monthly data taken from the MSCI world index and the MIFC database for emerging markets data. The regressions were built using this index data and additional variable data taken from Datastream for the 5-year period between 1992 to 1997.
The variables utilized were economic variables which were believed to be sensible leading indicators and had a acceptable t-statistics. Generally speaking, the levels of predictability of these regressions were not extremely high. It should be noted, however, that the emphasis of this exercise was not so much to forecast returns with the most accurate regression, but to show the improvement on returns when one recognizes the impact of different relationships between asset classes under different circumstances (i.e. changing correlation and the use of differing covariance matrices). An improvement in predictability, particularly for the lead market should only enhance the effects of the improved correlation rules. The regressions and the data used to create the regressions can be found on the main spreadsheet.
US Directional Prediction
The asset allocation program has utilized the domestic US market as the pivot for selecting the appropriate correlation between assets. The rationale for this was that as the US is a large component of the MSCI World Index it is a very efficient market and is probably the leading index in the world economy.
The accuracy of this prediction is perhaps the most important determinant in affecting the actual return of the portfolio over the test period. Our results indicated a hit ratio for the directional count of 75% from our regression prediction. This however is masked by the consistent positive movement of the US market over the past few years (since 1992 in this sample). We were able to predict a positive movement 97% of the time and disappointingly the negative returns only 14% of the time. This is understandable considering the historic mean return for the US market was 1.349% per month. We were thus not trying to predict below average performance but below zero performance, which assuming a normal distribution has a probability of 0.13.
The inability of our regression model to accurately predict the negative movements, specifically the substantial movements in August 1998 has not allowed the full benefits of our model to be realized. Adjusting this pivot point to account for the general positive direction of the US market would be a good direction for further study, and would undoubtedly result in a more refined and more accurate model. Nevertheless, given the regression models and directional predictors, the benefits appear to be substantial.
Set-up of Experiment
For the base case scenarios in each period we looked to optimize our portfolio weights for each asset by running a Markowitz mean-variance optimization based on the expected returns for each index from our predictive regressions and the correlation and covariance of data from a rolling 5-year period (60 months) immediately prior to the current period. This optimization was performed again at the end of each month for the period from 1992 to 1998, for a total of 72 months of which the last year was out of sample for the given regression data.
To test the hypothesis we used our predictive regression for the US index to forecast the direction of the US market. If the return was predicted to go positive rather than using the correlation for the previous 60 months, we would then optimize using the same expected returns as in the base case but using the correlation/covariance of the 5 assets in the last 60 months in which the US pivot market had seen a positive return. Similarly, if we predicted a negative return we used a correlation/covariance matrix based on the previous 60 months where the US had seen a negative return to determine our optimal weights.
To perform a Markowitz mean optimization the other two variables that are important in determining the eventual optimal weights are the level of risk (sigma) that is chosen and the decision whether or not to allow short sales at all, and whether or not to limit positions (long or short) in particular assets:
• In variable US sigma scenarios for each period the portfolio sigma was set to match the sigma of a US only portfolio over the previous 60 months. In these scenarios the sigma varies slightly in time going from a minimum of about 3.4% to a maximum of 5%. Under the fixed sigma scenarios the sigma is held constant at 4.43%, the historical US sigma over the period 1970 to 1998.
• Short sales scenarios varied from where they were either prohibited, unlimited, or set to maximum levels of 20% short and 50% long in any specific asset.
To take these differences into account, we ran the following scenarios which accounted for the base case scenario with a single comprehensive matrix, and the two matrix model, as well as two additional scenarios for a simple buy and hold portfolio optimized as of the end of the in-sample period (January 1998) using the 5-year historical return as the expected return. Additionally, we ran one scenario with positive and negative matrices where correlation/covariance was predicted using an ARCH regression of residuals and lagged residuals.
|Scenario |Description |Short Sales |Sigma |
|S1 |1 matrix |No |Variable US |
|S2 |2 matrix |No |Variable US |
|S3 |1 matrix |20/50 |Variable US |
|S4 |2 matrix |20/50 |Variable US |
|S5 |1 matrix |Yes no limit |Variable US |
|S6 |2 matrix |Yes no limit |Variable US |
|S7 |1 matrix |20/50 |US Historic |
|S8 |2 matrix |20/50 |US Historic |
|S9 |2 matrix ARCH |20/50 |Variable US |
|S10 |Buy and hold |N/A* |US Historic |
*The optimal strategy for scenario 10 had no short sales, or any long positions greater than 50% even when allowing for unlimited short sales.
In each case above, the scenario was run by selecting the appropriate options and running the model through an Excel program that calculated the appropriate predictions, performed the optimization and recorded the weights for each period. These weights were then matched up with the actual observed data to determine the performance of each scenario.
Results
Efficient Frontier
The initial efficient frontier was derived given the historical variance and returns for the base set of assets. This was used to benchmark the various scenarios and reflect the various historical profiles of the various countries. The results are illustrated below.
Scenarios
The model then used the forecasted returns and the respective covariance matrices to allocate the weights to the various asset classes based on our mean-variance optimization Solver engine. The results of the scenarios are included in Table 1.
Table 1: Actual annualized means and standard deviations for the Assets and Scenarios based on data from January 1992 to December 1998
|Asset |Annual Mean |Annual Std. Deviation |Index |
|World Return |14.74% |12.23% |248.62 |
|US Return |21.08% |12.31% |168.73 |
|BE Return |21.86% |12.20% |247.59 |
|HK Return |19.84% |32.86% |82.63 |
|JP Return |-0.02% |23.60% |362.19 |
|VE Return |0.86% |49.48% |42.47 |
|Return S1 |24.35% |13.42% |432.42 |
|Return S2 |26.90% |16.11% |485.86 |
|Return S3 |25.98% |12.41% |477.65 |
|Return S4 |30.28% |16.57% |580.48 |
|Return S5 |29.29% |12.96% |569.94 |
|Return S6 |35.37% |17.36% |751.59 |
|Return S7 |26.57% |17.77% |467.34 |
|Return S8 |34.85% |20.36% |705.21 |
|Return S9 |2.31% |11.13% |114.04 |
|Fixed Weight |14.81% |23.17% |218.25 |
To compare the impact of using two rolling covariance matrices we cross-tabulated the results to reflect the differences more clearly in Table 2.
Table 2: Performance summary of single and two matrix strategies
|Description of Scenario |Single matrix |Two matrix |Single matrix |Two matrix |Diff. in basis |
| |index |index |average return |average return |points |
|No short sales allowed, variable |432 |486 |24.35% |26.90% |255 |
|US volatility | | | | | |
|Max 20% short sales and 50% long, |478 |581 |25.98% |30.28% |430 |
|variable US volatility | | | | | |
|No limit on short selling, |570 |752 |29.29% |35.37% |609 |
|variable US volatility | | | | | |
|Max 20% short sales and 50% long, |467 |705 |26.57% |34.85% |828 |
|historic US volatility | | | | | |
|Average | | | | |530 |
The following graphs show a comparison of base and double matrix scenarios as compared to the buy and hold portfolio and the MSCI world index return over the same period. Enlarged graphs can be viewed by clicking on the relevant chart.
[pic]
Chart 1: No short sales allowed, variable US volatility
[pic]
Chart 2: Max 20% short sales and 50% long, variable US volatility
[pic]
Chart 3: No limit on short selling, variable US volatility
[pic]
Chart 4: Max 20% short sales and 50% long, historic US volatility
Conclusion
Although we achieved relatively poor levels in predictability and directional forecast from our US regression, especially for negative movements, the technique of using two differing covariance matrices yielded substantial improvements. On average across all scenarios this came out to a difference of 530 basis points per annum. The lowest returns and gains vis-à-vis the benchmark came unsurprisingly when short sales were not allowed where we showed an improvement of 260 basis points by adjusting the covariance matrix. Interestingly, our best results came from using fixed weight sigmas to optimize the portfolios.
Our results were computed from January 1992 to December 1997 which were in sample for the data from our predictive regressions, and from January 1998 to December 1998 out of sample. In all cases the correlation matrices were taken from backward looking data and can be considered out of sample.
Indeed the results from this simple study with a five-country portfolio over a limited time period are very interesting and show good support for our initial hypothesis. An interesting development of this analysis would certainly be to vary the time horizons and get a more accurate test in down market conditions, which was unfortunately not possible in this case due to the relative paucity of data for predictive regression of Venezuela. Future studies with a varying mix of countries for the portfolio, and particularly a more accurate predictor model for the pivot country would indeed prove very interesting, and we would conjecture result in even greater improvements from using a multi-matrix model. Furthermore, the Excel spreadsheet that provided the engine for our analysis can be easily modified to test these and other scenarios and can be found here.
Further research
Forecasting of Variances and Covariance with ARCH
We decided to push our investigation one step further and try to replace the historical variances and covariance used in our optimization program with a forecast of these values from an ARCH regression of residuals. From the forecasted returns and the observed values of the predicted regressions we calculated our residuals. These were then squared and multiplied across countries (see sheet Res_Res in the Excel Workbook, BE_BE represents the Belgian residuals squared, BE_HK, the Belgian residuals multiplied by the Hong Kong residuals, etc). We then split these residual across up markets (in the US) and down markets. Each of these samples were then regressed against themselves lagged by one period. To accomplish this we use a direct less squares formula with a rolling sample based on the last 60 data available. In this manner, the regressions are done automatically and were integrated in the program (see sheet Res_Reg). The results were then translated into a variance and covariance matrix for each state of the market: up or down (see sheet matrix). These matrices were linked to the main program and that selects the one to use as the input for the variance-covariance matrix used to allocate assets.
The results we obtained by this method were however quite unsatisfactory. The out of sample return was less than 50% of the world return. One of the main reasons that we found for this was the small sample available for the ARCH regressions, particularly for downward movements over the 5 years available (this would be true even if we use the full sample instead of a rolling sample). As the size of the sample was determined by the shortest series of return forecast of the five countries (Venezuela) and this sample is reduced even further when we split the returns into two smaller samples in order to differentiate the up and down markets. The down markets are the more critical ones in this case since the US markets are up most of the time. In this case, our sample for downward movements was reduced to 20 data points, which we feel did not provide an adequate basis for the correlation between indexes.
In conclusion, we are still convinced that an ARCH method making the distinction between up and down markets would be useful to improve the allocation of the assets. Nevertheless, its success is closely linked to the quality of a prediction model for the trend of the US market.
Excel Program:
The Excel program used to test the model is a fully functional and fully reusable pushbutton spreadsheet that can perform the Markowitz Mean-Variance Optimization, create an Efficiency Frontier for the given portfolio of 5 assets, or a Sharpe Utility maximization, in addition to replicating the changing matrix experiment we conducted.
The following Describes how each of the major functions of the spreadsheet operate:
Markowitz Optimization:
The Markowitz optimization uses the expected return data supplied by the user to build an optimal portfolio given the historical correlation and standard deviations of the underlying 5 assets.
• The user may select a level of risk (sigma) to match to one of the underlying assets or given benchmarks, or alternatively may enter a separate sigma to their preference.
• The user can choose whether to limit short sales or long sales by entering a number in the appropriate box. Leaving a limit cell blank or equal to “none” will result in no limit on the asset. Setting both long and short to 0 will result in the asset not being considered for the portfolio.
Expected returns:
By default the expected return is linked the historical return for the period of the data underlying the correlation matrix. Manually entering in a projected value will over ride these historical values, removing the underlying formula. Pressing the “Set historical button” will return these values to a linked value based on the selected period.
Correlation Matrix:
The correlation Matrix is calculated separately on a back sheet based on the from to dates shown on the data period button. Changing the data period will change these values to match them to the desired dates.
Creation of Efficiency frontier:
Having selected the expected returns, the “Create Efficiency Frontier” option creates the efficiency frontier by plotting a series of portfolios with the minimum variance for any given return from that of lowest asset to the highest asset. Note that when setting limits on portfolio composition (eg 20 short 50 long), the frontier may develop interesting kinks related to this imposition of limits. The underlying data, including asset weights for each point on the frontier can be found on the “graphbase” worksheet.
Sharpe Utility Maximization:
The Sharpe utility maximization lets the user select their Sharpe utility and builds a portfolio to match the implied risk profile given their level of utility. Note that this figure is valid when returned for the portfolios created in other optimizations. For an online version of this program and further discussion of its underlying precepts see Sharpes website at
Data Period and Reset Buttons:
These buttons are reather self explanatory in terms of what they due. They essentially reset the named ranges of the underlying data so that the formulas on the program page reflect the proper dates. For these functions to continue working after updating the spreadsheet with your own data you need only be sure that any new data must be written directly over the original data, and any new dates added must be specified in column a of the “returns” worksheet.
These functions can easily be adapted to work with any other data, or series of portfolio assets by simply writing over the data in the base indexes sheet with your own data. The first 5 columns represent the data included in the portfolio, and other columns are in place to provide benchmark sigmas. All other items, correlation matrices, monthly returns, labeling, data periods, etc will be set automatically as long as the format in place is followed as soon as the data period is reset. The data that is actually pulled comes from the “returns” sheet which calculates the monthly returns given the index values on the sheet prior, so if you have just returns, overwriting just the returns sheet will also work. The only caveat to this is to be sure that if you change the date range that all your dates appear on the returns sheet as it is those dates are used by the set period function. Labels also come directly from the returns sheet so be sure to have that data correct. If you do not plan on running the multi-correlation model, all sheets after the “graphbase” spreadsheet may be removed without fear as they are not used for the basic functions.
Multi-Correlation Model:
To run the model is straightforward by selecting the desired attributes and pressing the button at which point you will be prompted for the number of months over which to provide returns. Beware that it will take 10 to 20 minutes depending on your computer and the dates selected to run it. Output from the model is generated to the output sheet on the last page. This output provides the date, the portfolio weights, the matrix used (positive, negative or Full), and the sigma. The weights must then be combined with the actual returns from the other sheets to provide actual and expected returns. We have had problems with memory crashes after running the simulation so be sure to save before playing with the output.
The multi-correlation model requires quite a bit more work to be modified for use with a different asset portfolio, but is nonetheless fairly easily adjustable if one should like to replicate our experiment with different underlying assets. Expected returns for each period come from the predictions generated on the sheets following the “graphbase” sheet. The data sheets provide all relevant data, and the regression sheets are optional. If you care to substitute your own underlying data be sure that:
• Dates are in Column A
• Actual returns are found in column B
• Predicted returns are found in Column I: if you insert columns, move returns to column I which is where code will look regardless of insertions.
• All Dates on data sheets use the same dates in column A, and start with the same date in row 2
As long as these conventions are followed the multi-correlation model will run without any hiccups regardless of whether you use formulas, regressions or randomly generated #s to provide the expected returns.
The program works by taking your pivot return on the US data sheet, and depending on its value (+ or -) returning the corresponding correlation matrix which is built from either the PosReturn and NegReturn worksheets. Once you have copied your data in to the spreadsheet(eg the returns or base indexes sheet) you must then copy the returns data to a new sheet and run a sort on your data dividing it into positive and negative returns as per your pivot, copy and resort these by date on to the positive and negative sheets from which they will be drawn to create the positive and negative covariance and correlation matrices.
Other additions and changes
The ARCH model predictions will continue to generate automatically if the underlying data is changed as long as residual continue to be calculated in Column J, but given its complexity, it would be very difficult to modify easily. Additional assets can be added fairly easily with moderate knowledge of visual basic by inserting columns before Venezuela and then adjusting the Visual Basic code. I have completed a 10 asset version of the sheet which can be request by email.
Should you have any questions or additional comments, the author of the spreadsheet may be contacted via email at Geb.Berry@duke.edu. I consider the spreadsheet to be public domain, but would be most appreciative to be notified of any interesting results which it might help generate.
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- choosing our generalized coordinates as the horizontal
- this research conducted by allen newell and herbert a
- computer mathematics and the graphing calculator
- doing linear algebra in sage simmons university
- ghost image processes for the fixed charge network problems
- implementing finite difference solvers for the bs pde
- setup and methodology
Related searches
- office setup student and home have key
- marketing methodology and approach
- approach and methodology of projects
- methodology and approach examples
- difference between methodology and approach
- research methodology methods and techniques
- research methodology tools and techniques
- research methods and methodology pdf
- research design and methodology pdf
- research methods and methodology ppt
- difference between methodology and method
- methodology and design research samples