Stress Tests: Aspects and Considerations

Print print

By Andrew Robertson
andrew.d.robertson@jpmorgan.com

Stress testing has become an integral part of portfolio risk management to help eliminate potentially large losses from extreme events. This article explores the aspects and considerations needed to implement hypothetical stress testing as an effective risk management tool within an investment management organization.

Portfolio Risk Management

Perhaps the most important element of any risk management framework is buy-in from the top. Senior management within an organization needs to promote a 'risk culture' where the identification and measurement of risk becomes a central business driver. For senior management the risks need to be identified, measured and managed.

Statistical models, such as Value at Risk, have long been used for risk management purposes. In general, VaR models assume normal market conditions. Under extreme market conditions, the underlying assumptions of these models break down. In these situations, stress testing has been used as a complementary technique to identify potential loss.

Exhibit 1: VaR capturing risk as a plane, stress testing capturing risk as a point.

Exhibit 1: VaR capturing risk as a plane, stress testing capturing risk as a point.

Source: Yuko Kawai, Bank of Japan, 2006.


Stress tests fall into three main categories: scenario analysis, historical stress testing and hypothetical stress testing. Scenario analysis identifies a portfolio's sensitivity to an individual risk factor, for example, a 100 basis point shock to interest rates. Historical stress testing recreates a past extreme event, such as the September 11 attacks. Hypothetical stress testing uses potential future extreme events to stress a portfolio. Examples include the break up of the Eurozone or a severe downturn in China. The obvious difference between hypothetical stress tests and the two other forms is the requirement to create a complex severe event not yet encountered. This presents unique challenges and can take considerable resources to produce. However, hypothetical stress tests may allow an organization to prepare for events in advance and lower the chances of a shock and awe response if the event were to occur.

Hypothetical Model Building Blocks

Hypothetical stress test models are comprised of four key building blocks1 - an extreme hypothetical scenario to define a set of exogenous risk drivers, a data generating process to map the exogenous factors to a set of exposure specific risk factors, an exposure, and finally, a risk measure. These building blocks are illustrated below.

Exhibit 2: Stress test building blocks.

Exhibit 2: Stress test building blocks.

Source: Drehmann 2008


Stress tests perform two main tasks: act as an instrument of measurement for limit setting and capital allocation or to act as a tool for communication, allowing the discussion of risk within an organization to take place. If the purpose of the exercise is for communication, the priorities for the stress test model design are transparency and story telling suitability.1 The model design should be simplistic, with few systematic risk factors and simple relationships between variables.

If a stress test is to be used as a measurement instrument, the priority is model accuracy and forecast performance.1 In this case, a complex model should be created, containing many intricate parts and risk factors. Mechanisms such as feedback loops should be incorporated, liabilities considered and sophisticated quantitative models for co-movement employed.

The type of portfolio also plays a fundamental role in the design of the stress test model. This requires an understanding of the way the fund manager makes money and to what risk types they are exposed. For example, the model design for a credit risk incorporating probabilities of default will be fundamentally different from a market risk stress test model.

Scenario Development

The purpose of a stress test is to explore the behavior of a portfolio under extreme conditions and make decisions based on their results. Developing a hypothetical stress scenario is a complex process because it requires not only envisioning an event that hasn't happened before, but it also needs to be able to persuade others the event is plausible. If a scenario is too extreme, it may be hard to justify to decision makers and could be dismissed as too unlikely to occur. If a scenario isn't extreme enough, it will provide limited information and may be disregarded as too insignificant to act on. Therefore it is important to find the right balance between severity and plausibility when developing a scenario. This is best achieved through the collaboration of different experts within an organization, such as risk managers, economists and fund managers. Using their expertise and experience, a state of the world can be formulated based on possible future events and then cross checked by senior management. Using this approach a scenario may not only be more realistic, but will also incorporate the culture and risk appetite of the organization.

Exhibit 3: Iterative cycle of hypothetical scenario generation

Exhibit 3: Iterative cycle of hypothetical scenario generation

Source: J.P. Morgan


Stress testing is most effective when a number of hypothetical stresses are applied to give an overall risk profile of a portfolio. The ultimate goal is to create a library of scenarios covering many possible future events, so scenario generation should be iterative and ongoing. To keep scenarios relevant, they should be periodically screened, challenged and cross checked in light of changing economic events and the risk profile of the portfolio. The process should be dynamic and engage people from across the organization.

The most obvious starting point to develop a stress scenario is envisioning a future extreme world event. As well as having a degree of imagination, this calls on using economic fundamentals to create a forecast model. The extreme event is played through the model, with considerations made for arbitrage relationships between asset types and relationships between currencies. The laws of supply and demand are explored and challenged to produce a set of stress systematic risk factors such as global indices and major currency pairs.

Another popular approach to building an extreme event is to consider the interrelationship of financial markets and the effect a liquidity shock may have on it. The technique starts with a 'thought experiment' on liquidity key drivers. Features to be considered are the interconnection of the financial system through advances in information technology and how this can amplify events through feedback in the financial system. The effects of market participants all managing risk in the same manner is another element that may need to be explored. An example of this technique might be an event causing a sharp increase in market risk and dealers exiting positions to avoid breaching trading limits. This contributes to further volatility and triggers action to be taken by other market participants resulting in herd behavior and further feedback in the system. The behavior spreads to other markets through the deterioration in liquidity and the inability to implement hedging strategies, thus causing further increases in volatility. As a result, a major market event unfolds.

A third technique is to identify a maximum portfolio loss using mathematical optimization to create a hypothetical event scenario. The worst case scenario can be created by modifying the systematic risk factors within a stress test model under plausibility constraints, while ensuring the events are sensible due to the mathematical nature of the technique.

Interpretation of results

Hypothetical stress testing does not act as a crystal ball for future events. Stress testing is a risk management tool that requires both a quantitative and qualitative approach to establish the risk profile of a portfolio.

The qualitative element of stress testing has led to skepticism in the past and the rationale results are of little use without associating a probability to an event. Yet, this is the nature and challenge inherent in risk management. Trying to assign a probability to a hypothetical stress test in isolation seems to be a dangerous exercise, which could lead to a false sense of security in numbers.

One answer is not to look at single stress tests, but to apply a number of scenarios to a portfolio and use judgment to rank each on a probability of occurrence vs. impact of risk chart.

Exhibit 4: Probability impact chart

Exhibit 4: Probability impact chart

Source: J.P. Morgan, www.mindtools.com


The result is both intuitive and informative, giving a quick, clear view of which scenarios warrant most attention, as well as an overall risk profile of the entity being stressed.
Further insight can be gained by building up a history of probability/impact charts over time, thus allowing the ability to perform trend analysis on changes to business and the economic environment.

The process of interpreting the results of stress tests also aid psychological preparation to events. Bringing different members of an organization together to discuss the topic of risk helps raise decision and thought awareness within an organization. In turn, this helps formulate contingency plans and impact mitigation, lowering the chances of a shock and awe response to market events.

Conclusion

The business of risk management is a balancing act of risk against return. It sometimes feels like the playing field is not even, as small frequent opportunities to make profit are offset by large infrequent losses. The aim of hypothetical stress testing is to explore weaknesses in a portfolio under extreme circumstances to help mitigate these losses. But it is clear that there is no one-size-fits-all formula for stress testing in an organization. This is determined by the culture, the objective at hand and the overall risk appetite.

A hypothetical stress testing program needs to have buy-in from all aspects of the organization. In some sense, stress testing is born of a state of mind, where ideas can be explored and where people and methodologies are open to be challenged. It is most important that senior management is involved in the design process, as ultimately they will be the ones making decisions on the back of any stress scenario. As with any practice, experience gains understanding and grows confidence in a method.

 


References:
BIS 2009, 'Principles for sound stress testing practices and supervision'
PRM Handbook Volume III, pages 173 – 184
Kawai 2006, 'Stress Testing at Major Financial Institutions: Survey Results and Practice'

1Drehmann 2008, 'Stress Tests: Objectives, Challenges and Modelling Choices' Riksbank Economic Review.

 
Up

Copyright © 2013 JPMorgan Chase & Co. All rights reserved.