Home

The Formula That Killed Wall Street - The Gaussian Copula - Wired - Felix Salmon

Printer-friendly versionSend to friendPDF version

Einstein and MunroeThe Formula That Killed Wall Street - The Gaussian Copula - Wired - Felix Salmon (Updated) The reference of this post is an article is from Wired magazine, it's by Felix Salmon, who you might know from Seeking Alpha, the article is interesting in its depth (it has none!).

The article is being commented on LinkedIn this morning but it reflects a zero level understanding of the Gaussian Copula (the subject of the article), which then maybe reflects why "the wizards of wall street" got it so drastically wrong, its nothing to do with the technique, its just that they did not understand 1) what it is for and 2) how it does what it is for. Certainly the WIRED article reflects no understanding of either in a parable about a kindergarten (says all that is necessary, really).

If you want to see how the Gaussian Copula really works and how it should be used try these (from the Asymptotix "How to References Page") http://www.asymptotix.eu/content/economic-risk-capital-how-references;-

Correlation: Pitfalls and Alternatives, Paul Embrechts, Alexander McNeil & Daniel Straumann, Departement Mathematik, ETH Zentrum, 1999;
http://www.math.ethz.ch/~mcneil/ftp/risk.pdf
Modeling Dependencies in Finance using Copulae; Wolfgang Härdle, Ostap Okhrin & Yarema Okhrin, SFB 649 Discussion Paper 2008-043;
http://sfb649.wiwi.hu-berlin.de/papers/pdf/SFB649DP2008-043.pdf 
Modelling Dependent Defaults: Asset Correlations Are Not Enough! Rudiger Frey, Swiss Banking Institute, University of Zurich. Alexander J. McNeil, Department of Mathematics, ETH Zurich, Mark A. Nyfeler, Investment Office RTC, UBS Zurich, March 9, 2001;
http://www.mathematik.uni-leipzig.de/MI/frey/FreyMcNeilNyfeler.pdf

If you want a really easy, relaxed explanation of the Copula then try this;-
Economic Implications of Copulas and Extremes, Norges Bank, 2008, http://www.norges-bank.no/upload/71737/economic%20implications_pek_02_08.pdf

If you want to read a shallow sensationalist "red top" view of an important econometric technique, (which should be used properly) then the WIRED magazine article is for you;-

http://www.wired.com/techbiz/it/magazine/17-03/wp_quant?currentPage=all

 

Comments

Financial Crisis: Where Are They Now?

David X. Li

 

Then: Developed the Gaussian Copula Function
Now: Head of Risk Management, CICC

Perhaps one of the most unknown names of the financial crisis, Li cannot be overlooked. A mathematician/statistician originally from China, Li amassed a number of degrees before entering the financial industry in 1997, bouncing around between several banks, including Barclays Capital and JPMorgan Chase.

In 2000, Li published a paper that featured a Gaussian Copula Function (displayed on the left), which allowed modeling of risk and default correlation that was used to an increasingly large extent by derivative traders on Wall Street. Although Li was simply an enabler (he did not endorse the use of his formula in this way), the formula is considered a contributing factor to the financial crisis.

Wired Magazine, which provides an in-depth explanation of Li's processes , reports that he is currently employed by the China International Capital Corporation as the head of the risk management. 

The Real Debate is Less About Right or Wrong...

The important question is not whether copulas work or can be made to work; of course they can (almost by construction). The important question is whether copula methods are the most intuitive way to think about dependency modeling. And that's another problem: Correlation is a linear measure of dependency; measures based on higher co-moments or nonlinear (but structurally/theoretically meaningful) functions are more useful -- especially with respect to modeling default dependencies.

Now as for copula methods, I don't like them. They obscure the dependency structure and I cannot say they do the minimal amount of abuse to what I might want to use as a baseline for dependence. Those are my major complaints against copulas. In layman's terms: I find them abstract, non-intuitive, and far too subject to noise for my comfort level.

I'd feel guilty about this; but, I did my PhD in statistics and wrote part of my dissertation on barely parametric models for dependence. So it's not like I haven't the comfort with other dependence measures or with the theory. Rather, I would prefer a model for dependence that allows me to gain even some minimal insights about the economics or risk factors in a loan portfolio.

User-friendliness might be another term for what I'm getting at: I think copulas are not so user friendly; and, since all models *are* wrong and will eventually break, I prefer methods that I can easily debug when they do break. Sure, I could do all my time series modeling with Haar wavelets and build any function from simple functions; but I don't because it doesn't give me any insights into the problem. Good models should let the data speak clearly to give the modeler those insights.

We must take the Copula & its implementation seriously

relief en bronzeThere is crucial work going on the area of the implementation of the Copula. REvolution Computing provides the platform to implement this crucial analytic properly now, REvolution obviates the need for mathematical convolution in the face of memory or time constraints so no longer is academic specification and elaboration of the technique "pie in the sky"; REvolution can put this technique into production in a robust fashion.

 

"Recipe for Disaster: The Formula That Killed Wall Street" The Li formula is a quick-and-dirty approach. Problems:

1. It uses just one number for the correlation between returns on two assets. That ignores subtleties such as that maybe the up-sides of the two assets are highly correlated but the down-sides are not.

2. The correlation was estimated from market beliefs about the correlation. If the market was wrong, so was the correlation.

3. The correlation was estimated from market beliefs during a particular small period of time- the housing boom post-2001. A housing bust might behave differently.

4. Small mistakes in the correlation estimate could result in giant mistakes in the valuation.

"Investment banks would regularly phone Stanford's Duffie and ask him to come in and talk to them about exactly what Li's copula was. Every time, he would warn them that it was not suitable for use in risk management or valuation. " [Rasmussen]

"The outputs came from "black box" computer models and were hard to subject to a commonsense smell test." The quants, who should have been more aware of the copula's weaknesses, weren't the ones making the big asset-allocation decisions. Their managers, who made the actual calls, lacked the math skills to understand what the models were doing or how they worked. They could, however, understand something as simple as a single correlation number. That was the problem.

Thus let us look at the material in my Analytic Bridge blog which documents the latest and practical ways to use the Copula

Implementation of the Copula - Interesting work from Italy and wider Europe
http://www.analyticbridge.com/profiles/blogs/implementation-of-the-copula

CDO Pricing with Copulae (Crucial Methodological Paper)
http://www.analyticbridge.com/profiles/blogs/cdo-pricing-with-copulae

The Copula AGAIN - Forecasting VaR and Expected Shortfall using Dynamical Systems
http://www.analyticbridge.com/profiles/blogs/the-copula-again-forecasting

 

Finance's Gaussian Copulas: The New Frankenstein Monster

Excerpts from an interesting article in relation to the post above: Copula is one of those fashionable buzzwords (Value-at-Risk is another one), which almost no one in the financial world had heard of a few years ago, and which have now become omnipresent. Copulas are used to transform general multivariate distributions into related multivariate uniform distributions, in order to study the dependence of the modified (uniform) random variables. For some reason, this makes the analysis simpler. There are several families of copulas, used to model different types of dependencies, but the Gaussian one is by far the most popular because of its widespread adoption by the financial industry.

Li's model allowed derivatives to be rated simply on that one correlation number. An article in The Economist states ("In Plato's Cave -- Mathematical models are a powerful way of predicting financial markets. But they are fallible" -- January 22, 2009): "the [ratings] agencies’ models were even less sophisticated than the issuers’," for instance not distinguishing between a BBB rated CDO [credit debt obligation] and a BBB rated corporate bond, despite their different risk profile. The issuers were even able to "build securities with any risk profile they chose, including those made up from lower-quality ingredients that would nevertheless win AAA ratings" because they knew (thanks to third-party companies) the models the rating agencies used to rate financial instruments.

From Wired: "Just about anything could be bundled and turned into a triple-A bond—corporate bonds, bank loans, mortgage-backed securities, whatever you liked," simply by creating a derivative with the "right" correlation number. The deceptive simplicity of the model attracted quants and, more dangerously, their non-quant bosses like moths to a flame, with the results we see today.

A key issue, emphasized in the Wired article, was that the copula model assumed correlation to be constant, although in practice it varies with time and is very sensitive to small changes in the inputs. Another problem was that the historical data for the credit default swaps (CDS) covered a very narrow range of market conditions - the period during which CDS were traded witnessed soaring house prices, so models only knew a world where there was a real-estate bubble. A similar comment was made in The Economist: "there was no guarantee that the future would be like the past, if only because the American housing market had never before been buoyed up by a frenzy of CDOs."

Source: http://engineered.typepad.com/thoughts_on_business_engi/2009/03/finance-are-simple-models-bad.html

Gaussian Copula formulas

I don't know much about economics John (nothing at all actually), but something about quantum mechanics and Mathematical Philosophy. I wondered if this formula was at all related to the expressions derived from De Broglie's Theorem and the use of Hamiltonian Operators to enable the proof of Time-Dependant and Independant Schroedinger equations when it comes to the prediction of particle location (protons) in spin matrices. Maybe it's related also to the discussions between Euclidean and Non-Euclidean Geometries and the ancient debate over Particular-Universal distinctions and also Godel's Slingshot. In short the mathematical debates and proofs about whether matter and anti-matter exist or co-exist, it's not a huge leap to see a parallel between such debates and the black hole of the current Global Economic Recession, but then again I am not an econometrist! Don't lose sleep over it I won't, large periods of life spent without two pennies to rub together make the problems of how to stay rich, well frankly irrelevant from a personal (and particular) viewpoint.

Are the key legislative pillars such as Basel II & III, UCITS IV and Solvency II forcing you to re-examine how you identify, measure and manage risk and capital?

Asymptotix work closely with our partners to help clients develop a more proactive, systematic and integrated approach to governance and risk management to deliver proper value.

Asymptotix can offer the support you need to deliver on time. Read more...
 

Is the goal of your website to sell services or products, educate, or collect data?

A positive customer experience is vital to conversion, no matter what your conversion goals may be. Our designers and developers will create a positive experience to maximize your conversions and deliver the optimal return on your investment. We strive to find the perfect balance between the web site’s design and functionality.

Asymptotix implements interactive solutions for European companies. From corporate websites to social communities, our clients will tell you an investment in building a scalable online experience will deliver long-term tangible benefits.

Based in Luxembourg we can help you all over Europe. Our multi-lingual team can work with projects and speak your language! Read more...