The Illusion of Validity

Today’s New York Times Magazine had an article about the hazards of confidence, by Nobel Prize-winning economist Daniel Kahneman, adapted from his forthcoming book Thinking, Fast and Slow. Kahneman describes some team-building exercises he engaged in many years ago in the Israeli Army, that were used to predict the leadership qualities of soldiers. It turned out that these exercises had no predictive power whatsoever, yet those who participated and evaluated the results continued to believe in their value, even after seeing their lack of predictive power. It must just seem intuitively obvious that those who exhibit the most skill at such tasks as figuring out how to get the team over a wall, would perform best at leadership tasks in the military. Kahneman calls this cognitive fallacy, the illusion of validity.

Kahneman noticed a similar phenomenon in studying the work of stock traders. He discusses studies showing that stocks that traders sell actually out-perform the stocks they continue to hold. It seems that a lot of stock traders would show just as good or better results if they didn’t even bother coming to work. Kahneman once analyzed the performance of a group of investment advisers, finding that none of these advisers managed to out-perform the others when their results were compared over a number of years, suggesting that theirs is a game of chance more than skill. Yet every year, bonuses were awarded based on individual performance, and the best-performing advisers each year no doubt congratulated themselves on the results they had achieved for their clients. These economic and psychological studies show that it is difficult to shake people’s belief in their own powers of prediction, or in the validity of the tools they use to make decisions, even when those tools are shown to have no predictive power.

In mediation, we see these kinds of cognitive fallacies, and others, all the time. Parties and their attorneys make predictions of success based on inadequate or even misleading or worthless information. Parties believe, understandably, in the validity of their positions; and attorneys are expected to show confidence in their clients’ cases, as well as in their own skills. Part of the mediator’s job may be to shake people’s confidence in their predictive powers, something that Kahneman’s work suggests may be impossible to do. It is also a tricky thing to attempt when the mediator is at the same time trying to show empathy and understanding for each party’s predicament. So I might tell a party that they should place great reliance on their attorney’s evaluation that they have a 75% chance of winning their case at trial. But they might also want to take into account that the other side’s attorney thinks their side has a 75% chance of winning. It’s not that either attorney is wrong, it’s that the outcome of cases might be a bit harder to predict than people think it is.

(Tim Enthoven illustration from NY Times article)

                       

Joe Markowitz

Joseph C. Markowitz has over 30 years of experience as a business trial lawyer.  He has represented clients ranging from individuals and small businesses to Fortune 500 corporations.  He started practicing with a boutique litigation firm in New York City, then was a partner in a large international firm both… MORE >