gurus - Human-Centered Change and Innovation

Never Trust a Guru

GUEST POST from Greg Satell

In 2005 W. Chan Kim and Renée published Blue Ocean Strategy, which found that “blue ocean” launches, those in new categories without competition, far outperformed the shark-infested “red ocean” line extensions that are the norm in the corporate world. It was an immediate hit, selling over 3.5 million copies.

Bain consultants Chris Zook and James Allen’ published, Profit from the Core, around the same time. They found that firms that focused on their ”core” far outperformed those who strayed. For example, they warned that Amazon was putting itself from peril for expanding its business beyond books and predicted dire results.

Clearly, none of this makes sense. How can you both “focus on your core” and seek out “blue oceans?” It betrays logic that both strategies could outperform one another. Today, Amazon makes most of its money outside of books. Yes, new markets lack competitors, but they also lack customers. The truth is that most business research is surprisingly shoddy.

Cargo Cult Science

When Richard Feynman took the podium to give the commencement speech at CalTech in 1974, he told the strange story of cargo cults. In certain islands in the South Pacific, he explained, tribal societies had seen troops build airfields during World War and were impressed with the valuable cargo that arrived at the bases.

After the troops left, the island societies built their own airfields, complete with mock radios, aircraft and mimicked military drills in the hopes of attracting cargo themselves. It seems more than a little silly, and of course, no cargo ever came. Yet these tribal societies persisted in their strange behaviors.

Feynman’s point was that we can’t merely mimic behaviors and expect to get results. To illustrate what he meant, he told a story about going to a new-age resort where people were learning reflexology. A man was sitting in a hot tub rubbing a woman’s big toe and asking the instructor, “Is this the pituitary?” Unable to contain himself, the great physicist blurted out, “You’re a hell of a long way from the pituitary, man.”

What makes science real is not fancy sounding words or slick charts with numbers on them. Business gurus often boast of their “research” that consists of hundreds of case study interviews and large databases containing data on thousands of firms, but without the proper methods and controls, those things are meaningless.

The Problem With Case Studies

Organizations are often inscrutable and hard to research. That’s why the preferred mode of analysis is case studies in which insiders are interviewed and a particular situation is interpreted by investigators. These can be helpful, but they also have severe limitations.

First, with shareholders and customers to please, managers are rarely eager to talk about failures. So we usually only hear about successes. Those, of course, are important but also subject to survivorship bias. For example, if a risky strategy results in 1% of the firms being wildly successful and 99% going out of business, then we’ll tend to hear glowing accounts of that lucky 1% and we’ll miss the vast majority that flamed out.

Another issue with the case study method is that it is necessarily limited. When researchers did a case study on a company I used to run, to take just one example, they interviewed insiders (including me) and did their best to interpret what they heard and what they could glean from background information regarding the market.

While I don’t think anything was inaccurate, it wasn’t exactly the truth either. Only a handful of people were interviewed, almost all of them were concentrated in a single part of the business and none of them, besides me, were involved in making decisions. The issues presented in the case study simply weren’t the ones we were actually wrestling with.

The problem with case studies is that they offer little to no documentation. In more rigorous fields like, say, sociology or psychology, researchers are expected to share their data so that others can interpret it. Unfortunately, that’s rarely true in business research.

Working Around The Glitches In Our Brains’ Machinery

We tend to imagine that our minds are some sort of machines, recording what we see and hear, then storing those experiences away to be retrieved at a later time, but that’s not how our brains work at all. Humans have a need to build narratives. We like things to fit into neat patterns and fill in the gaps in our knowledge so that everything makes sense.

Psychologists often point to a halo effect, the tendency for an impression created in one area to influence opinion in another. For example, when someone is physically attractive, we tend to infer other good qualities and when a company is successful, we tend to think other good things about it.

The truth is that our thinking is riddled with subtle yet predictable biases. We are apt to be influenced not by the most rigorous information, but what we can most readily access. We make confounding errors that confuse correlation with causality and then look for information that confirms our judgments while discounting evidence to the contrary.

Unfortunately, so many of the popular management ideas today come from people who never actually operated a business, such as business school professors and consultants. These are often people who’ve never failed. They’ve been told that they’re smart all their lives and expect others to be impressed by their ideas, not to examine them thoroughly.

That’s why it’s so important to not to believe everything you think, there are simply too many ways to get things wrong and so few ways to get things right.

It’s More Important To Be Careful Than Smart

When I lived in Poland, a common aphorism advised that “life is cruel, and full of traps.” From an American perspective, the aphorism can be a bit of a culture shock. We tend to believe in the power of positivity, the American dream and the can-do spirit. Negativity can be seen as something worse than a weakness, both an indulgence and a privation at the same time.

Over the years, however, I came to respect the Poles’ innate suspicion. The truth is that we are far too easily fooled and taken in by those prey on the glitches in our cognitive machinery. Often business gurus have fooled themselves. They believe they have special powers of insight and get taken in by the glitches we all have in our mental machinery.

We get taken in because we want their claims to be true. We’d like to think that there is a secret we’re missing, that there’s a black magic that we’re not privy to and, if we prove our worth and obtain access to a few simple truths, we’ll capture the success that eludes us. Things can seem simple in a PowerPoint deck, but the truth is that the world is a messy place.

That’s why we need to train ourselves to ask the tough questions. What are we not seeing? What data is missing? What are alternative interpretations for the evidence being presented? It’s more important to be careful than smart. We can only make decisions on higher or lower levels of confidence. In the real world, there are no “sure things.”

— Article courtesy of the Digital Tonto blog
— Image credit: Pexels

Sign up here to join 17,000+ leaders getting Human-Centered Change & Innovation Weekly delivered to their inbox every week.

Don't Get Fooled by Hucksters, Gurus And Consultants

GUEST POST from Greg Satell

When I lived in Poland, it was common to say that “life is cruel, and full of traps.” From an American perspective, the aphorism can be a bit of a culture shock. We’re raised to believe in the power of positivity, the American dream and the can-do spirit. Negativity can be seen as something worse than a weakness, both an indulgence and a privation at the same time.

Over the years, however, I came to respect the Poles’ innate suspicion. The truth is that we are far too easily fooled and taken in by those prey on the glitches in our cognitive machinery. Sometimes the ones peddling bunk have fooled also themselves. Their claims seem to be supported by logic and evidence, but their promises never quite pan out.

We’re taken in because we want their claims to be true. We’d like to think that there is a secret we’re missing, that there’s a black magic that we’re not privy to and, if we prove our worth and obtain access to a few simple truths, we’ll capture the success that eludes us. Yet these frauds follow common patterns and there are telltale signs we can learn to spot.

1. The Survivorship Bias Trick

In 2005 W. Chan Kim and Renée Mauborgne, both distinguished professors at INSEAD, published Blue Ocean Strategy. In their study of 108 companies the authors found that “blue ocean” launches, those in new categories without competition, far outperformed the shark-infested “red ocean” line extensions that are the norm in the corporate world. It was an immediate hit, selling over 3.5 million copies.

Bain consultants Chris Zook and James Allen’ book, Profit from the Core, boasted even more extensive research encompassing 200 case studies, a database of 1,854 companies, 100 interviews of senior executives and an “extensive review” of existing literature. They found that firms that focused on their ”core” far outperformed those who strayed.

It doesn’t take too much thinking to start seeing problems. How can you both “focus on your core” and seek out “blue oceans”? It betrays logic that both strategies could outperform one another. Also, how do you define “core?” Core markets? Core capabilities? Core customers? While it’s true that “blue ocean” markets lack competitors, they don’t have any customers either. Who do you sell to?

Yet there is an even bigger, more insidious problem and it is a trick that hucksters, gurus and consultants regularly employ to falsely establish dubious claims. It’s called survivorship bias. Notice how “research” doesn’t include firms that went out of business because there were no customers in those “blue oceans” or because they failed to diversify outside of their “core.” The data only pertains to the ones that survived.

Can you imagine a medical researcher failing to include the results of patients that died? Or an airplane designer forgetting to mention the prototypes that crashed? Yet hucksters, gurus and consultants get away with it all the time.

2. Dressing Up Social Proof As “Research”

Another trick hucksters, gurus and consultants use is to dress up social proof as research in order to increase their credibility as experts and establish a need for their services. They say, for example, that they find company profitability is strongly correlated with a customer focus or that culture has a statistically powerful effect on performance.

At first glance, these claims seem reasonable, but as Phil Rosenzweig explained in The Halo Effect, it’s all part of a subtle bait and switch. What is being “researched” is not really “customer focus” or “culture,” but perceptions about those things in responses to a survey. So it is highly likely that successful companies are merely being perceived as having these traits.

For example, in 2000, before the dotcom crash, Cisco was flying high. A profile in Fortune reported it to have an unparalleled culture with highly motivated employees. But just one year later, when the market tanked, the very same publication described it as “cocksure” and “naive.” Did the “culture” really change that much in a year, with the same leadership?

Some might say that it’s “obvious” that a strong culture and customer focus contribute to performance, but then why go through the whole kabuki dance of “research?” Why not just say, “if you believe these things are important, we can help you with them?” It’s hard to avoid the conclusion that their is either an intent to deceive or just pure incompetence.

You don’t have to look far to see that this is an ongoing con. A few quick Google searches led me to major consulting firms currently selling halo effects as causal relationships to trusting customers here and here.

3. The VUCA World

Today it’s become an article of faith that we live in a VUCA world (Volatile, Uncertain, Complex and Ambiguous). Business pundits tell us that we must “innovate or die.” These are taken as basic truths that are beyond questioning or reproach. Those who doubt the need for change risk being dismissed as out of touch.

The data, however, tell a very different story. A report from the OECD found that markets, especially in the United States, have become more concentrated and less competitive, with less churn among industry leaders. The number of young firms have decreased markedly as well, falling from roughly half of the total number of companies in 1982 to one third in 2013.

A comprehensive 2019 study from the National Bureau of Economic Research found two correlated, but countervailing trends: the rise of “superstar” firms and the fall of labor’s share of GDP. Essentially, the typical industry has fewer, but larger players. Their increased bargaining power leads to more profits, but lower wages.

The truth is that we don’t really disrupt industries anymore. We disrupt people. Economic data shows that for most Americans, real wages have hardly budged since 1964. Income and wealth inequality remain at historic highs. Anxiety and depression, already at epidemic levels, worsened during the Covid-19 pandemic.

So why do hucksters, gurus and consultants insist that industries are under constant threat of disruption?

4. The Allure Of Pseudoscience

In Richard Feynman’s 1974 commencement speech at Cal-Tech, he recounted going to a new-age resort where people were learning reflexology. A man was sitting in a hot tub rubbing a woman’s big toe and asking the instructor, “Is this the pituitary?” Unable to contain himself, the great physicist blurted out, “You’re a hell of a long way from the pituitary, man!”

His point was that it’s relatively easy to make something appear “scientific” by, for example, having people wear white coats or present charts and tables, but that doesn’t really make it science. True science is testable and falsifiable. We can’t merely state what you believe to be true, but must give others a means to test it and prove us wrong.

This is important because it’s very easy for things to look like the truth, but actually be false. That’s why we need to be careful, especially when it’s something we already believe in. The burden is even greater when it’s an idea that we want to be true. That’s when we need to redouble our efforts, dig in and make sure we verify our facts.

Hucksters, gurus and consultants love to prey on our weakness for authority by saying that “the science says…” The truth is that science doesn’t “say”anything, it merely produces hypotheses that haven’t been disproven yet. Some, like Darwin’s theory of natural selection, have been around a long time, so we’re pretty sure that they’re true, but even in that case a large part of it was debunked within months. The ‘theory” as we know it now is what survived.

There are no absolute answers. There is, as Sam Arbesman has put it, a half life of facts. We can only make decisions on higher or lower levels of confidence. In the real world, there are no “sure things,” and don’t let hucksters, gurus and consultants tell you any different.

— Article courtesy of the Digital Tonto blog
— Image credits: Pexels