Survivorship Bias 101

History is written by the victors. But if we exclusively focus on these successes, we allow survivorship bias to distort our understanding of the world.

But what is "survivorship bias" and how does it work?

Here's Survivorship Bias 101!

👇👇👇

1/ First, a few definitions.

Survivorship bias is the logical error of concentrating on survivors (successes) and ignoring casualties (failures).

When we do so, we miss the true "base rates" of survival (the actual probability of success) and arrive at flawed conclusions.
2/ When we completely ignore failures, we lose our ability to correctly identify the differences between successes and failures.

Put simply, exclusively focusing on successes may actually inhibit our ability to identify (and replicate) the actions that led to such success.
3/ Cicero wrote on the topic over 2,000 years ago.

An atheist named Diagoras is shown portraits of people who prayed and were saved from death at sea as proof of God's existence.

Diagoras replies, "I see those who were saved, but where are those painted who were shipwrecked?"
4/ Cicero cuts right to the point - we cannot conclude that prayer led to being saved from the sea if we ignore those who prayed and then drowned.

Survivorship bias can lead to a deeply-flawed understanding of cause-and-effect relationships.

Let's look at some examples.
5/ One of the famous examples of survivorship bias comes from World War II.

The U.S. wanted to add reinforcement armor to specific areas of its planes.

Analysts plotted the bullet holes and damage on returning bombers, deciding the tail, body, and wings needed reinforcement.
6/ But a young statistician named Abraham Wald noted that this would be a tragic mistake.

By only plotting data on the planes that returned, they were systematically missing data on a critical, informative subset - the planes that were damaged and unable to return.
7/ The "seen" planes had sustained damage that was survivable.

The "unseen" planes had sustained damage that was not.

Wald concluded that armor should be added to the unharmed regions of the survivors.

Where the survivors were unharmed is where the planes were most vulnerable.
8/ Based on his observation, the military reinforced the engine and other vulnerable parts, significantly improving the safety of the crews during combat.

Wald had identified the survivorship bias and avoided its wrath.

Where else do we see survivorship bias arise?
9/ In business?

We all love business success stories. We love to read about companies and people who have achieved incredible success and fame.

We scan their backgrounds in desperate search of the actions or features that led to that success.

But these conclusions are flawed.
10/ For every entrepreneur who took out a second mortgage in a last-ditch attempt and succeeded, there may be 10 who did the same and went bankrupt.

For every company that pursued a moonshot idea and is now worth billions, there may be 10 who did the same and collapsed.
11/ In markets?

Analysts may try to calculate the performance of funds or groups of stocks using only the survivors at the end of the period.

By ignoring closed funds or stocks removed from an index, we bias the data and overstate returns.

Flawed data ➡️ Flawed decisions
12/ The point? By ignoring the companies or people who failed, we miss out on valuable data points from those cases.

To actively fight this, we must study the features of both successes and failures.

The "seen" and the "unseen" are equally important in guiding our decisions.
13/ As @nntaleb wrote in his classic, Fooled by Randomness, "Heroes are heroes because they are heroic in behavior, not because they won or lost."

So the next time you read a story of the hero who won, be sure to reflect on all of the heroes who lost, whose stories are not told.
14/ So that was Survivorship Bias 101. As someone who shares many success stories on Twitter, I thought it was an important topic to address.

Special thanks to @austin_rief of @MorningBrew, whose interesting tweet on new founders sparked this thread. https://t.co/ldSVsPP4uX
15/ For more on the topic of survivorship bias, I highly recommend the below resources.

Fooled by Randomness by @nntaleb: https://t.co/fB9ncIMlvE

Great blog from @ShaneAParrish and @FarnamStreet: https://t.co/o1T85OJMl7
16/ And for more educational threads on business, money, finance, and economics, check out my meta-thread below. Turn on post notifications so you never miss one! https://t.co/53UhhfzIcp

More from Sahil Bloom

THREAD: With #silversqueeze trending on Twitter, it appears that this week's market spectacle may well be in the silver market.

A perfect moment for a thread on the Hunt Brothers and their alleged attempt to corner the silver market...


1/ First, let's set the stage.

The Hunt Brothers - Nelson Bunker Hunt, William Herbert Hunt, and Lamar Hunt - were the sons of Texas tycoon H.L. Hunt.

H.L. Hunt had amassed a billion-dollar fortune in the oil industry.

He died in 1974 and left that fortune to his family.


2/ After H.L.'s passing, the Hunt Brothers had taken over the family holdings and successfully managed to expand the Hunt empire.

By the late 1970s, the family's fortune was estimated to be ~$5 billion.

In the financial world, the Hunt name was as good as gold (or silver!).


3/ But the 1970s were a turbulent time in America.

Following the oil crisis of the early 1970s, the U.S. had entered a period of stagflation - a dire macroeconomic condition characterized by high inflation, low growth, and high unemployment.


4/ The Hunt Brothers - particularly Nelson Bunker and William Herbert - believed that the inflationary environment would persist and destroy the value of their family's holdings.

To hedge this risk, they turned to silver.

They began buying the metal at ~$3 per ounce in 1973.

More from For later read

Wow, Morgan McSweeney again, Rachel Riley, SFFN, Center for Countering Digital Hate, Imran Ahmed, JLM, BoD, Angela Eagle, Tracy-Ann Oberman, Lisa Nandy, Steve Reed, Jon Cruddas, Trevor Chinn, Martin Taylor, Lord Ian Austin and Mark Lewis. #LabourLeaks #StarmerOut 24 tweet🧵

Morgan McSweeney, Keir Starmer’s chief of staff, launched the organisation that now runs SFFN.
The CEO Imran Ahmed worked closely with a number of Labour figures involved in the campaign to remove Jeremy as leader.

Rachel Riley is listed as patron.
https://t.co/nGY5QrwBD0


SFFN claims that it has been “a project of the Center For Countering Digital Hate” since 4 May 2020. The relationship between the two organisations, however, appears to date back far longer. And crucially, CCDH is linked to a number of figures on the Labour right. #LabourLeaks

Center for Countering Digital Hate registered at Companies House on 19 Oct 2018, the organisation’s only director was Morgan McSweeney – Labour leader Keir Starmer’s chief of staff. McSweeney was also the campaign manager for Liz Kendall’s leadership bid. #LabourLeaks #StarmerOut

Sir Keir - along with his chief of staff, Morgan McSweeney - held his first meeting with the Jewish Labour Movement (JLM). Deliberately used the “anti-Semitism” crisis as a pretext to vilify and then expel a leading pro-Corbyn activist in Brighton and Hove
Hi @EdinburghUni @EHRC @EHRCChair @KishwerFalkner @RJHilsenrath @trussliz @GEOgovuk

The DIVERSITY INFORMATION section in yr job application mentions 'legal equality duties'. You then ask "What is your gender identity?" with options

Female
Male
Non-binary
Not-listed
Other

1/13


'Gender identity' is not a protected characteristic under the Equality Act 2010 and is not defined in the Act.

https://t.co/qisFhCiV1u

2/13


Sex is the protected characteristic and the only two possible options for sex are 'Female' and 'Male' as defined in the Act and consistent with biology - 'non-binary' and 'other' are not valid options.

https://t.co/CEJ0gkr6nF

'Gender identity' is not a synonym for sex.

3/13


You then ask "Does your gender identity match your sex registered at birth?"

4/13


Again, 'gender identity' is not a protected characteristic under the Equality Act 2010 and is not defined in the Act.

https://t.co/qisFhCiV1u

5/13

You May Also Like