Finding Signal In The Noise

How To Avoid The Noise Bottleneck

Finding Signal In The Noise -
How To Avoid The Noise Bottleneck. Picture of Jodrell Bank Observatory,

The Challenge Of Finding The Signal In The Noise

We are blessed and cursed to live in the digital age. We have access to more information than we can possibly handle yet we struggle to find the signal in the noise.

We are drowning in a tsunami of 24/7 news, a swamp of social media and cesspit of trivia and garbage.

Surface skimming

Like flat stones skimming the surface of a lake, we skim through endless articles and news reports and fill our heads with soundbites. But this is just superficial information and we delude ourselves, and try to delude others, that we know what we are talking about.

But as Shane Parrish puts it:

"...most people are operating on the same level of surface knowledge! So, in a twisted bout of game theory, we are rarely if ever called out on our bullshit (because people fear that we’ll call them out on theirs.)"

We entertain ourselves with social media and clickbait and see it as harmless fun, but it isn't because it fires up the pleasure receptors in our brain and make us temporarily feel good and it is addictive. The more we have of it the more we want.

Like junkies seeking their next fix, we gorge on information, blindly seeking substance beneath the froth and bubble.

Nassim Taleb frames this as striving for "more signal and less noise"

So how do we find the signal in the noise?

The noise bottleneck

In his book Antifragile Taleb makes the following observations:

  • We believe that the more information we consume the more signal we receive, but in practical terms this is just not true, it is a cognitive illusion.
  • As you consume more data, the ratio of noise to signal increases, the less you really know about what’s going on and the more likely you are to jump to the wrong conclusions and make the wrong decisions.
  • "The more frequently you look at data, the more noise you are disproportionally likely to get (rather than the valuable part called the signal); hence the higher the noise to signal ratio."
  • Taleb refers to this as "the noise bottleneck".
  • Taleb suggests that our brains are not hardwired to extract the signal from the noise and to understand the key point.
  • "... in a natural environment, a stressor is information. So too much information would be too much stress..."
  • " we overreact emotionally to noise."

Nassim Taleb's conclusions

  1. Access to too much information increases intervention  i.e. the "do something syndrome" - taking action makes us feel better because it makes us feel in control.
  2. Too much information causes us stress and we over-react, e.g. the panic-buying of various household items during the recent pandemic. Taleb notes how the media glorifies the anecdote.
  3. We need far less information and less frequently.
  4. We should ignore small changes in data measured over short periods of time and should only look at very large changes in data or conditions.

Know What To Ignore And Where To Focus Your Attention

Nassim Taleb offers a big picture perspective on finding the signal in the noise and one that resonates with me.

During the recent pandemic I found it very frustrating trying to get solid facts and reliable data and I came to the same conclusions as Taleb [although without his technical knowledge and expertise].

I learned to disregard the media and to seek out and focus on solid, evidence based, data provided by independent research organisations and the UK Government's Office of National Statistics.

But even with this data I found that it required a certain level of skill that, as a non-scientifically and statistically trained lay-person, I do not possess to attempt to interpret this data and come to sensible extrapolations and insights.

Fortunately, I found an excellent article by Shane Parrish in which he shared 7 tips on finding the signal in the noise from the late Richard Feynman:

[1] Do they really know what they are talking about?

Feynman suggests asking a series of direct questions, or watching a skillful interviewer asking, until the person doesn't know the answer. The honest person will admit that he/she does not know rather than trying to waffle and avoid a direct answer.

[2] Is it probably true vs. probably false?

This is about dealing with uncertainty, and here Feynman suggests testing the information with 2 different theories in a number of different scenarios to see which is stronger. The idea is  to evaluate each theory in each scenario to find a balance of probability of it being true, until one theory emerges as "probably true".

[3] A prediction should get stronger with repeat testing.

As we investigate whether something is true or not, Feynman advises  that new methods of experimentation and new evidence should show the predicted outcome as getting stronger and not weaker.

[4] Ask is it PROBABLE not is it POSSIBLE.

Feynman says that we have to ask the right question. So often we ask "Is this possible?" But Feynman says that we should ask: "Is this really the case? [Or "Is this how it is?"]

[5] You can only judge probability before it has happened.

Feynman is very clear that it is an error to base a conclusion on the probability of something based on what has already happened. You can only infer probability before it has happened.

[6] Anecdotes are not data.

Contrary to the way in which the media and popular opinion present inferences and "conclusions" based on anecdotes as certainties, Feynman is very clear that you need to use statistically sound sampling to arrive at 99% certainty, and this would require a sample size of 10,000 units or 10,000 attempts to replicate the prediction.

[7] The Rumsfeld factor

Feynman reminds us that many errors are caused because of missing information. I was never a fan of the politics of the late former US Secretary of Defense Donald Rumsfeld, but I always think he made a lot of sense when he said:

    The Art Of Being Wise Is The Art Of Knowing What To Overlook

    [William James]

Further Reading:

Next Article: The Checklist Manifesto - Your Personal Safety Net

Return from "Finding Signal In The Noise to": Walking The Talk

Or to: Mental Models

Contact me

English Chinese (Traditional) Russian French German Italian Spanish Vietnamese


  1. Drop The Story - Deal With Your Demons and Transform Your Experience

    Are you living your life from the stories you tell yourself? Learning how to drop the story and deal with that voice in your head can be a game changer. When you can do this you will have a powerful t…

    Read More

  2. Standing In The Gap Between No Longer And Not Yet

    Standing In The Gap In Conditions Of Imposed Change. This is about imposed change and surviving a dire and desperate situation where you are stuck in a difficult or seemingly impossible set of circums…

    Read More

  3. Preparing The Ground - For Things You Can Not See

    We plough the fields and scatter the good seed on the ground. The phrase "preparing the ground" is a metaphor for making the necessary preparations to create the favourable conditions for something to…

    Read More

  4. Easing The Weight Of Expectation

    Don’t you often feel like you are carrying the weight of the world on your back? Our start point is understanding that the ego has a very clear idea of how things ought to be, and its intention and ex…

    Read More

  5. Coram Deo - Living In Consciousness

    In you there is a dimension of consciousness far deeper than thought. It is the very essence of who you are. Coram Deo is about living in consciousness. It is a Latin phrase which literally means “to…

    Read More

  6. The Power Of Patience - Why You Need The World's Toughest Quality

    Nothing in the world can take the place of patience. Patience and persistence are omnipotent. In everyday life, patience is often overshadowed by the desire for immediate results. We live in an era of…

    Read More

  7. Demonizing The Other and Personal Acts Of Compassion

    What Does Demonizing The Other Mean? Demonizing the other refers to the act of portraying a group of people or an individual as inherently evil, threatening, or inferior. It often serves to justify di…

    Read More

  8. Why You Should Embrace Anomalies - The Incredible Value Of Disconfirming Evidence

    Is Your Desire To Be Right Greater Than Your Desire To Have Been Right? An anomaly is a deviation from what is expected or commonly regarded as the norm. It often appears as an unexpected observation…

    Read More

  9. Amazing Grace - The Majesty And The Mercy of Freedom From Your Pain

    "I once was lost, but now I am found, was blind, but now I see." The hymn and popular song "Amazing Grace" was written 250 years ago by John Newton, a former slave trader who in 1748 nearly died in a…

    Read More

  10. The Transformative Power Of Acceptance

    Experience The Power Of Acceptance. This website contains about 500,000 words. You could read every single word and it wouldn't make any real difference to you. You might become better informed, but t…

    Read More


Support This Site