Science writer Steven Johnson has said that innovation is the result of accumulated hunches over time: it’s what happens when we let personal experience collide with environments that bring out creativity. From this perspective, world-changing inventions—from the x-ray to penicillin—are just “<a href="https://www.nature.com/articles/d41586-018-01405-7">happy accidents </a>” that illustrate intuition in action.

Many researchers, including machine learning experts and data scientists, are <a href="https://www.datasciencecentral.com/profiles/blogs/bridging-data-science-and-business-intuition">embracing </a>the role intuition plays in breakthrough thinking. Intuition is now considered simply another kind of data—one that’s <a href="https://hbr.org/2013/12/big-data-and-the-role-of-intuition">no less valuable </a>than traditional analytics.

The human mind is <a href="http://bigthink.com/endless-innovation/humans-are-the-worlds-best-pattern-recognition-machines-but-for-how-long">wired to see patterns </a>. Not only does the brain process information as it comes in, it also stores insights from all your past experiences. Your intuition has been developing and expanding for as long as you’ve been alive. Every interaction, happy or sad, is cataloged in your memory. Intuition draws from that deep memory well to inform your decisions going forward.

Big data isn’t going anywhere, nor should it. But we tend to grossly undervalue the role intuition plays in decision-making, especially at high levels of leadership. In a time where we all tasked with processing the deluge of information coming at us daily, sometimes it’s worth going with your gut.

One study showed that this type of thinking yields real business results: <a href="https://www.biznews.com/thought-leaders/2014/04/22/intuition-great-ceos-great-intuition-can-learn-gut-feel/">81% of CEOs </a>with high intuition scores doubled their business in five years.

There’s no denying that data helps you present your case to your team or company leadership. Statistical analysis can put your findings into context and make a strong argument for more funding or development. Intuition, on the other hand, helps you gauge whether your discovery feels accurate and on-point. Using intuition to do a “gut check ” can help you earn credibility. You’re less likely to present a discovery that has holes and more likely to communicate your findings in a way that’s relatable.

3. Use Intuition To “Gut-Check” Your Data

Being itself faster than rational thought, intuition is a necessary skill that can help decision-making when time is short and traditional analytics may not be available.

In other words, intuitive decisions are based on data, in a way. When we subconsciously spot patterns, the body starts firing neurochemicals in both the brain <a href="http://www.hopkinsmedicine.org/health/healthy_aging/healthy_body/the-brain-gut-connection">and gut </a>. These “<a href="https://hbr.org/2013/12/the-focused-leader">somatic markers </a>” are what give us that instant sense that something is right … or that it’s off. Not only are these automatic processes faster than rational thought, but your intuition draws from decades of diverse qualitative experience (sights, sounds, interactions, etc.) – a wholly human feature that big data alone could never accomplish.

In many instances, it’s virtually impossible to make decisions without using data. If a company has been collecting and relying on data for decades and is thriving, for instance, there’s no sense in completely throwing out the old playbook. Big data can point out patterns that are too subtle for our brains to detect. Analytics don’t necessarily have to overrule human judgement, but they can complement it.

Cultivating intuition doesn’t just rely on your brain’s ability to detect patterns. It also requires empathy, a skill that can be a huge competitive advantage. Empathy allows you to observe a problem, see how it affects others, and determine how you can fix it. For example, Linkedin’s “People You May Know” feature was developed based on strong hunch that people would be curious to know what their former colleagues and contacts are up to. There wasn’t much hard evidence to prove that the idea would be successful. It sprung up from a deeper knowing of what drives human needs and desires.

4. Hone your empathy

Because each person’s intuition is based on a collection of individual experiences, it is subject to opinion and bias.

Where Intuition Can Go Wrong

Rather than trying to value one over the other, leaders can combine insights from big data and intuition to make decisions. This approach gives them the best of both worlds. Here’s how to use it:

In the age of big data, relying on intuition—what others call gut, instinct, a sixth sense or a hunch—can seem like a cop-out or an inferior system.But according to a <a href="https://smith.queensu.ca/insight/articles/intuition_in_the_age_of_big_data">survey </a>of top executives, the majority of leaders leverage feelings and experience when making handling crises. And despite popular belief, intuition isn’t a woo-woo concept exclusively reserved for the touchy-feely self-help world. There’s actually a neurological basis for it.

Management expert Travis Bradberry <a href="https://qz.com/880678/intuition-is-more-powerful-than-intellect/">recently wrote </a> that highly intuitive people tend to:<ul><li>Be more mindful and seek out solitude</li><li>Practice empathy accurately, tuning into nuances like body language more closely</li><li>Nurture their creativity through a love for the arts</li></ul>

A hypothesis, whether in the boardroom or in a lab, is a hunch. It’s an educated guess fueled by intuition, and it can point you in the direction of a potentially remarkable discovery. Once you have a theory, you can put it to the test with data. If intuition is the spark, data is the kindling that allows the fire to burn. Validating, then iterating, provides a method for exploring the hunch further.

2. Use intuition to develop a theory and test it with data

It’s not a war of <a href="https://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/where-machines-could-replace-humans-and-where-they-cant-yet">AI versus humans </a>. Intuition and big data can exist in harmony, especially if companies actively create teams that combine people from diverse backgrounds and schools of thought. Both intuition and data can lead to insights and breakthroughs. Rather than seeing yourself at odds with colleagues who use the opposite technique, be open to the insights they have. Teams that are echo chambers for one way of thinking lead to groupthink and squelch creativity.

1. Don’t pit data and intuition against each other

Despite popular belief, intuition isn’t a woo-woo concept exclusively reserved for the touchy-feely self-help world. There’s actually a neurological basis for it.

Similar ideas

CHARLES DUHIGG

Ray Dalio’s Formula for a Successful Life

Using a Personal List Of Values