6 Ways to Leverage Data From Losing or Inconclusive A/B Testing #1-#2 - Deepstash
Onboarding Matters

Learn more about marketingandsales with this collection

How to create a successful onboarding process

Why onboarding is crucial for customer retention

How to measure the success of onboarding

Onboarding Matters

Discover 54 similar ideas in

It takes just

8 mins to read

6 Ways to Leverage Data From Losing or Inconclusive A/B Testing #1-#2

Try Something Really Different

Inconclusive test results could mean your variations are too close. A/B testing can help you see if a small change impacts conversions, but sometimes those tiny tweaks don’t have much impact at all.

Analyze Different Traffic Segments

  • new versus returning customers
  • buyers versus prospects
  • specific pages visited
  • devices used
  • demographic variations
  • locations or languages

7

16 reads

MORE IDEAS ON THIS

#3-#4

Look Beyond Your Core Metrics

You might have hidden data in your losing test results.

E.g. Look at your “losing” ad to see if it drove less traffic but had higher conversions. If you’d only been looking at traffic & revenue, you might not have noticed this ad works be...

7

9 reads

How Do You Know If You Have a Losing or Inconclusive A/B Test?

How Do You Know If You Have a Losing or Inconclusive A/B Test?

An inconclusive test might mean the numbers are less than a percent off, or neither variation got any traffic at all. When your tests don’t have enough data or if the numbers are too close, they are considered inconclusive or statistically insignificant.

7

63 reads

#5-#6

Look for Biases & Get Rid of Them

Look for factors that could have impacted your test.

  • Did you run a promotion?
  • Was it during a traditionally busy/slow season in your industry?
  • Did a competitor’s launch impact your tests?

Try to separa...

7

15 reads

CURATED FROM

CURATED BY

phaedrus

Digital Marketer Welcome to my Deepstash where I share ideas I find most valuable for those who wish learn more about digital marketing!

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving & library

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Personalized recommendations

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates