Product Management Skills: A/B Testing - Deepstash
Product Management Skills: A/B Testing

Product Management Skills: A/B Testing


198 reads

Product Management Skills: A/B Testing

Keep reading for FREE

A/B Testing

A/B testing involves splitting your audience/user base into two groups. The two groups receive two versions of a feature. After a specified time, the product manager will look at the data gathered to know which version should be used for the entire user base.

The point of running a test is to use data to best improve your product.


34 reads

  • The first step is to decide what you're trying to find out.  Base your hypothesis on real pain points within your product. Find something that you need to fix and consider ways to fix it.
  • Decide how you'll be measuring the results.


39 reads

Before you deploy the test, you need to make sure it meets the minimum acceptance criteria.

Every test in your backlog needs to have a detailed:

  • Hypothesis
  • Definition
  • Implementation plan
  • Expected outcome

Once you've set the minimum criteria, you can deploy.


33 reads

A/B Testing vs Multivariate Testing

These two tests are not opposites, but two ways of approaching the same problem - the need to test your ideas.

Multivariate testing is used if you have many variables to test at once and if your userbase is big enough to create multiple segments.


28 reads

The biggest mistake you can make after running an A/B test is to just pick the winner and forget about the test.

Testing is about understanding the reason why. Your users have given you more information about themselves, and to serve them properly you need to take advantage of that. Also make the data available to other teams as they may gain unique insights from it.


29 reads

If you’re a larger organization, Optimizely may be suitable for deploying powerful tests and managing the insight you glean from them.

If you’re on a tight budget, many developers like to keep it simple with Google experiments.


35 reads


It's time to
Read like a Pro.

Jump-start your

reading habits

, gather your



remember what you read

and stay ahead of the crowd!

Save time with daily digests

No ads, all content is free

Save ideas & add your own

Get access to the mobile app

2M+ Installs

4.7 App Rating