Product Management Skills: A/B Testing - Deepstash
Product Management Essentials

Learn more about product with this collection

Essential product management skills

How to work effectively with cross-functional teams

How to identify and prioritize customer needs

Product Management Essentials

Discover 57 similar ideas in

It takes just

8 mins to read

A/B Testing

A/B Testing

A/B testing involves splitting your audience/user base into two groups. The two groups receive two versions of a feature. After a specified time, the product manager will look at the data gathered to know which version should be used for the entire user base.

The point of running a test is to use data to best improve your product.

14

128 reads

Develop a hypothesis

  • The first step is to decide what you're trying to find out.  Base your hypothesis on real pain points within your product. Find something that you need to fix and consider ways to fix it.
  • Decide how you'll be measuring the results.

14

129 reads

Set the parameters for the test

Before you deploy the test, you need to make sure it meets the minimum acceptance criteria.

Every test in your backlog needs to have a detailed:

  • Hypothesis
  • Definition
  • Implementation plan
  • Expected outcome

Once you've set the minimum criteria, you can deploy.

14

118 reads

A/B Testing vs Multivariate Testing

A/B Testing vs Multivariate Testing

These two tests are not opposites, but two ways of approaching the same problem - the need to test your ideas.

Multivariate testing is used if you have many variables to test at once and if your userbase is big enough to create multiple segments.

15

114 reads

What to Do With The Data

The biggest mistake you can make after running an A/B test is to just pick the winner and forget about the test.

Testing is about understanding the reason why. Your users have given you more information about themselves, and to serve them properly you need to take advantage of that. Also make the data available to other teams as they may gain unique insights from it.

14

107 reads

A/B Testing Tools

If you’re a larger organization, Optimizely may be suitable for deploying powerful tests and managing the insight you glean from them.

If you’re on a tight budget, many developers like to keep it simple with Google experiments.

15

113 reads

CURATED BY

tifmiller

Quantity surveyor

stash-superman-illustration

Explore the World’s

Best Ideas

200,000+ ideas on pretty much any topic. Created by the smartest people around & well-organized so you can explore at will.

An Idea for Everything

Explore the biggest library of insights. And we've infused it with powerful filtering tools so you can easily find what you need.

Knowledge Library

Powerful Saving & Organizational Tools

Save ideas for later reading, for personalized stashes, or for remembering it later.

# Personal Growth

Take Your Ideas

Anywhere

Organize your ideas & listen on the go. And with Pro, there are no limits.

Listen on the go

Just press play and we take care of the words.

Never worry about spotty connections

No Internet access? No problem. Within the mobile app, all your ideas are available, even when offline.

Get Organized with Stashes

Ideas for your next work project? Quotes that inspire you? Put them in the right place so you never lose them.

Join

2 Million Stashers

4.8

5,740 Reviews

App Store

4.7

72,690 Reviews

Google Play

Shankul Varada

Best app ever! You heard it right. This app has helped me get back on my quest to get things done while equipping myself with knowledge everyday.

Sean Green

Great interesting short snippets of informative articles. Highly recommended to anyone who loves information and lacks patience.

samz905

Don’t look further if you love learning new things. A refreshing concept that provides quick ideas for busy thought leaders.

Ashley Anthony

This app is LOADED with RELEVANT, HELPFUL, AND EDUCATIONAL material. It is creatively intellectual, yet minimal enough to not overstimulate and create a learning block. I am exceptionally impressed with this app!

Laetitia Berton

I have only been using it for a few days now, but I have found answers to questions I had never consciously formulated, or to problems I face everyday at work or at home. I wish I had found this earlier, highly recommended!

Giovanna Scalzone

Brilliant. It feels fresh and encouraging. So many interesting pieces of information that are just enough to absorb and apply. So happy I found this.

Jamyson Haug

Great for quick bits of information and interesting ideas around whatever topics you are interested in. Visually, it looks great as well.

Ghazala Begum

Even five minutes a day will improve your thinking. I've come across new ideas and learnt to improve existing ways to become more motivated, confident and happier.

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving & library

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Personalized recommendations

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates