Kmart used to be a highly successful discount department-store chain with over 2,300 locations in the U.S. Their famous in-store promotion was the BlueLight Special, where a great deal would be announced at unknown times. This helped them clear out unwanted stock and gave shoppers an adrenaline rush that made them spend more money.

Kmart headquarters tried to scale it up by deciding where, when, and what product would be placed on the BlueLight Special across all stores. But customers in one store had different needs than customers in another store. Centralising the special ruined the brand.

Moving from creating evidence-based policy to one of producing policy-based evidence is a call to researchers, policymakers and business people to consider the following: If scaling an idea, what constraints should be taken into account when doing the original research?

For example, in the Chicago Heights Early Childhood program, researchers created a pre-school in a low-income Chicago neighbourhood to see what would produce the biggest educational gains. They hired the best teachers for their pilot program, but at scale, they’d have to hire 30,000 less-good teachers to stay within the budget.

The voltage effect describes what happens when you move from the small to the large. Most ideas experience voltage drops, when a seemingly great idea loses power as it is scaled.

How to fail at scaling

• You scale a program that was never tested.
• Humans don’t scale. Any time there is a human at the centre of the program, it will fail.
• Experts in their field assume that everyone else thinks hyper-rationally as they do, but people seldom think clearly in an area that is unfamiliar to them.

When a small startup firm or institution has some success and wants to get bigger, they should consider the following:

• Be as diverse as you possibly can, as early as you can. 
• Types of diversity are observable characteristics, like gender and race and the socioeconomic status of how you were raised. 

This will allow for a much deeper and more diverse set of ideas and solutions to problems and, consequently, a more productive organisation.

The best example of a product that scaled unbelievably well is Jonas Salk and the polio vaccination. He had an innovation, tested it out on his own kids, and then he ramped it up to test all kinds of different kids. It worked well and then leveraged the healthcare system.

The worst example is the Drug Abuse Resistance Education (D.A.R.E) program of Nancy Reagan. Police officers would go into school classrooms and teach kids about the dangers of drugs. The drug use didn’t fall and, in some cases, actually increased. The program was ineffective because it never had voltage to start with.

False positives arise for many reasons such as bad measurement, wishful thinking or simply because the world is messy and it can be difficult to establish cause and effect.

One reason why we don’t make as big an impact as we should is:

• We’re not really sure that this is going to ever scale.
• We are unsure that this is the correct result.

Results should be tested with, for example, Benford’s Law, to see whether the data have been fabricated.

The secret to high-voltage scaling is understanding when to quit. People generally don’t quit soon enough.

Usually, when someone wants to quit, it is because something went wrong. But, you should think more about the opportunity I’m giving up if I stick with it. If the opportunity changes for the better, I should quit more often. 

If you’re considering quitting, force yourself to compare your performance with your peer group. Consider if you have a comparative advantage in this particular activity.