“‘Does it make sense?’ will often cut a statistic down to size when the whole rigmarole is based on an unproved assumption.” Consider what they are saying and why they are saying it. If a statistic doesn’t seem right, or someone arrives at a conclusion that seems questionable, ask “Does it make sense”.

The common-sense test

If you want to use a test to measure something or somebody, it is equally important to know the limitations of the test. What can it not measure?  For example, an intelligence test does not measure leadership, creative imagination, diligence, and emotional balance. The test may still be useful for admission to a university or a job, but you should also understand its limitations.

Consider what it really measures

Averages, relationships, trends and graphs are not what they seem. Statistics can make an important fact look as if it is nothing noteworthy and a trivial fact like there may be more in it. Writers need statistical methods and statistical terms when reporting data of social and economic trends, but they need to use the words honestly, and readers need an understanding of what they mean. Otherwise, it may result in semantic absurdity.

The abused statistic

“The secret language of statistics, so appealing in a fact-minded culture, is employed to sensationalize, inflate, confuse, and oversimplify.”

It describes using one thing as a way to claim proof of something else, even if there exists no correlation between the two.Meaningless statements:<ul><li>“32% of doctors think Mercedes vehicles are safe."</li><li>“27 % of a large sample of eminent physicians smoke Throaties— more than any other brand.”</li></ul>Expressing the data to suit your view. For instance, express exactly the same fact by calling it a one % return on sales, a fifteen % return on investment, a ten-million-dollar profit, or a decrease of sixty % from last year.

The semidetached figure

<ol><li>Who says so? What is the agenda? Who will benefit from presenting the data that way? Does it tell the whole story or only the good or bad part? Does it misuse average? Does any bias come into play?</li><li>How do they know? Where did the data come from? Is it representative? Can it be biased? Is the sample big enough?</li><li>What’s missing? </li><li>Did someone change the subject between the raw data and the conclusion? Is it a real statistic, or what someone reported?</li><li>Does it make sense? Pay attention if it fails the common sense test. Is something complex reduced to a single number?</li></ol>

How to avoid blind belief in statistics

If B follows A, then A has caused B.For example:<ul><li>Assuming that since smoking and low grades go together, smoking causes low grades.</li><li>If you attend college, you will earn more money than if you decide to use the next four years in another way. The unwarranted assumption is that since college-trained people make more money, they make it because they went to college. However, we don’t know if these people would have made more money had they not gone to college.</li></ul>

Correlation vs. Causation

There are three common kinds of average: 
<ol>
<li>Mean. Add up all the values and divide by the quantity of the values.</li>
<li>Median. The value in the middle of the sample.</li>
<li>Mode. The most common value. </li>
</ol>
When a statistic cites the “average”, it could be the mean, median or mode, which can be drastically different. The unspecified “average” is used to prove a point while leaving out any numbers that might question their predetermined point.

The kind of average

“As long as the errors remain one-sided, it is not easy to attribute them to bungling or accident.” Statistics are often used to support a cause or agenda a person believes in, rather than to disprove them. When people err in their use of statistics, it is always in the direction of their beliefs or agenda. So, instead of getting an unbiased view of the world, we get a biased view that other people want us to see.

Statistics are always biased

For any statistic to be worth it, it should come from a representative sample of the group it is describing. But a representative sample is near impossible because of lack of time, resources, and other practical reasons. As a result, you are more likely to see a subset based on biases from the method of sampling rather than the representative group itself. When you see the statistic that, for example, represent the entire nation, ask yourself, “Which part of the nation?”

The representative sample

This book lays the groundwork for the many ways statistics are used to mislead people. Honest people must learn the tricks of statistics so that they can interpret data intelligently.

Over Half a Million Copies Sold--an Honest-to-Goodness Bestseller Darrell Huff runs the gamut of every popularly used type of statistic, probes such things as the sample study, the tabulation method, the interview technique, or the way the results are derived from the figures, and points up the countless number of dodges which are used to full rather than to inform.

problemsolving

Problem Solving

books

Books

If you want to outsmart a crook, learn his tricks—Darrell Huff explains exactly how in the classic How to Lie with Statistics. From distorted graphs and biased samples to misleading averages, there are countless statistical dodges that lend cover to anyone with an ax to grind or a product to sell. With abundant examples and illustrations, Darrell Huff’s lively and engaging primer clarifies the basic principles of statistics and explains how they’re used to present information in honest and not-so-honest ways. Now even more indispensable in our data-driven world than it was when first published, How to Lie with Statistics is the book that generations of readers have relied on to keep from being fooled.

Consider what it really measures

Similar ideas to Consider what it really measures

What is a beta reader?

Creative Burnout

More About An IQ Test