IQ is one of the most widely cited and versatile tools in psychology. It aims to measure the innate intelligence of the human population. IQ tests work by aggregating the scores from several distinct tasks into a singular number representing the person’s cognitive ability. However, the tests have many methodological flaws and do more harm than good.

IQ - intelligence quotient

One of the biggest issues with using IQ is the degree to which any test measures the construct it proclaims. IQs construct does not exist<ul><li>in the sense used in scientific measures</li><li>or knowing what differences on the 'inside' are being truly reflected in the scores on the 'outside.' This is simply because few agree on what happens on the 'inside.'</li></ul> In job performance, the correlations in IQs are doubtful. There is little if any correlation with later job performance or other markers of success. The job performance measures that many studies rely upon are themselves not reliable.

Questioning construct validity

The degree to which IQ may have a genetic foundation is questioned. The work done by behavioural geneticists rests upon <ol><li>studies with fraternal and identical twins, and </li><li>studies which survey the whole genome to find genes linked to certain traits.</li></ol> But both of these measures have methodological problems because they rely on assumptions. For example, heritability is based on outdated models that don't account for epigenetics, the study of how your environment causes changes in your genes.

Biological failings

IQ, short for intelligence quotient, is one of the most widely cited and versatile tools in psychology, spanning thousands of studies across more than a century of research. Aiming to measure the innate intelligence of the human population, IQ tests work by aggregating the scores from several distinct tasks into a singular number representing the person’s cognitive ability. The tests also have numerous methodological flaws that we’re only just beginning to understand.“I think IQ testing has done far more harm than good," says British Psychologist Ken Richardson, author of <a href="https://www.cambridge.org/us/academic/subjects/life-sciences/neuroscience/understanding-intelligence" rel="noopener" dir="ltr">Understanding Intelligence</a>. “And it's time we moved beyond the ideologically corruptible mechanical model of IQ to a far deeper and wider appreciation of intelligence.”<h2>Questioning Construct</h2><a href="https://www.sciencedirect.com/topics/social-sciences/construct-validity" rel="noopener" dir="ltr">Construct validity</a>, or the degree to which any test can be said to measure the construct it proclaims, is one of the largest issues with using IQ as a scientific measure. According to Richardson, IQ’s construct validity doesn't exist: “Not in the sense used in biomedical and other scientific measures, or knowing what differences on the 'inside' are being truly reflected in the scores on the 'outside.' That's because there is little agreed-on theory of what happens on the 'inside.’”As discussed in a <a href="https://www.sciencedirect.com/science/article/abs/pii/S2211368119300658#!" rel="noopener" dir="ltr">2019 review</a>, published in the Journal of Applied Research in Memory and Cognition, what’s commonly touted as “general intelligence” is instead little more than a statistical artifact resulting from the same brain regions being activated for similar tasks on an IQ test.On the other hand, one of the things IQ is most famous for is the shape of its score distribution. When the scores of a group of test-takers are put on a graph, they generally follow a bell-shaped curve — what’s known as the <a href="https://www.britannica.com/topic/normal-distribution" rel="noopener" dir="ltr">normal distribution</a>. It’s commonly said that IQ naturally falls this way, thus spelling proof that it’s a legitimate construct. However, it’s actually artificially constructed to have an average of 100 and a standard deviation of 15.There’s also the issue of the correlational validity of IQ. A common argument in favor of IQ is that it correlates highly with other constructs, such as socioeconomic status, thus proving its validity. However, this falls apart under further scrutiny. The large-scale correlation between IQ and socioeconomic status could also be said to represent the unaccounted-for influence of income and wealth upon one’s testing conditions, for example.Likewise, Richardson and his colleagues have revealed that <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4557354/" rel="noopener" dir="ltr">job performance</a>, one of the most well-regarded correlations in intelligence testing, is empirically suspect. “The correlations wash out over time, and there is little if any correlation with later job performance or other indices of success,” he says.In fact, the link between job performance and IQ is extremely fragile — quite a bit of the research this link rests upon is decades old and composed of a wide variety of tests that aren’t easily comparable. The job performance measures that many such studies rely upon are themselves very flawed, adds Richardson, lacking standard reliability and validity to determine that an objective criterion of job performance is being measured.<h2>Biological Failings</h2>And there’s a further biological case to be made against IQ’s methodological soundness; the degree to which IQ may have a genetic foundation has been widely criticized. Work conducted by behavioral geneticists primarily rests upon twin studies (which assess the degree of similarity between identical and fraternal twins in relationship to a given trait) and <a href="https://www.genome.gov/about-genomics/fact-sheets/Genome-Wide-Association-Studies-Fact-Sheet" rel="noopener" dir="ltr">genome-wide association studies</a> (GWAS), which survey the whole genome to find specific genes that could be linked to a given trait at hand.Both of these measures, however, suffer from methodological issues. Psychologist Jay Joseph, in his book <a href="https://www.amazon.com/Trouble-Twin-Studies-Jay-Joseph/dp/113869892X" rel="noopener" dir="ltr">The Trouble With Twin Studies</a>, writes in-depth about how twin studies rest upon assumptions of equivalent raising environments for twins and non-twins — an assumption that often fails.And <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5538622/" rel="noopener" dir="ltr">according to Richardson</a>, GWAS often have numerous environmental confounds hidden beneath the surface. Researchers frequently fall prey to the false assumption that they’ve corrected them while using measures that hold additional confounds in and of themselves. What this research often shows, as opposed to a direct genetic link, is another way in which social inequality gets inherited: through societal and environmental measures.Further, the measures rest strongly upon the measure of <a href="https://www.britannica.com/science/heritability" rel="noopener" dir="ltr">heritability</a>, something noted for being based on outdated models that don’t account for recent genetic findings such as epigenetics, the study of how your environment causes changes in your genes. “I'm not sure it rests on any genetic foundation at all,” says Kevin Bird, who recently earned his Ph.D. from Michigan State University and has focused on how IQ helps to promote scientific racism. “The main thing they've found for the last several decades is that there is a correlation between similarity of IQ scores and genetic relatedness, but that tells you almost nothing,” says Bird.IQ as a measure that seemingly holds many issues, owing to its lack of construct validity, the flawed genetics research behind it, and its problematic correlations. Thanks to the work of a few scientists, we’re beginning to understand the extent to which its flaws prevail.

IQ tests are one of the most prominent tools in the modern psychologist's toolbox. They also have numerous methodological flaws.

Understand yourself and those around you.

psychology

Psychology

problemsolving

Problem Solving

scienceandnature

Science & Nature

IQ, short for intelligence quotient, is one of the most widely cited and versatile tools in psychology, spanning thousands of studies across more than a century of research. Aiming to measure the innate intelligence of the human population, IQ tests work by aggregating the scores from several distinct tasks into a singular number representing the person’s cognitive ability. The tests also have numerous methodological flaws that we’re only just beginning to understand.

“I think IQ testing has done far more harm than good," says British Psychologist Ken Richardson, author of <a href="https://www.cambridge.org/us/academic/subjects/life-sciences/neuroscience/understanding-intelligence">Understanding Intelligence </a>. “And it's time we moved beyond the ideologically corruptible mechanical model of IQ to a far deeper and wider appreciation of intelligence.”

<a href="https://www.sciencedirect.com/topics/social-sciences/construct-validity">Construct validity </a>, or the degree to which any test can be said to measure the construct it proclaims, is one of the largest issues with using IQ as a scientific measure. According to Richardson, IQ’s construct validity doesn't exist: “Not in the sense used in biomedical and other scientific measures, or knowing what differences on the 'inside' are being truly reflected in the scores on the 'outside.' That's because there is little agreed-on theory of what happens on the 'inside.’”

As discussed in a <a href="https://www.sciencedirect.com/science/article/abs/pii/S2211368119300658#!">2019 review </a>, published in the Journal of Applied Research in Memory and Cognition , what’s commonly touted as “general intelligence” is instead little more than a statistical artifact resulting from the same brain regions being activated for similar tasks on an IQ test.

On the other hand, one of the things IQ is most famous for is the shape of its score distribution. When the scores of a group of test-takers are put on a graph, they generally follow a bell-shaped curve — what’s known as the <a href="https://www.britannica.com/topic/normal-distribution">normal distribution </a>. It’s commonly said that IQ naturally falls this way, thus spelling proof that it’s a legitimate construct. However, it’s actually artificially constructed to have an average of 100 and a standard deviation of 15.

There’s also the issue of the correlational validity of IQ. A common argument in favor of IQ is that it correlates highly with other constructs, such as socioeconomic status, thus proving its validity. However, this falls apart under further scrutiny. The large-scale correlation between IQ and socioeconomic status could also be said to represent the unaccounted-for influence of income and wealth upon one’s testing conditions, for example.

Likewise, Richardson and his colleagues have revealed that <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4557354/">job performance </a>, one of the most well-regarded correlations in intelligence testing, is empirically suspect. “The correlations wash out over time, and there is little if any correlation with later job performance or other indices of success,” he says.

In fact, the link between job performance and IQ is extremely fragile — quite a bit of the research this link rests upon is decades old and composed of a wide variety of tests that aren’t easily comparable. The job performance measures that many such studies rely upon are themselves very flawed, adds Richardson, lacking standard reliability and validity to determine that an objective criterion of job performance is being measured.

And there’s a further biological case to be made against IQ’s methodological soundness; the degree to which IQ may have a genetic foundation has been widely criticized. Work conducted by behavioral geneticists primarily rests upon twin studies (which assess the degree of similarity between identical and fraternal twins in relationship to a given trait) and <a href="https://www.genome.gov/about-genomics/fact-sheets/Genome-Wide-Association-Studies-Fact-Sheet">genome-wide association studies </a>(GWAS), which survey the whole genome to find specific genes that could be linked to a given trait at hand.

Both of these measures, however, suffer from methodological issues. Psychologist Jay Joseph, in his book <a href="https://www.amazon.com/Trouble-Twin-Studies-Jay-Joseph/dp/113869892X">The Trouble With Twin Studies </a>, writes in-depth about how twin studies rest upon assumptions of equivalent raising environments for twins and non-twins — an assumption that often fails.

And <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5538622/">according to Richardson </a>, GWAS often have numerous environmental confounds hidden beneath the surface. Researchers frequently fall prey to the false assumption that they’ve corrected them while using measures that hold additional confounds in and of themselves. What this research often shows, as opposed to a direct genetic link, is another way in which social inequality gets inherited: through societal and environmental measures.

Further, the measures rest strongly upon the measure of <a href="https://www.britannica.com/science/heritability">heritability </a>, something noted for being based on outdated models that don’t account for recent genetic findings such as epigenetics, the study of how your environment causes changes in your genes. “I'm not sure it rests on any genetic foundation at all,” says Kevin Bird, who recently earned his Ph.D. from Michigan State University and has focused on how IQ helps to promote scientific racism.

“The main thing they've found for the last several decades is that there is a correlation between similarity of IQ scores and genetic relatedness, but that tells you almost nothing,” says Bird.

IQ as a measure that seemingly holds many issues, owing to its lack of construct validity, the flawed genetics research behind it, and its problematic correlations. Thanks to the work of a few scientists, we’re beginning to understand the extent to which its flaws prevail.

Understanding the Flaws Behind the IQ Test

IQ - intelligence quotient

Questioning construct validity

Biological failings

Related collections

Other curated ideas on this topic: