People are deploying AI to do things like figure out which movie script is going to be the most successful with an audience, or mediate between parents who are fighting over child custody. Those are both real uses of AI. There is an experimental system coming out that guides the conversational style between customer service agents and their clients, as well as guiding conversation style between colleagues. AI is being deployed predominantly for financial gain, but likely its greatest use could be for nonprofits.

The Real Uses Of AI Prove That

This deployment by companies is taking forms we never saw coming. It’s not just being used to recommend a song or a video you might like; it’s being used to recommend who gets a job, who gets a loan, or who gets bail. In theory, all of these things can be done by a pattern-recognition algorithm.

From A Song And A Video To A Loan And A Bail

When we think about our fast-thinking brain and our slow-thinking brain, consider that nobody makes money selling to your slow-thinking, creative, cautious, rational brain. They want to sell to your ancient, instinctive, snake-detection system. They want to trigger your fast-thinking brain to do something unconsciously and instinctively. That is a huge part of how people are making money, and especially making money off of AI.

Which Mind Would You Be More Successful Selling Something To?

As one federal judge put it to Jacob Ward, you could make the act of entering a guilty or not guilty plea far easier than it is now by deploying AI. Right now, you have to go to court, enter a plea in person, and jump through all sorts of hoops. Even though you could make that far more efficient, such as a right-or-left swipe on a phone, you don’t want to do that. The system is designed as it is in order to trigger your slow-thinking brain. You are made to stop and think about it.

But We, Like Our Slow-Thinking Brain, Are The Only Fit Judge

When Jacob Ward speaks to people who want to deploy AI for socially beneficial reasons, they complain that their clients—the museums, governments, and social service agencies that could benefit from AI—don’t have the money or the sophistication to deploy it.

Good AI Is Perfectly Possible, But Money Tends To Ruin It

The problem is that those algorithms are not as smart as we think they are, and we basically get addicted to using them. Through over-reliance, we would approach a place where we won’t know how to make those decisions without that kind of system involved, and those systems are going to shape our behavior in invisible ways that we will irresistibly follow.

Patterns On Top Of Patterns

There are all sorts of examples of ways we could make modern life more efficient. We could make it more efficient to figure out who to arrest, who gets a job, and who gets a home loan. But should we? Maybe instead we should encode some inefficiencies, some fundamental human values, that make the difference between our ancient, instinctive selves and our modern selves who are trying to create law and rationality and art and justice. In order to be the best version of ourselves, we may need to push back against technology that is trying to make money off the people we never intended to be.

We Need To Learn Our Patterns And Preserve Our Inefficiencies

The fast-thinking brain is the one we’ve had for around 30 million years. We have aspects of it in common with primates and monkeys, and it is the system that allows us to make rapid decisions without having to talk it through or blow any calories. This system allows us to make all kinds of decisions, like what food we’re going to eat, what people were going to trust, and which dangers might slide into our lives.

The Fast-Thinking Brain

For instance, one researcher was telling him that if someone gave him an AI system and access to all of the birth certificates issued in the United States each year, he could specifically identify which apartments need to be stripped and repainted to avoid lead poisoning of millions of children a year. It would be an incredibly useful purpose to put AI to. The trouble is, nobody’s making money taking lead paint out of buildings.

Benefit Is Good. But Profit Is Better. 

In many surveys, it’s been shown that leaders of companies who rely on AI systems to make important decisions don’t care how it works because it works well enough. Combine all that with the fact that we humans are prone to believing the verdicts of systems we don’t understand, and you wind up in a dangerous situation. We take, on faith, the verdict of relatively simple systems that no one is able to actually look inside.

Judging Is Forming An Opinion. AI Can’t Do That Either. 

The other brain is the slow-thinking brain, which is a much more recent development in evolutionary terms. It’s probably only about 70,000 to 100,000 years old. This is the system that we use to make creative, cautious, rational decisions, and it’s super glitchy, according to the people who study it. It’s the system that we use to invent things like law and art. It’s also central to what we think of as being human. Researchers have discovered that we use our fast-thinking, instinctive brain most of the time, but we think we’re using our creative, cautious, rational mind most of the time.

The Slow-Thinking Brain

Companies are using AI to predict patterns you don’t even know you have. You can experience this in many ways in your day-to-day life. If you let Spotify recommend a song to you, it will probably do a pretty good job. If you watch a YouTube video, the next one the platform recommends will probably be one that you would be interested in watching. There’s almost no category of technologically-driven company that isn’t trying to predict what you will do next, and they’re increasingly using AI for that purpose.

Systems “See” Patterns Where Humans Don’t

What’s missing from so much of the talk about AI is understanding how simple its process is. An AI might look at dogs and cows and find the easiest variables to distinguish between those two categories, such as size or basic behaviors, and so it renders a verdict. It says this is a cow, and this is a dog . The problem is we humans look at that and think, wow, this thing is amazing. It’s a dog and cow expert!  But the truth is, it doesn’t actually know anything about dogs and cows. It only knows the bare minimum information it needs for picking patterns that allow it to tell the difference.

Telling Cows From Dogs Isn’t Exactly Genius

This is true no matter what you throw at an AI system. If you have an AI system trying to determine which person in a photograph is most likely to be a security threat, it’s going to use the same comparatively stupid way of drawing a distinction that it might use to draw a distinction between dogs and cows. Yet when you ask the makers of an AI system how their algorithms know the difference between these two things, the creators may not know. They are not legally required to know, and it’s not a technical requirement for the system. They don’t really know how their AI works most of the time.

Knowing Is Being Able To Explain. AI Can’t Do That. 

Pattern-based behavior turns out to have everything to do with using our fast-thinking brain. When you put that brain under pressure and starve it of some essential information, it makes all kinds of decisions in ways that we can predict using formulas. Those predictable patterns in human behavior make us ripe for exploitation by pattern-based systems like AI.

Pattern-Based Behavior And Pattern-Based Systems - Us And AI

It is always going to be the case that AI can make us money and save us time by being deployed on a problem. There is no guarantee that it would solve the problem in an ethically viable way, but it could make a problem easier to deal with, like require fewer employees. All sorts of benefits can accrue when you sic AI on a problem.

AI, Like Our Fast-Thinking Brain, Is Certainly A Fit Fixer

We make decisions using systems that rest on ancient evolutionary gifts. The last 50 years of behavioral science have established that, in a way, the brain can be thought of as two brains: a fast-thinking brain and a slow-thinking brain. This idea was popularized in Daniel Kahneman’s book, Thinking, Fast and Slow .

Human Behavior Is Pattern-Based 

AI is really just an ability to take an unstructured set of variables, a big mess of data that a human being could never take the time to look through, and find patterns. It will discern that if X and Y conditions are met, then Z outcome is probable. Take, for example, a system that distinguishes between dogs and cows. Let’s say you’ve got a room full of dogs and cows, and you ask the AI system to distinguish between them. It would find whatever variables it could that best predict the difference.

AI Is A Lot Simpler Than We Think

The most obvious patterns in our behavior—patterns an algorithm will use to make decisions about what's best for us—are not the ones we want to perpetuate.

Technology journalist Jacob Ward shares 5 key insights from his new book, The Loop: How Technology Is Creating a World Without Choices and How to Fight Back

Discover the world of business and economics.