Computers Evolve a New Path Toward Human Intelligence

It goes beyond traditional evolutionary approaches. It explains innovation. Instead of optimizing for a specific goal, it embraces the creative exploration of a diverse population of solutions.

The steppingstone’s potential can be seen by analogy with biological evolution: feathers likely evolved for insulation and only later became handy for flight.

Biological evolution is the only system to produce human intelligence.

If we want algorithms that can navigate the physical and social world as we do, we need to imitate nature's tactics. Instead of hard-coding for specific metrics, we must let a population of solutions blossom that may discover an indirect path or a set of stepping stones to allow them to evolve better than if they'd received those skills directly.

Pursuing specific goals can be a hindrance to reaching those objectives.

Kenneth Stanley, a computer scientist, hoped to show that by following ideas in interesting directions, algorithms can produce a diversity of results and solve problems. Thus, ignoring an objective can get you to the solution faster than pursuing it. He showed this through an approach named novelty search.

Cons

• It requires a considerable amount of computation.
• Most people want to solve a particular problem. Neuroevolution might get you to a creative solution but could lead you astray before it puts you on the right path.

Pros

• Other AI, like reinforcement learning, can lead to short-terms gains, but will eventually get stuck in a rut. Random exploration in the steppingstone principle can beat the best algorithms. 
• Open-ended exploration might lead to human-level intelligence via paths we would never have anticipated.

• Maintaining a population of different solutions
• Optimizing a single solution.