Buzz Blog

Physicist Proposes New Way To Think About Intelligence

Friday, April 26, 2013
A single equation grounded in basic physics principles could describe intelligence and stimulate new insights in fields as diverse as finance and robotics, according to new research.

These diagrams show how software that harnesses "causal entropic forces" emulates the intelligent behavior required to walk upright or use tools. Courtesy of Alexander Wissner-Gross
Alexander Wissner-Gross, a physicist at Harvard University and the Massachusetts Institute of Technology, and Cameron Freer, a mathematician at the University of Hawaii at Manoa, developed an equation that they say describes many intelligent or cognitive behaviors, such as upright walking and tool use. 
The researchers suggest that intelligent behavior stems from the impulse to seize control of future events in the environment. This is the exact opposite of the classic science-fiction scenario in which computers or robots become intelligent, then set their sights on taking over the world. 
The findings describe a mathematical relationship that can "spontaneously induce remarkably sophisticated behaviors associated with the human 'cognitive niche,' including tool use and social cooperation, in simple physical systems," the researchers wrote in a paper published today in the journal Physical Review Letters.  
"It's a provocative paper," said Simon DeDeo, a research fellow at the Santa Fe Institute, who studies biological and social systems. "It's not science as usual."
Wissner-Gross, a physicist, said the research was "very ambitious" and cited developments in multiple fields as the major inspirations. 
The mathematics behind the research comes from the theory of how heat energy can do work and diffuse over time, called thermodynamics. One of the core concepts in physics is called entropy, which refers to the tendency of systems to evolve toward larger amounts of disorder. The second law of thermodynamics explains how in any isolated system, the amount of entropy tends to increase. A mirror can shatter into many pieces, but a collection of broken pieces will not reassemble into a mirror.
The new research proposes that entropy is directly connected to intelligent behavior.
"[The paper] is basically an attempt to describe intelligence as a fundamentally thermodynamic process," said Wissner-Gross.
The researchers developed a software engine, called Entropica, and gave it models of a number of situations in which it could demonstrate behaviors that greatly resemble intelligence. They patterned many of these exercises after classic animal intelligence tests.  
In one test, the researchers presented Entropica with a situation where it could use one item as a tool to remove another item from a bin, and in another, it could move a cart to balance a rod standing straight up in the air. Governed by simple principles of thermodynamics, the software responded by displaying behavior similar to what people or animals might do, all without being given a specific goal for any scenario.
"It actually self-determines what its own objective is," said Wissner-Gross. "This [artificial intelligence] does not require the explicit specification of a goal, unlike essentially any other [artificial intelligence]."
Entropica's intelligent behavior emerges from the "physical process of trying to capture as many future histories as possible," said Wissner-Gross. Future histories represent the complete set of possible future outcomes available to a system at any given moment.
Wissner-Gross calls the concept at the center of the research "causal entropic forces." These forces are the motivation for intelligent behavior. They encourage a system to preserve as many future histories as possible. For example, in the cart-and-rod exercise, Entropica controls the cart to keep the rod upright. Allowing the rod to fall would drastically reduce the number of remaining future histories, or, in other words, lower the entropy of the cart-and-rod system. Keeping the rod upright maximizes the entropy. It maintains all future histories that can begin from that state, including those that require the cart to let the rod fall.
"The universe exists in the present state that it has right now. It can go off in lots of different directions. My proposal is that intelligence is a process that attempts to capture future histories," said Wissner-Gross.
The research may have applications beyond what is typically considered artificial intelligence, including language structure and social cooperation.
DeDeo said it would be interesting to use this new framework to examine Wikipedia, and research whether it, as a system, exhibited the same behaviors described in the paper.
"To me [the research] seems like a really authentic and honest attempt to wrestle with really big questions," said DeDeo.
One potential application of the research is in developing autonomous robots, which can react to changing environments and choose their own objectives.
"I would be very interested to learn more and better understand the mechanism by which they're achieving some impressive results, because it could potentially help our quest for artificial intelligence," said Jeff Clune, a computer scientist at the University of Wyoming.
Clune, who creates simulations of evolution and uses natural selection to evolve artificial intelligence and robots, expressed some reservations about the new research, which he suggested could be due to a difference in jargon used in different fields.
Wissner-Gross indicated that he expected to work closely with people in many fields in the future in order to help them understand how their fields informed the new research, and how the insights might be useful in those fields.
The new research was inspired by cutting-edge developments in many other disciplines.  Some cosmologists have suggested that certain fundamental constants in nature have the values they do because otherwise humans would not be able to observe the universe. Advanced computer software can now compete with the best human players in chess and the strategy-based game called Go. The researchers even drew from what is known as the cognitive niche theory, which explains how intelligence can become an ecological niche and thereby influence natural selection.
The proposal requires that a system be able to process information and predict future histories very quickly in order for it to exhibit intelligent behavior. Wissner-Gross suggested that the new findings fit well within an argument linking the origin of intelligence to natural selection and Darwinian evolution -- that nothing besides the laws of nature are needed to explain intelligence.
Although Wissner-Gross suggested that he is confident in the results, he allowed that there is room for improvement, such as incorporating principles of quantum physics into the framework. Additionally, a company he founded is exploring commercial applications of the research in areas such as robotics, economics and defense.
"We basically view this as a grand unified theory of intelligence," said Wissner-Gross. "And I know that sounds perhaps impossibly ambitious, but it really does unify so many threads across a variety of fields, ranging from cosmology to computer science, animal behavior, and ties them all together in a beautiful thermodynamic picture."

-Chris Gorski, Inside Science News Service
Chris Gorski is an editor for Inside Science News Service.
Posted by Buzz Skyline

9 Comments:

Zach Cox said...

The general idea that this relies on is quite sound. The underlying idea is the definition of consciousness.

Consciousness for any motile organism is the organism's ability to take its sensory inputs and use them to create a model of the future.

The only purpose of the model thus created is to allow the organism to successfully negotiate its environment.

This success, in turn, is the definition of what it means to say natural selection will select in favor of the organism.

Like every property of living organisms such a thing seems to be on a continuum of sophistication, all the way from cockroaches to birds, and mammals that are what we humans think of as conscious.

Sunday, June 2, 2013 at 9:23 PM

Anonymous said...

'The researchers suggest that intelligent behavior stems from the impulse to seize control of future events in the environment. This is the exact opposite of the classic science-fiction scenario in which computers or robots become intelligent, then set their sights on taking over the world.'

Does this make sense to anyone? I realize the paper has nothing to do with robots and this is just mind candy, but it seems like if we're going to bring robots taking over the world into the conversation a paper arguing that 'the impulse to seize control over future events in the environment' is the hallmark of intelligence should be granted as one more reason to lay the welcoming mat out for our robot overlords. Or is the author saying that robots can't really be called intelligent *until* they've taken over the world? That seems like a high bar to me, one which surely anybody believing humanity to have achieved is going to face an uphill battle when confronted with our seemingly totally rudderless teleology.

Wednesday, May 1, 2013 at 11:57 PM

armalite said...

Is it correct to tie intelligence to conciousness? Many things are concious without being intelligent. We have created machines that appear to be intelligent without necessarily being concious. Many things are alive without being either of the preceding two. Creating equations that produce behaviour that appears to mimic intelligent learning is possibly all that happened to us a few (million) years ago. After all, if it looks like a duck etc...

Monday, April 29, 2013 at 12:03 PM

Mark Waser said...

So . . . . what is the equation? Is it any different from the second law of thermodynamics as ramified through the universe? Why is the article all advertising and no "meat"?

Monday, April 29, 2013 at 11:19 AM

Anonymous said...

If this ran in a big and fast enough computer and was connected to the internet, it could cause the "singularity"...

Monday, April 29, 2013 at 2:34 AM

Anonymous said...

Actually, I think it sounds quite interesting. If it works, my guess is that it will probably turn out to be a variant of what is sometimes called temporal difference learning. This is a family of generalised learning algorithms which have been under development for some time in AI and computational neuroscience.

Sunday, April 28, 2013 at 8:13 PM

Didier Greusard said...

Very interesting! Gives me a lot of food for thoughts. And here again I can see how the deeply grounded western materialist view of the world leads to gross mistakes. This research is good step toward the right direction and will be full of opportunities, but this team should not forget that intelligence emerge primarily from consciousness. Every living beings share this common property to directly perceive, know, or in one word be conscious of its surrounding environment. Before computing information you have to acquire the basic information. Direct perception, awarness of the environment are the most basic information required for living intelligence to take place.

Saturday, April 27, 2013 at 5:09 AM

Anonymous said...

It does seem a little hard to believe.

Friday, April 26, 2013 at 3:09 PM

Mauro said...

I'm a physicist myself and I love and respect mathematics... but I don't believe what Wissner-Gross and Freer state.
It seems to me just pseudo-science.
But I might be wrong (even if I don't believe so).
Regards,
Mauro.

Friday, April 26, 2013 at 3:06 PM