The Remarkable Noam Chomsky

George Rebane

In a private communication an RR reader brought up Noam Chomsky and his views on the Singularity.  It appears that the world famous linguist does not believe that the Singularity is possible.  I was not aware of that, since in his 60 years at MIT he has been credited with making contributions to computer science.  The reader included the link (here) to an extremely revealing interview that Dr Chomsky gave to an interviewer who operates a website that belongs to the halo of sites that report on the doings in the Singularity community and comment on these pre-Singularity years (perhaps even RR is one of those sites).

For me, as a former worker in the fields of machine intelligence, the interview revealed a chasm in the knowledge base of an individual who has been in daily elbow rubbing distance from some of the world class AI researchers.  I comment on this chasm here to illustrate its ‘black swanness’ and shudder to think how pervasive such chasms are throughout the fields of technology and science.  The most telling example of that is the deep ignorance of the tools of systems science evinced by so many scientists established in fields such as climatology and meteorology when they attempt to understand the modeling and behavior of large scale dynamic systems in the context of manmade global warming.  (RR readers will recall that I have been the first to admit that no one today can be an expert familiar with all of the long and convoluted shoreline of Man’s expanding island of knowledge.)

But getting back to the good Professor Chomsky and the Singularity (see also RR's Singularity Signposts).  I do hope that the reader will take the twenty some minutes to view the video.  There he will discover that Chomsky still believes that machine intelligence is being pursued through “brute force” programming, and therefore peer or superior to human AI is “beyond the limits of contemporary science” or even a fool's errand.

Computer scientists gave up trying to program higher levels of machine intelligence in the 1970s which in the field saw a sea change in AI research.  We came to realize then that peer intelligence in machines would arise along the same line as it has in critters, as a learned emergent property in a sufficiently complex system that is exposed to the world (experience, data, and information).  We switched from trying to program intelligence to creating learning machines.

We now know that smart machines must be able to deal with uncertainty and causality.  They must be able to internally fashion and maintain computational structures that can calculate useful measures of uncertainty, and go on to think subjunctively in order to successfully construct causal nets from which plausible causal basins can be abstracted and compelling causal beams identified.  That is what we know that humans can do, and we know that such processing is done by ‘hardware’ with a handful of specific neuronal structures that are joined in gazillions of repetitive and recursive arrays in our brains.  The links between these structures are dynamically established, pruned, strengthened, and weakened as we go through life.  And now there is evidence that brain cells can even grow anew in our noggins.

Dr Chomsky’s insistence that attempting AI is limited to remain a ‘programming problem’ on an essentially von Neumann (i.e. garden variety architectural) computer is diametrically opposite to what is happening in the real world.

(My humble contribution to the field is the discovery of what is now known as the Rebane-Pearl Polytree algorithm (q.v.) of machine learning.  I showed that even today’s computers could be exposed to data from which they can autonomously develop Bayes nets to capture the uncertain information content of that data in a computable form - i.e. generate knowledge from data.  The field of Bayesian learning has exploded since those days 25 years ago.  Subsequently, Judea Pearl has developed causal calculus (q.v.) that has enabled a quantum leap in machine intelligence in these pre-Singularity years.)

As the video demonstrates, Chomsky himself is quite adamant that the entire effort of developing peer intelligence in machines is a fruitless enterprise.  For example he holds that Turing asked a “meaningless question” when he wrote his epochal 8-pager ‘Can Machines Think?’ and gave rise to the now famous Turing Test.  Dr Chomsky implies that ‘true thinking’ is some as yet mysterious process that is unique to humans and totally impossible for other computational structures which may (and will!) exceed the complexity of the human brain.  One wonders, why take such an intellectually ephemeral stance?

In the same way Chomsky denies the possibility of machines truly ‘understanding’ anything.  Since, in his world, these machines are just running programs which are axiomatically incapable of understanding, regardless of the intelligent behaviors they emit.  But again, no one has defined what understanding means absent its subsequent demonstration in observable behavior – i.e. only operational definitions of understanding are available to us.  But such verification involves Skinnerian observation, and Chomsky is known for rejecting BF Skinner’s work in operant conditioning and behaviorism.  (We recall that Skinner did not care what was in the ‘black box’ of a critter’s brain, only in developing reliable input/output relationships for that black box.  Chomsky is a cognitive scientist who definitely posits the inner workings of all the black boxes that make up sentient cum sapient brains, even though he can offer no working definitions for such functions.)

Finally, Professor Chomsky still labors under the belief that AI workers are continuing in their effort to come up with a “theory of being smart”.  I’ve been privileged to know and have had extensive conversations with some of the leading lights in this field, and no one nor nowhere have I run across anyone who is wasting time on such a pursuit.  So I finished watching that interview video shaking my head and asking how can that be possible.  The man has spent the last 60 years steps away from the bleeding edge of machine intelligence research and continues to harbor views that were abandoned almost two generations ago.

My most recent readings of Chomsky come from the neo-communist website truthout.com where he is a regular contributor.  Chomsky also has a long history of social activism and has self-identified as a ‘libertarian socialist’ and an ‘anarcho-syndicalist’, both belief systems worthy of future comment.  Through his day-to-day prosaic offerings, Dr Chomsky can be put into the far left ideological camp with little error in predicting his attitudes and reactions to current events and public policies.

A brilliant man, yet living at the edge of a chasm; it should give all of us, especially those who deal in the arena of ideas, pause.

Comments

[Russ Steele]

I once had a dog named Hoover who refused to recognize any situation that he did not think he could handle. If it was too big, in Hoover's mind, it did not exist. He was never troubled by problems he could not solve. It could be that Norm Chomsky is "Hoovering" No longer interested in addressing a complex problem, sticking with the small stuff he understands and acknowledges is limited, untroubled, in his mind, by an unsolvable problem.

[George Rebane]

Dear Reader, I draw your kind attention to the 6oct13 update of the recent 'National Ignorance' piece.
http://rebaneruminations.typepad.com/rebanes_ruminations/2013/10/national-ignorance-proof-of-concept-working.html

[Ryan Mount]

This is going to take an extra heavy-duty steak knife to cut through. I need to review both this post and the video before can address both.

However, I do have some brief comments regarding Noam Chomsky

1) I am a tremendous fan of his observations regarding generative grammars. His Syntactic Structures is a masterpiece of Structuralist Linguistic theory that is one of the few to survive the intellectual chaos of the 60s, 70s and even to this day of post-modernism/post-structuralism.

He's "debates" with Michel Foucault, which cover a variety of topics, are a great introduction to this tension.

http://www.youtube.com/watch?v=3wfNl2L0Gf8

2) Then there's the political Chomsky that people know the best. The Anarcho-Libertarian. He is often mis characterized as a Left Winger, but up until recently(more on that in a moment), he shared very little with more common American Left-wing Liberal Progressivism. His criticisms on Foreign policy and more notably the media are typical topics of discussion.

3) Then there's what I call the post-John Kerry Noam Chomsky when he somewhat reluctantly supported the Presidential run of him in 2004. I think this marks his decline (some say post 9/11 is when this started) his decline as a spokesmen for the Left/Libertarian causes. He's getting old.

I think we have more of #3 in the video attached in the post. But I need to study what he's saying in more detail.

[Gregory]

As a chemistry professor of mine liked to say, "One clean experiment is worth a thousand dirty equations". The "singularity" either is possible, or it isn't. Expect heated debates until that time, or until a quorum of believers no longer seeks it.

No Ryan, Chomsky isn't libertarian and never has been. His particular brand of a libertarian socialism, in short, remains socialist but instead of national thugs driving a state socialism, we'd have a plethora of anarcho-syndicalist thugs (think "community organizer") with much smaller domains but the same disdain for individual liberty.

[Ryan Mount]

I'm assuming you haven't seen this:

http://en.wikipedia.org/wiki/Left-libertarianism

Anyhow there is a broad spectrum of Libertarianism, as I'm sure you know. All of them have one thing in common: A dislike of central control. But more specifically to illustrate this, we have Anarcho-Capitalists who form the Right wing of Libertarians, and Anarchy-Syndalysts who are ostensibly stateless communists.

I suppose your objection to their inclusion has to do with their VOLUNTARY participation in a group. And not the Melvillian isolatode version that Americans seem to prefer with their Right-ish Libertarianism. I suppose calling them "thugs" is the academic and rational way to keep this discussion going?

> much smaller domains but the same disdain for individual liberty.

That is a tremendous assumption and a rather sharp misunderstanding of the values of the Left Libertarians.

[Gregory]

You assume wrong, Ryan.

"That is a tremendous assumption and a rather sharp misunderstanding of the values of the Left Libertarians"

No, it's substantially based on being around a number of labor union executives in my youth, and reading the likes of Chomsky as an adult. Not to mention my own leanings as a left libertarian.

Look, I understand folks tending towards totalitarianism wanting to soften the labels of their own side with libertarian, but "libertarian socialist" as a label should probably be ridiculed the way "military intelligence" was by left-liberals a few short decades ago.

[Bill Tozer]

I was one of those who thought Norm had lost his friggin mind. But, I was wrong. They found it.

http://www.theverge.com/2013/10/3/4798898/human-brain-preserved-for-4000-years-after-being-boiled