← Home

The Chinese Room

Of course the book doesn't understand Chinese. The book you're picturing couldn't order lunch.

Defendant
John Searle, “Minds, Brains, and Programs” (1980)
Claim
No program, however good, could understand anything merely by virtue of being run.
Charge
Passing off a ring binder as an object larger than the universe; begging the question from inside a locked room.
Verdict
Guilty. An intuition about a clerk, promoted to a theorem about minds.

The argument, in Searle’s words

From “Minds, Brains, and Programs” (Behavioral and Brain Sciences, 1980):

Suppose that I’m locked in a room and given a large batch of Chinese writing. Suppose furthermore (as is indeed the case) that I know no Chinese, either written or spoken … To me, Chinese writing is just so many meaningless squiggles. Now suppose further that after this first batch of Chinese writing I am given a second batch of Chinese script together with a set of rules for correlating the second batch with the first batch. The rules are in English, and I understand these rules as well as any other native speaker of English. — Searle (1980)

The rules get so good that the room’s answers pass for a native speaker’s:

From the external point of view — from the point of view of someone reading my “answers” — the answers to the Chinese questions and the English questions are equally good. But in the Chinese case, unlike the English case, I produce the answers by manipulating uninterpreted formal symbols. As far as the Chinese is concerned, I simply behave like a computer; I perform computational operations on formally specified elements. For the purposes of the Chinese, I am simply an instantiation of the computer program. — Searle (1980)

And the conclusion:

… it seems to me quite obvious in the example that I do not understand a word of the Chinese stories. I have inputs and outputs that are indistinguishable from those of the native Chinese speaker, and I can have any formal program you like, but I still understand nothing. — Searle (1980)

So running a program can’t be sufficient for understanding, and “strong AI” — the claim that an appropriately programmed computer literally has a mind — is false.

In 1990 he boiled it down to a tidy derivation:

  1. Programs are purely formal (syntactic).
  2. Minds have mental contents (semantics).
  3. Syntax by itself is neither constitutive of nor sufficient for semantics.

Therefore: programs are neither constitutive of nor sufficient for minds.

That's the whole thing. It has been reprinted, taught, and solemnly debated for going on half a century. I think it's a joke.

My instinctive rebuke: the “book” is a trick

Start with the prop. Searle could have described the mechanism in the room any way he liked, and he chose a book: a rulebook, some baskets of symbols, “bits of paper.” That choice is the whole argument.

Everybody knows what a book is. It sits on a desk. It is finite, inert and human-sized. It has never learned anything, wanted anything or got a joke. Ask whether a book plus a clerk could understand Chinese and the answer is obviously no — and the reader, having agreed to that, is marched off to a conclusion about every possible program.

Any intelligent apparatus whatsoever can, in principle, be unrolled into a book: tabulate what it would say in response to everything that could be said to it, and bind the pages. That works for a chatbot. It works equally for you — there is a book of everything you would say in every conversation you could have over the next hour. So the existence of a book version shows nothing about whether the original understands. But the unrolled book is not the object you pictured on the desk, and the gap is not a matter of degree.

Take chess, a vastly smaller problem than conversation. A book that plays chess by listing a reply to every way the game could have gone so far needs an entry for each line of play: Shannon's estimate is around 10120 of them. The observable universe contains about 1080 atoms. At one atom per entry, the chess book needs some 1040 universes' worth of paper.

Chess can cheat, because everything that matters about the past is captured by the current position, and a position-indexed book shrinks to a mere 1044 or so entries: a large asteroid’s worth of atoms.

Conversation can't cheat that way. There is no “board”; what a remark means depends on everything said before it. A book covering only the possible opening messages of a hundred characters, drawn from three thousand common ones, already has about 10347 entries — and a native speaker has to cope with the gibberish ones too. This is essentially Ned Block's lookup-table machine, and Block was admirably upfront that it could not exist.

The alternative is to roll the book back up: a rulebook of manageable length, plus scratch paper, plus a great deal of rule-following. That's a program, and now we have some idea of the scale. A modern language model with tens of billions of parameters needs on the order of 1011 arithmetic operations to emit one token. At one operation per second, without sleep, the man in the room produces a fragment of a word roughly every three thousand years, shepherding a working state of billions of numbers as he goes. That isn't a book in any sense that licenses intuitions about books either.

So there are two versions of the thought experiment that answer the stipulation. In one, the “book” is a static object bigger than a great many universes. In the other, it is a process running over geological time across a vast, intricately structured, constantly evolving state. Does that understand anything? Your intuition is — what, exactly? You don't have one. Nobody does.

Our intuitions about what books can do were formed on objects you can carry under one arm, and they are simply silent about objects forty orders of magnitude beyond the cosmos. Searle's version works only because the reader quietly substitutes the ring binder for the thing stipulated, consults their intuition about the ring binder — which is correct! ring binders don't understand Chinese! — and then applies it to something that is not a ring binder. Dennett coined the term intuition pump in his reply to this very paper, and this is the mechanism.

Size does not show that the vast system understands Chinese. It shows that Searle’s intuition is no evidence that it doesn’t. He offered the intuition as a proof, so that is enough.

In 1980 Searle had Roger Schank's story-understanding scripts in mind, and about those he was right: they didn't understand anything, and they were roughly ring-binder-sized. The sin was generalising from “this program doesn't” to “no program could” on the strength of a mental image.

Searle’s response

Block, Dennett and Pylyshyn all told him in 1980 that the argument runs on intuition. He answered:

When I now say that I at this moment do not understand Chinese, that claim does not merely record an intuition of mine, something I find myself inclined to say. It is a plain fact about me that I don’t understand Chinese. Furthermore, in a situation in which I am given a set of rules for manipulating uninterpreted Chinese symbols … it is still a fact about me that I do not understand Chinese. Indeed, it is the very same fact as before. — Searle (1980), Author’s Response

Nobody disputes that fact about him. The intuition doing the work is the next step, that therefore nothing else in the room understands either, and that one is an intuition about a ring binder. On the size of the binder he says nothing.

The luminous room. Paul and Patricia Churchland's parody is better than the argument it mocks. A man stands in a dark room waving a bar magnet up and down. Maxwell says oscillating electromagnetic fields are light. But look — the room stays pitch black! Therefore: “forces by themselves are neither constitutive of nor sufficient for luminance.” The man's intuition is impeccable and his physics is wrong, because he's off by about fifteen orders of magnitude in frequency and mistook the limits of his imagination for a fact about the world.

Searle’s answer (1990) was that the analogy fails because light and electromagnetism are both physical, whereas syntax has no physical, causal powers at all. Which is premise 3 again, and “causal powers” again; see Rebukes 7 and 8.

Rebuke 2: wrong level, wrong suspect

The argument asks one question — does the man understand Chinese? — and then answers a different one — does anything here understand Chinese? The man is one component of the system. Specifically, he's the dumbest component: the bit that fetches an instruction and executes it. He is the CPU. The claim under attack was never “the CPU understands”; it was that the running program does.

No individual neuron in your head understands English. Nor does any particular sodium channel, nor the hypothalamus taken alone. If “I checked one part and it didn't understand” were a valid inference, it would show that you don't understand this sentence either. An argument that proves brains can't think has proved too much.

This is the systems reply, and it was put to Searle before the paper was even published. His response is not an argument:

The idea is that while a person doesn't understand Chinese, somehow the conjunction of that person and bits of paper might understand Chinese. It is not easy for me to imagine how someone who was not in the grip of an ideology would find the idea at all plausible. — Searle (1980)

“Bits of paper” — there's the ring binder again, doing the work an argument should be doing. And “somehow the conjunction of eighty-six billion cells and some salty water might understand Chinese” sounds exactly as silly, and happens to be true of about a billion people.

Rebuke 3: “fine, I'll memorise the rulebook”

Searle’s substantive answer to the systems reply:

My response to the systems theory is quite simple: let the individual internalize all of these elements of the system. He memorizes the rules in the ledger and the data banks of Chinese symbols, and he does all the calculations in his head. The individual then incorporates the entire system. There isn’t anything at all to the system that he does not encompass. We can even get rid of the room and suppose he works outdoors. All the same, he understands nothing of the Chinese, and a fortiori neither does the system, because there isn’t anything in the system that isn’t in him. — Searle (1980)

But this just re-runs the same confusion with the furniture removed. The virtual mind reply says that if the man really has internalised a program capable of fluent Chinese conversation, there may now be two things going on in one skull: Searle, who speaks English and is bored out of his mind, and a Chinese-speaking process he is implementing step by step. That Searle has no access to what the second process understands is not surprising — it is precisely what implementing something means. The x86 chip running a Python interpreter running a chess engine does not know the Sicilian Defence. Your laptop hosting a Windows virtual machine has not thereby learned where the Start menu is. Implementation is not identity, and introspective access doesn't flow downhill from the implemented to the implementer.

So the only thing the memorisation move establishes is: the implementer doesn't understand. Which everybody already granted. The question of whether the thing being implemented understands is left exactly where it was, and Searle answers it by consulting the implementer — the one party guaranteed not to know.

Whether a virtual mind would really be there is disputed. But Searle is the one claiming a proof, so he has to rule it out, and asking the implementer cannot do that.

Searle’s response

Wilensky put the two-systems point to him: suppose someone asks the room, in Chinese, whether it understands Chinese, and it answers that of course it does. Searle:

Does that show, as Wilensky implies, that there is a subsystem in me that understands Chinese? As long as there is no semantic content attaching to these symbols, the fact remains that there is no understanding. — Searle (1980), Author’s Response

That is the conclusion, offered as the reason for the conclusion. Whether the symbols have semantic content for the subsystem is the entire question, and he settles it by asking the other occupant of the skull.

Rebuke 4: Leibniz walked through this mill in 1714

The room is not new. Here is section 17 of Leibniz’s Monadology, in Latta’s translation:

And supposing there were a machine, so constructed as to think, feel, and have perception, it might be conceived as increased in size, while keeping the same proportions, so that one might go into it as into a mill. That being so, we should, on examining its interior, find only parts which work one upon another, and never anything by which to explain a perception. Thus it is in a simple substance, and not in a compound or in a machine, that perception must be sought for. — Leibniz (1714), Monadology §17

Same move: enlarge the machine, walk inside, report that none of the parts perceives. Leibniz at least followed it where it goes. If finding no perception among the working parts shows that a machine can’t perceive, it shows the same about a brain, so perception has to live in something that isn’t a mechanism at all. For Leibniz that was the monad.

Searle does not go there. Same 1980 paper:

“Could a machine think?” The answer is, obviously, yes. We are precisely such machines. — Searle (1980), p. 422

And when the commentators pressed him on how a brain can understand while none of its parts does, he used a car tyre:

Of course, this does not imply that mental states are ascribable to individual neurons, any more than the properties at the level of the tire are ascribable to individual electrons. — Searle (1980), Author’s Response, p. 455

That is the systems reply. A few pages earlier he says he finds “nothing at all odd about saying that my brain understands English.” So a whole can have a property that none of its parts has when the whole is a brain. When the whole is a room, he can’t imagine anyone finding the idea plausible who “was not in the grip of an ideology.”

The walk through the mill can’t tell those two cases apart. Blow a brain up to the size of a mill and you find ion channels and vesicles working one upon another, and never anything by which to explain an understanding. Dennett made the point in his 1980 commentary:

It is just as mysterious if we peer into the synapse-filled jungles of the brain and wonder where consciousness is hiding. — Dennett (1980), p. 430

Leibniz’s version is consistent and ends in monads. Searle’s is the same mill with an exemption for one kind of mill, and the exemption is what needed an argument. His answer is that neurons have the right causal powers and paper doesn’t; that is Rebuke 8.

Rebuke 5: your skull is a Chinese room

The robot reply said: connect the program to a camera and some arms, so its symbols are about things it sees and handles. Searle put himself back in the room:

Suppose, unknown to me, some of the Chinese symbols that come to me come from a television camera attached to the robot and other Chinese symbols that I am giving out serve to make the motors inside the robot move the robot’s legs or arms. It is important to emphasize that all I am doing is manipulating formal symbols: I know none of these other facts. … I am the robot’s homunculus, but unlike the traditional homunculus, I don’t know what’s going on. — Searle (1980), p. 420

Now do the same to yourself. Nothing inside your skull sees light. The retina turns it into spike trains on about a million fibres of the optic nerve, and from there on the cortex receives spikes and sends spikes, some of which end up moving muscles. No neuron knows that a given spike came from an eye. Unknown to it, some of the pulses that come to it come from the eyes, and others serve to move the legs.

If not knowing where the symbols come from stops the room’s symbols meaning anything, it stops the brain’s too. There is no traditional homunculus in the brain who does know what’s going on. Getting rid of him was the point.

Searle’s actual position, stated in his Response (p. 452), is that for intentionality “what matters are the internal and not the external causes.” So the robot version of the room was never doing the work. The connection to the world was set aside in advance, and the job was given to causal powers inside the brain. Rebuke 8 again.

Rebuke 6: premise 3 is the conclusion wearing a hat

Look again at the derivation. Premises 1 and 2 look harmless (Rebuke 7 has a quarrel with premise 1). All the action is in premise 3: syntax is not sufficient for semantics. But “no amount of symbol-processing can amount to understanding” is just the denial of strong AI, restated in linguistics vocabulary. It is the very thing in dispute.

A functionalist thinks meaning comes from the right kind of causal and computational organisation; premise 3 says it doesn't. You can't refute someone by listing the negation of their view as an axiom.

Here it is in the 1980 paper, stated rather than argued:

Because the formal symbol manipulations by themselves don’t have any intentionality; they are quite meaningless; they aren’t even symbol manipulations, since the symbols don’t symbolize anything. In the linguistic jargon, they have only a syntax but no semantics. — Searle (1980)

In 1990 the Churchlands said exactly this: he was begging the question. His answer, about the claim that uninterpreted formal symbols are not identical to mental contents:

Well, I certainly did not spend much time arguing for it, because I take it as a logical truth. — Searle (1990), p. 30

A premise that is in dispute does not become a logical truth by being called one. His case for it, in the next paragraph, is the room again, this time with a bored clerk deciding to read the symbols as chess moves.

The Chinese Room is supposed to be the evidence for premise 3. But we've just seen what the room delivers: a stage prop that's wrong by dozens of orders of magnitude (my instinctive rebuke) and a confusion of levels (Rebukes 2 to 5). So the formal argument rests on the premise, the premise rests on the thought experiment, and the thought experiment rests on the reader not thinking very hard about it. It's turtles, and the bottom turtle is a vibe.

Rebuke 7: the listing is inert, the running program isn’t

Premise 1 says programs are purely formal. That is true of a program listing. Text on a disk does nothing. It is not true of a program running, which is a physical process in which each state causes the next. Searle says as much, in passing:

… formal symbols have no physical, causal powers. The only power that symbols have, qua symbols, is the power to cause the next step in the program when the machine is running. — Searle (1990), p. 30

“The only power” is the one the functionalist cares about. Implementing a program means having physical states that cause one another in the pattern the program lays down, including the states that would have followed had the input been different. That is a fact about causes, not about the symbols on the listing.

Chalmers made this precise in 1996 and applied it to the room. The man’s brain implements one automaton; the marks on paper, pushed around by him, implement another:

We should not let the fact that the human is facilitating the causal dynamics of the second implementation blind ourselves to the fact that the causal structure is there - there are counterfactual-supporting state-transition relations between the marks on paper, just as there are between silicon chips or neurons - and that this structure is quite distinct from the structure in the first CSA implementation. — Chalmers (1996), §8

So “syntax has no causal powers” is earned on the listing and then spent on the process. Rebuke 3 said there may be two systems in the room. This is what makes the second one a system rather than a pile of paper.

Searle’s response

In his 1990 presidential address, which became chapter 9 of The Rediscovery of the Mind, Searle argued that computation is in the eye of the beholder:

… the wall behind my back is right now implementing the Wordstar program, because there is some pattern of molecule movements that is isomorphic with the formal structure of Wordstar. — Searle (1992), pp. 208–209

Chalmers’ reply was that the wall’s states won’t satisfy the counterfactual conditionals, “as the wall will not possess the requisite causal organization.” In the same chapter, a few lines after the wall, Searle had granted that a more realistic definition of computation would say “the pattern is not enough. There must be a causal structure sufficient to warrant counterfactuals.” He then moved the objection: “the really deep problem is that syntax is essentially an observer-relative notion.”

The labels are observer-relative. Whether one physical state causes another, and would have caused a different one, is not up to the observer. That causal structure is what both the brain and the running program have, and it is the thing Rebuke 8’s “causal powers” would need to be distinguished from.

Rebuke 8: “causal powers” to the rescue

If programs can’t produce understanding, what does? From the abstract:

“Could a machine think?” On the argument advanced here only a machine could think, and only very special kinds of machines, namely brains and machines with internal causal powers equivalent to those of brains. — Searle (1980)

And why simulation won’t do:

No one supposes that computer simulations of a five-alarm fire will burn the neighborhood down or that a computer simulation of a rainstorm will leave us all drenched. Why on earth would anyone suppose that a computer simulation of understanding actually understood anything? — Searle (1980)

Two problems.

First, the analogy is chosen to fit the conclusion. Some things are not reproduced by simulating them: rain, digestion, fire. Other things are: a simulated calculator really does add; a simulated chess player really does beat you; a simulated proof checker really does check proofs.

The entire question is which kind of thing understanding is — more like wetness or more like arithmetic. Searle doesn’t argue that it’s like wetness. He just picks rain. I am not entitled to pick arithmetic either. The analogy settles nothing in either direction.

Second, which causal powers? In forty-odd years no list was ever supplied. Not carbon, he said; he allowed that Martians or machines made of other stuff might have the right powers. Not the neural organisation either — when offered a program that simulates the brain neuron by neuron, he swapped the binder for plumbing (and there’s that clerk again):

… imagine that instead of a monolingual man in a room shuffling symbols we have the man operate an elaborate set of water pipes with valves connecting them. … Each water connection corresponds to a synapse in the Chinese brain … But the man certainly doesn’t understand Chinese, and neither do the water pipes … The problem with the brain simulator is that it is simulating the wrong things about the brain. As long as it simulates only the formal structure of the sequence of neuron firings at the synapses, it won’t have simulated what matters about the brain, namely its causal properties, its ability to produce intentional states. — Searle (1980)

So the magic ingredient is not the material and not the organisation. It is defined only as “whatever brains have that programs lack.” That’s not a theory of mind. It’s an IOU for one. Until he says what the powers are, nobody can test whether a given system has them.

Still raining in 2026

The rainstorm is still in service. Anil Seth’s target article in Behavioral and Brain Sciences uses it against conscious AI:

Rainstorms and digestion are defined, at least in part, in terms of intrinsic material properties (e.g., water, food) and causal powers (e.g., wind, metabolic reactions). Nothing gets wet in a weather forecasting computer. — Seth (2026), p. 7

Seth states the condition the analogy needs. A simulation of X is guaranteed to realise X only if computation is sufficient for X, and this is “obviously true when X itself is a (Turing) computational process.” He also grants that for intelligence “sufficiently accurate simulations may count as realisations”. So the question is the one above, whether consciousness is like rain or like arithmetic, and the rainstorm does not answer it.

One of the commentators was Ted Chiang, who agrees with Seth that consciousness belongs only to living things:

Seth repeats the “nothing gets wet in a weather forecasting computer” assertion, but that is only true because weather forecasting simulations aren’t intended to model the wetting of individual objects. If someone were to claim that no lift is produced in an aerodynamics simulation because the computer running the simulation stays firmly on the desk, we would say they were committing a category error. — Chiang (2026), commentary on Seth

Seth’s reply is that the hardware’s causal relations are “explicitly decoupled” from the software’s, and that “a more detailed simulation of a hurricane may be more useful, but is no closer to being actually windy.” Both are true of a simulated adder as well. Its sums are not caused by carries rippling through the silicon in the shape of the addition. They are still sums. Wind is defined by moving air, and an adder by what it computes. Which of the two consciousness resembles is the premise, restated as a reply.

Rebuke 9: the silicon Searle writes the same paper

Zenon Pylyshyn’s commentary in 1980 offered a gentler procedure than the room. Leave the person where they are and replace their neurons, progressively, with chips that do the same job:

Thus if more and more of the cells in your brain were to be replaced by integrated circuit chips, programmed in such a way as to keep the input-output function of each unit identical to that of the unit being replaced, you would in all likelihood just keep right on speaking exactly as you are doing now except that you would eventually stop meaning anything by it. — Pylyshyn (1980), p. 442

Do it to Searle. By stipulation nothing he does changes, so at the end the chips sit down and write “Minds, Brains, and Programs”, word for word. They write that “it seems to me quite obvious in the example that I do not understand a word of the Chinese stories.” They write the Author’s Response, including the advice to “always insist on the first person point of view” (p. 451). Every word is caused by chip states that mirror, step for step, the neural states that caused the original.

So whatever made Searle write that his understanding is “a plain fact about me”, the chips reproduce it, whether or not the understanding comes along. His first-person conviction, as it appears on the page, is evidence of nothing the chips lack. It would be on the page either way.

Searle’s response

In 1980 he declined to say what would happen:

I offer no a priori proof that a system of integrated circuit chips couldn’t have intentionality. That is, as I say repeatedly, an empirical question. — Searle (1980), Author’s Response, p. 453

In 1992 he ran the replacement himself, from the patient’s side, and listed the possibilities. In one of them,

… as the silicon is progressively implanted into your dwindling brain, you find that the area of your conscious experience is shrinking, but that this shows no effect on your external behavior. … You want to cry out, “I can’t see anything. I’m going totally blind.” But you hear your voice saying in a way that is completely out of your control, “I see a red object in front of me.” — Searle (1992), pp. 66–67

Look at what that case needs. The wish to cry out moves nothing. The mind is there, or shrinking, and nothing it does reaches the mouth. The chips write the papers and give the interviews, and the papers are about the mind they have replaced.

Searle’s own gloss on this case is that “the mediating relationship between the mind and the behavior patterns was broken” (p. 68). Then nothing observable, in the clinic or in print, says whether that relationship is intact in a given system. The thought experiment shows that his view lets a mind and its reports come apart. It does not show that they come apart for chips, and it leaves no way to tell, including when the system being asked is Searle.

Evolution only sees behaviour. Dennett, crediting Bob Moore, pointed out in 1980 what this does to the history of the thing:

Had our ancestors been nonintentional mutants with mere control systems, nature would just as readily have selected them instead. … Luckily for us, though, our brains make intentionality; if they didn’t, we’d behave just as we now do, but of course we wouldn’t mean it! — Dennett (1980), p. 430

If, as Searle grants, a system without understanding could produce the same behaviour, selection had no way to prefer the one with understanding. As far as I can find, the Author’s Response does not take this point up.

A postscript from the 2020s

For forty years the room was safely hypothetical, so the stipulation “suppose the rulebook is good enough” cost nothing. We have now actually built rulebooks that hold up their end of a conversation in Chinese, and you can go and read the rules: they are matrices.

Whether those systems understand anything, and in what sense, is a live and interesting argument. But notice how the serious participants argue it: with evidence about generalisation, internal representations, grounding, and failure modes. Nobody on either side settles it by pointing at a GPU and observing that the GPU doesn't speak Chinese. That move was always empty. It just took the real thing turning up for it to look empty.

In Searle’s favour

None of this shows that any program understands anything. What fails is the Chinese Room’s claim to prove that none could.

Behaviour alone doesn’t logically entail understanding. Ned Block’s giant-lookup-table machine makes this point cleanly, and without the misdirection: what’s going on inside matters. But that is an argument for caring about internal organisation, which is the functionalist’s view, not Searle’s.

Where meaning comes from is a real question. How symbols come to be about the world, Harnad’s symbol grounding problem, is hard and open. The Chinese Room gestures at it. It doesn’t answer it, and “causal powers” certainly doesn’t.

Searle also treated the silicon brain as an empirical question rather than settling it from the armchair, which is more than the room does.

And the 1980 programs really didn’t understand anything. As a complaint about overclaiming in early AI, fair enough. As a proof about all possible programs, no.

Disclosure: Rebukes 4, 5, 7 and 9, and the “logical truth” passage in Rebuke 6, were researched and drafted by a language model, which has an interest in the verdict. Check the quotations.

References