Chapter 2 — The Thermodynamics of Thought

The bill nobody reads

When you ask a language model a question and watch the answer appear, the experience is weightless. Words arrive on a screen out of nowhere, costing you nothing you can feel. This weightlessness is an illusion, and it is worth dispelling early, because almost every confused public argument about the future of artificial intelligence — the breathless ones and the dismissive ones alike — rests on not understanding what a thought costs.

A thought costs heat. Not metaphorically. The production of that answer required a physical machine to change its physical state billions of times, and every one of those changes dissipated energy as warmth into a room somewhere, in a building you will never see, drawing power from a grid that runs on something burning or spinning or splitting. The mirror we built in the last chapter does not float free of the world. It runs on the world's electricity, and it gets hot.

This chapter is about that fact and its consequences — because the physical cost of computation is not a footnote to the AI story. Increasingly, it is the story. The question of where artificial intelligence can go is, to a degree few people appreciate, a question of thermodynamics. So before we ask, in later chapters, whether these systems understand anything, it is worth establishing what they consume, and why the consumption is not an accident of present-day engineering but is rooted in physics itself.

Information is physical

Begin with the deepest fact, the one that connects thinking to heat at the level of natural law. It was stated in 1961 by a physicist at IBM named Rolf Landauer, and it is one of those rare results that sounds like philosophy but is in fact a theorem.

Landauer asked a simple-seeming question: is there a minimum, unavoidable energy cost to computation? The answer he found is subtle. Many computational steps, in principle, can be done with no minimum cost at all — they are reversible, meaning you could run them backward and recover what you started with, and reversibility turns out to be the key to thermodynamic cheapness. But one operation is special. Erasing a bit of information — taking a memory that could be either 0 or 1 and forcing it to a definite 0, discarding whatever was there — cannot be undone. And that irreversibility has a price. [VERIFIED — Landauer's principle, R. Landauer, IBM, 1961.]

Landauer's principle states that erasing a single bit of information requires the dissipation of a minimum quantity of heat, equal to a small constant multiplied by the temperature: in symbols, kT ln 2, where k is Boltzmann's constant and T is the temperature of the surroundings. [VERIFIED — the Landauer bound is kT ln 2 per bit erased; experimentally confirmed in the 2010s.] You do not need the equation. You need the idea inside it, which is profound: information is physical. A bit is not an abstraction floating in a Platonic realm. It is always embodied in some physical system — a charge, a magnetic domain, a voltage — and rearranging those embodiments to discard information forces a payment to the universe, in the irreducible currency of heat. The connection between knowing and warming is not engineering. It is law.

The amount is almost comically tiny — at room temperature, the erasure of one bit dissipates around three thousand-billion-billionths of a joule. [SOURCED — ~3 × 10⁻²¹ J at 300 K.] A single human breath involves more energy than erasing every bit in a laptop's memory. So Landauer's limit is not, today, what makes AI expensive. Here the honest detail matters, and it cuts against the alarmist reading: real computers operate roughly a million times above the Landauer limit. [SOURCED — current commercial computing runs ~six orders of magnitude above the Landauer bound.] We are nowhere near the physical floor. Which means the energy problem of artificial intelligence, today, is not a problem of fundamental physics. It is a problem of architecture — of the staggering gap between what computation must cost and what our particular way of doing it actually costs. And that gap, unlike Landauer's limit, is something we can see, measure, and in principle close.

Why mention a limit we are a million-fold away from hitting? Because it reframes everything that follows. It tells us that the heat pouring off the world's data centers is not nature's tax. It is our tax — a consequence of how we have chosen to build thinking machines, not a consequence of thinking itself. The mirror runs hot because of the particular furnace we constructed to hold it, and furnaces can be redesigned.

Maxwell's demon, and why knowing costs

There is a ghost that haunts this corner of physics, and meeting it makes Landauer's idea click into place. In 1867 James Clerk Maxwell imagined a tiny intelligent being — later called a demon — stationed at a small door between two gas-filled chambers. By opening the door only for fast molecules going one way and slow ones going the other, the demon could sort the gas into a hot side and a cold side without doing any work, creating a temperature difference from nothing. And a temperature difference is usable energy. The demon appeared to violate the Second Law of Thermodynamics — the iron rule that disorder, on the whole, always increases. It seemed to get order for free. [VERIFIED — Maxwell's demon thought experiment, 1867; its resolution via information erasure is standard.]

For nearly a century the demon embarrassed physics. The resolution, when it came, ran straight through information. To sort the molecules, the demon must measure them — it must acquire and store information about each one's speed. Its memory fills up. And eventually, to keep working, it must erase that memory to make room for more. By Landauer's principle, that erasure dissipates heat — and when you account for it, the demon's bookkeeping balances exactly. The order it seemed to create for free was paid for, all along, by the thermodynamic cost of forgetting. The Second Law survives, but only because information turned out to be physical. [VERIFIED — Bennett's resolution of Maxwell's demon via Landauer erasure is the standard account.]

I dwell on the demon because it makes vivid what is otherwise abstract. The lesson is not a curiosity about gas in boxes. It is that any system which acquires, stores, and discards information — a demon, a brain, a data center — is bound by the same thermodynamic accounting. Thinking is a physical process of managing information, and managing information has an unavoidable relationship with heat. When a language model processes your question, it is, in a precise sense, a very large and very expensive descendant of Maxwell's demon, sorting signal from noise and paying for every act of forgetting.

The architecture gap: brains and machines

Here is the fact that should reframe how you think about machine intelligence. Your brain runs on about twenty watts — roughly the power of a dim lightbulb. [SOURCED — the human brain consumes on the order of 20 watts.] On that miserly budget it does things no artificial system can yet match: it sees, plans, remembers, talks, and learns continuously, for eighty years, on the caloric output of a few sandwiches a day. The machines that approximate narrow slices of these abilities consume, during training, the power of a small town.

Why the staggering difference? Not because the brain cheats physics. Because the brain and the computer are built on opposite architectures, and the architecture is where the energy goes.

A conventional computer separates memory from processing. Data sits in one place; the processor sits in another; and computing consists of shuttling information back and forth between them across a bus. This separation — named after the mathematician John von Neumann, who helped formalize the design — is the foundation of essentially every computer you have ever used. It is flexible and it is general. It is also, for the kind of work intelligence requires, profoundly wasteful: a vast fraction of the energy is spent not on computing but on moving data back and forth across the gap between where it is stored and where it is used. This is the von Neumann bottleneck, and at the scale of modern AI it is the difference between a warm chip and a thirsty data center. [VERIFIED — the von Neumann bottleneck refers to the throughput limit imposed by separating memory and processing; it is a standard concept in computer architecture.]

The brain has no such gap. In neural tissue, memory and processing are the same physical substance: the synapses that store what you know are the very same structures that do the computing. Information is processed where it lives. The brain is also analog and event-driven — neurons do not march to a global clock ticking billions of times a second whether or not anything is happening; they fire only when they have something to say, and stay quiet otherwise, spending energy only on activity. A conventional processor, by contrast, clocks relentlessly, burning power on a rigid rhythm regardless of how much real work each tick accomplishes. [INTERPRETATION — the contrast is well established in the neuromorphic-computing literature; the framing here is mine.]

So the twenty-watt brain is not a miracle. It is an existence proof. It demonstrates that intelligence-like information processing can be done at a tiny fraction of the energy our machines require — because something is already doing it, inside your skull, right now. The gap between twenty watts and a megawatt is not a law of nature. It is a measure of how far our architecture has to go.

Jevons's curse: why efficiency may not save us

The natural hope, having seen the gap, is that efficiency will close it — that better chips and smarter designs will steadily drive the energy cost of AI down until the problem dissolves. This hope runs into an old and counterintuitive piece of economics, and honesty requires facing it.

In 1865 the economist William Stanley Jevons observed something strange about coal. As steam engines became more efficient — as they wrung more work from each lump of coal — Britain's total coal consumption did not fall. It rose. The reason is that efficiency made coal-powered work cheaper, cheaper work invited far more of it, and the expanded demand swamped the per-unit savings. Efficiency, paradoxically, increased total consumption. [VERIFIED — the Jevons paradox, 1865.]

The same logic shadows artificial intelligence, and the early evidence fits it uncomfortably well. Even as the energy cost per AI task has fallen — and it has fallen fast — total energy consumption has climbed, because cheaper, better AI invites vastly more use: more users, more queries, and now AI agents that run continuously rather than answering a single question and stopping. [SOURCED — IEA reporting indicates per-task AI energy efficiency is improving rapidly even as total data-centre electricity demand rises; AI-agent workloads are a growing driver.] The efficiency gains are real. They are simply being outrun by the growth they themselves unleash. This is Jevons's curse applied to thought: the cheaper we make machine thinking, the more of it the world consumes, and the larger the total bill grows.

There is a quieter danger inside this dynamic, worth naming because it connects back to the book's spine. When thinking becomes cheap, the world does not only fill with more good thinking. It fills with more thinking of all kinds, including the vacuous — an ocean of automatically generated text, plausible and empty, produced because it can be. The mirror, made cheap, does not only reflect us more; it floods the world with reflections, most of them unasked for. We will return to what this does to the information commons when we reach model collapse in Chapter 4. For now, note only that the energy story and the quality story are the same story seen from two sides.

Honest figures: what AI actually consumes

A book that leads with rigor owes you real numbers rather than rhetorical ones, and it owes you the numbers in their proper context — because the context is where most public discussion of AI energy goes wrong, in both directions.

Here is the current state, as best it can be measured. The world's data centers — the buildings that house essentially all serious computation, AI and otherwise — consumed roughly 415 terawatt-hours of electricity in 2024, which is about 1.5 percent of global electricity use. [SOURCED — IEA, 2024 figures.] That consumption is growing fast, more than four times faster than overall electricity demand, and is projected to roughly double by 2030, to around 945 terawatt-hours — close to the total electricity consumption of Japan. [SOURCED — IEA Energy and AI projection, central scenario.] AI is the single most important driver of that growth.

Those numbers are large, and they are the ones that fuel alarmist headlines. But the same data carry a second message that the headlines omit, and intellectual honesty requires giving it equal weight. Even at the doubled 2030 figure, data centers would represent only about 3 percent of global electricity, and their associated carbon emissions about 1 percent of the global total. [SOURCED — IEA central scenario for 2030.] The projected rise in data-center demand is a smaller contributor to total electricity growth than electric vehicles, or even air conditioning. [SOURCED — IEA, 2025.] AI's energy footprint is real, it is concentrated enough to strain local grids, and it is rising on a steep curve — and it is also, in the global picture, not yet the civilizational energy crisis it is sometimes painted as.

I give you both halves deliberately, because the discipline of this book is to refuse the comfortable exaggeration in either direction. The technologists who wave away AI's energy cost as trivial are wrong: the curve is steep, the local strain is real, and the Jevons dynamic means the total keeps climbing. The critics who frame AI as a planet-burning catastrophe are also overstating a case the data do not yet support. The truth is narrower and more useful: AI's energy demand is a serious, fast-growing engineering and infrastructure problem, not a thermodynamic inevitability and not yet a dominant share of human energy use. Where it goes next depends on whether efficiency can outrun Jevons — which is, at bottom, an architecture question.

Two bills: training once, answering forever

There is a distinction hiding inside those aggregate figures that most public discussion flattens, and pulling it apart makes the whole energy picture clearer — including why Jevons bites where it does.

The energy cost of a language model comes in two very different bills. The first is training: the vast, one-time expenditure of running the trillion-fold nudging process of Chapter 1, a cost paid once per model, concentrated in weeks or months of enormous computation. This is the bill the headlines usually mean, and it is genuinely large — frontier training runs consume electricity on the scale of thousands of households' annual use. [SOURCED — estimates of frontier-model training energy are substantial but vary widely across models and disclosures; verify representative current figures in the verification pass.] The second bill is inference: the cost of actually answering questions, paid again with every single query, forever, for as long as the model is used. Each individual answer is cheap — plausible estimates for a typical query sit in the range of the energy a lightbulb burns in minutes, though the honest caveat is that the companies disclose little and independent estimates span a wide range. [SOURCED — per-query inference energy estimates vary by roughly an order of magnitude across analyses, reflecting limited disclosure; characterize the uncertainty honestly and verify current estimates near publication.]

Here is why the distinction matters. Training is a fixed cost; inference scales with use. And once a model is deployed to hundreds of millions of people asking billions of questions — and now to automated agents that query continuously rather than occasionally — the accumulated inference bill overtakes the training bill and keeps growing without ceiling. [SOURCED — analyses of deployed AI systems indicate inference has become the dominant and fastest-growing share of AI energy demand as usage scales; verify in the verification pass.] This is Jevons's curse located precisely: efficiency gains lower the cost of each answer, cheaper answers invite more questions, and the total climbs even as every individual query gets lighter. The alarmist telling fixates on the training bill, which is bounded and paid once. The real long-run story is the inference bill, which is unbounded and paid always — a tax not on building the mirror but on looking into it, levied every time anyone looks, multiplied by a world that is learning to look constantly. [INTERPRETATION — the framing of training as the bounded bill and inference as the unbounded one is mine; the underlying cost structure is established.]

The real frontier: computing more like a brain

If the architecture is the problem, the architecture is also where the genuine frontier lies — and it is far more interesting than the usual conversation about building more power plants.

The most promising direction has a name: neuromorphic computing — chips designed to work less like a von Neumann machine and more like neural tissue. The two ideas at its heart are exactly the two advantages we saw in the brain. The first is in-memory computing: putting the processing where the data already lives, collapsing the von Neumann gap so that energy is not burned endlessly shuttling information across a bus. The second is spiking: building artificial neurons that, like real ones, stay silent until they have something to contribute and fire only on events, rather than clocking uselessly billions of times a second. [VERIFIED — neuromorphic computing, in-memory computing, and spiking neural networks are established research directions aimed at energy-efficient computation.]

These are not science fiction; they are active engineering, with working chips in laboratories and early commercial use. They are also not a solved problem — neuromorphic systems are harder to program, less general, and not yet a drop-in replacement for the machines that run today's models. But they represent the honest frontier of the energy question, because they attack it where it actually lives: in the architecture, in the gap between the million-fold-above-Landauer machines we have and the near-optimal machine sitting in every human skull.

This is the chapter's quiet thesis. The energy problem of artificial intelligence is real but it is not fundamental. It is a gap, and the gap is closeable, because nature has already closed it once. The question is whether we can learn to build thinking machines that think the way thinking is cheapest — and that is a question about engineering and time, not about physical law.

A note on quantum computing, kept in its place

No honest chapter on the future of computation can ignore quantum computing, and none should overstate it. I raise it here, in the chapter about substrates and physical cost, because this is the only place it honestly belongs — as a question about the machinery of computation, not about the nature of mind. We will return to it once more, in Chapter 10, where the forward-looking hardware thread can be developed at length and properly hedged. Everything I say about it is marked as frontier, because frontier is what it is.

Here is the honest sketch. A quantum computer is not a faster version of an ordinary computer. It is a different kind of machine that exploits the strange rules of quantum mechanics — superposition, in which a quantum bit can represent a blend of states rather than a definite 0 or 1, and entanglement, in which qubits become correlated in ways with no classical analog — to perform certain very specific computations in ways no classical machine can match. [VERIFIED — qubits, superposition, and entanglement are the basic resources of quantum computing; this is textbook.] For a narrow set of problems — certain kinds of search, optimization, and especially the simulation of quantum systems themselves — this offers genuine and sometimes dramatic speedups. [VERIFIED — quantum speedups are established for specific problem classes, not for general computation.]

And here is the discipline. Quantum computing is, as of this writing, early and fragile — the machines are small, error-prone, and not yet a general accelerator for the particular kind of mathematics that deep learning relies on. [SPECULATIVE/FRONTIER — the state of quantum hardware is early; claims of near-term quantum advantage for mainstream AI are not supported by current evidence and should be treated with caution.] The honest verdict, which I will defend more fully later, is that quantum computing is unlikely to be a near-term general accelerator for AI, while remaining genuinely important for specific simulation and optimization problems. Anyone who tells you that quantum computers are about to supercharge artificial intelligence is selling something. Anyone who tells you they are irrelevant is also overconfident. The truth sits, as it usually does, in the carefully hedged middle — and we will keep it there.

Where this leaves us

Let me close, as I will close each chapter, by separating what we have established from what we have argued.

It is established that information is physical and that erasing it has an irreducible thermodynamic cost (Landauer); that today's computers operate vastly above that fundamental floor; that the brain achieves intelligence-like processing on roughly twenty watts while our machines require many orders of magnitude more; that this gap is rooted in architecture — the von Neumann separation of memory and processing — rather than in physical law; and that data-center electricity use, driven substantially by AI, is real, fast-growing, and yet still a modest fraction of global energy use.

It follows, as argument rather than fact, that AI's energy problem is best understood as an architecture problem and not a thermodynamic destiny — closeable in principle because the brain has already closed it — with neuromorphic computing as the most honest frontier and quantum computing as a real but narrow and overhyped adjacent possibility.

We have now seen what the mirror costs to run. The next question is harder and older, and no amount of energy accounting can settle it. We have described, in mechanism and in heat, exactly what these machines do. We have not yet asked whether any of it amounts to understanding — whether a system that predicts text with such fluency knows anything at all, or only seems to. That is the question of the next chapter, and it is the one on which thoughtful people most sharply disagree.