In this level-0 post, we take a look at some interesting thought experiments in thermodynamics, in particular the various incarnations of Maxwell’s demon. These were constructed as possible ways to subvert the second law of thermodynamics, and here we will talk about why they don’t.
Introduction
The mid-19th century was a boom time for physics in Europe. Great advances were being made in foundational areas, like electrodynamics and thermodynamics, which lead to the steam engine and the light bulb. Central to the construction and efficacy of heat engines was the developed (and developing) theory of thermodynamics, with its 4 laws. In this post, we will focus on the second law of thermodynamics, which states that any closed system cannot decrease its entropy. A famous thought experiment, originally by James Clark Maxwell, proposes that a “demon” could break the second law through several different means. Now we know that this is not true, and in this post, we will go through why this is so.
Entropy and Heat Engines
To understand Maxwell’s demon, we need to understand the law it is trying to break and thus to understand entropy. Entropy is an odd thing in the popular science discourse, since different people will give very different “definitions” of entropy. These explanations range from “entropy is a measure of disorder” to “entropy is a measure of how spread out energy is”. While these interpretations can be useful in certain situations, we will use a simple operational definition so that we may get to the main discussion.
Let’s say we have a box full of gas. The gas has some energy associated to it, and there are a couple of ways of increasing or decreasing the energy in the gas: we could add/remove thermal energy or we could add/remove mechanical energy by doing work on the gas (for example, by compressing the gas). This is summarized in the first law of thermodynamics,
where 
For the purposes of this post, this and the second law are all we need to know about entropy. Let’s see a simple consequence of these two facts. Say we have a closed system consisting of two boxes, one at temperature 
In the above equation, I chose
Now let’s talk a little bit about heat engines. In physics, we like to start as simple and idealized as possible before we add the more complicated and realistic stuff. This allows us to reduce a problem to its most fundamental parts. The physicist’s idealized model of a heat engine (everything from steam engines, diesel engines, Stirling engines, etc) is shown in the diagram below. It consists of three parts: a hot reservoir, a cold reservoir, and a black box that represents the internal components of the engine. In simplest terms, heat flows from the hot reservoir to the cold reservoir through the heat engine, and the heat engine can convert some of this heat into useful work.
Let’s analyze the efficiency of the heat engine using the second law of thermodynamics. The efficiency is the fraction of energy that the engine can convert into useful work. The energy coming in is 
I used a little trick there where I used the conservation of energy to write 
The second law says that the above change in entropy must be 0 or larger. The maximum efficiency of the engine comes from 
That allows us to write the maximum efficiency of a heat engine in terms of the temperatures of the two reservoirs:
To get a really efficient heat engine, you need the cold reservoir to be much colder than the hot one. If we tried to run a heat engine off of the boxes in our previous example, we could only achieve a maximum of 50% efficiency! In particular, notice that the second law prevents the construction of a monothermal heat engine, that is one where there is really only one reservoir, so 
Maxwell’s demon and Szilard’s refinement
We are now in a position to discuss Maxwell’s demon. Though to be clear, the concept of a supernatural demon isn’t strictly necessary here, the demon is really just any measuring device. In fact, Maxwell himself didn’t talk about demons, that was coined by Lord Kelvin, who seemed to be evoking the more neutral sort of demon from the ancient Greeks, rather than the evil spirits of the Abrahamic religions. Just thought I’d get that out of the way, since I will be using the standard term ‘demon’ all over this article. There are many equivalent Maxwell demon thought experiments, but we will start with just one. Suppose you have a box filled with a gas, a demon, and the demon has a partition that it can slide into the center of the box, splitting it into two (importantly, without needing to do any work on the gas). The demon, with its supernatural intellect can see the positions of all the particles of gas and knows their velocities. By moving the partition, the demon is able to let through specific gas particles from one side of the box to the other. The demon uses this power to let all the quickly moving particles to the left side of the box and all the slowly moving particles to the right side. Since temperature is related to the average speed of particles in a gas, the demon has separated a gas at one temperature into a hot gas and a cold gas without doing any work on the gas, violating the second law.
In the early 20th century, Hungarian physicist Leo Szilard refined Maxwell’s demon into the simplest possible model of a demon seemingly violating the 2nd law. This is called a Szilard engine, and it works like so: There is a single gas particle in a box, which is touching a reservoir so that everything stays at one temperature. The demon has a partition to split the box in half. Once this is done, the demon can look to see which side of the box the gas particle is on and place a piston in the other half so that, as the “gas” is allowed to expand, it pushes the piston, doing work. The demon can do this over and over again to extract as much energy as it wants out of the system. This is a heat engine that operates at one temperature, a monothermal heat engine. We argued just a moment ago that a monothermal heat engine should be 0% efficient by the second law, but this is clearly extracting some useful work. What is going on?
Classical Szilard engine
We will start with the classical engine, that is the engine where we treat the gas molecule as a classical particle (no quantum mechanics allowed). The key to resolving this issue with the second law is to realize that we have applied it incorrectly in this case. We are looking that the gas as an isolated system, but that is clearly not the case! In particular, the demon is measuring the particles location. Any measurement, no matter how careful, requires an interaction between the measurer (the demon) and the system to be measured (the particle). Therefore, we need to consider the internal workings of a demon! Sounds complicated and dependent on the inner workings of supernatural creatures and measurement devices alike, but we can at least find out what the most efficient demon can do.
What’s important here is that the demon measures the particle’s location, and then uses that information to place a piston in the right orientation so that it may extract useful work from the particle. The most efficient demon would only need to know whether the particle is on the left or the right side of the box. We can think of the demon’s memory like 1-bit of memory on a computer. The bit is on if the particle is on the right side, off if the particle is on the left side. Importantly, the demon will have to erase the information once it is done using it in order to complete the engine cycle, so that the system returns to its starting configuration (otherwise it wouldn’t be much of a cycle would it).
In the 1960’s, around 100 years since Maxwell proposed his demon, Rolf Landauer was working at IBM and argued for a fundamental limit in computing related to erasing memories. In particular, he placed a lower bound on the amount of energy required to erase one bit of information. Amazingly, this bound was exactly the amount of work that is extracted from one cycle of the Szilard engine! So with Landauer’s principle, the second law is saved from Maxwell’s demon because all of the energy extracted from a cycle of the Szilard engine has to then be used to erase the demon’s memory.
Although I haven’t gone into the mathematical details, just this history explains the birth of the most incredible advances in physics and computing: information theory (and its relationship to thermodynamics). Until Szilard proposed his engine, physics was the domain of concrete objects and the interactions between them. But now the notion of information, before a subjective human concept, has been made precise and physical.
Quantum Demons
The previous discussion was all classical, so some may object, “hey! You can’t treat a single atom/molecule as a classical particle, this is very clearly the realm of quantum mechanics!” This is correct, of course. However, treating the problem quantum mechanically doesn’t change the basics or interpretation. To show what I mean, let’s go through the quantum version of the story.
The gas particle is now a quantum particle, meaning that it is represented not as a point in space, but as a wave function, which encodes all the information we could ever hope to know about the particle (i.e. the probabilities of all possible measurements that one could perform on the particle). The wave function is essentially the state of the particle, and in this set-up, we take the particle to be in a constant temperature state. The demon inserts a barrier into the box, chopping the wavefunction in half. Then, the demon measures the particle, and this is where things get funky. To properly model the problem, we should treat the demon also as a quantum object. So let’s talk about that for a second.
We can take the demon to have two possible states: the state where the demon has measured the particle to be on the left, and the one where the demon measured the particle to be on the right. Before measuring, the state of the demon in a “superposition” or combination of these left and right states, such that if we measured the demon, there would be a 50/50 chance of measuring the demon in the left or right state. Then, when we say that the demon “measures” the particle, we mean that the demon and particle interact in a very specific way. This interaction must “entangle” the demon and the particle states. When two quantum objects are entangled, it means that there is no way of thinking about them as separate objects. In this case, the demon+particle state is a superposition of (the demon and particle both in their left states) and (the demon and particle both in their right states). Don’t worry if this doesn’t fully make sense to you, hopefully the upcoming animation will help.
Okay, so the demon inserts the barrier and measures the particle. At this point, everything continues just like in the classical case. The demon uses the knowledge of the particles position to extract work just like before (albeit in this weird split-in-two way). When the particle expands to fill the rest of the box, it returns to its initial state. However, the demon does not. We need an extra step to complete the cycle, in which we return the demon to its initial ready-to-measure state. The issue with this is that it takes energy to change the demons state. How much? Well, at least as much energy as the demon was able to extract from the particle. Therefore, there is no engine and no violation of the 2nd law, even when you treat everything quantumly.
Conclusion
Maxwell’s demon is a great demonstration of why thought experiments are important. In testing the logical limits of our scientific theories, we can see when they break down, or better yet, entire new areas of physics to explore. Maxwell, while concerned about the former, really inspired the latter, eventually leading to entirely new fields of research, like quantum information theory. The second law of thermodynamics, meanwhile, has stood the test of time since then, even being extended to describe the physics of black holes and the cosmological horizon of our own universe. I’m sure such topics will appear in future posts (wink).
Singular Points 