Main content

## Physics library

### Unit 10: Lesson 3

Laws of thermodynamics- Macrostates and microstates
- Quasistatic and reversible processes
- First law of thermodynamics / internal energy
- More on internal energy
- What is the first law of thermodynamics?
- Work from expansion
- PV-diagrams and expansion work
- What are PV diagrams?
- Proof: U = (3/2)PV or U = (3/2)nRT
- Work done by isothermic process
- Carnot cycle and Carnot engine
- Proof: Volume ratios in a Carnot cycle
- Proof: S (or entropy) is a valid state variable
- Thermodynamic entropy definition clarification
- Reconciling thermodynamic and state definitions of entropy
- Entropy intuition
- Maxwell's demon
- More on entropy
- Efficiency of a Carnot engine
- Carnot efficiency 2: Reversing the cycle
- Carnot efficiency 3: Proving that it is the most efficient

© 2023 Khan AcademyTerms of usePrivacy PolicyCookie Notice

# Entropy intuition

Introduces second law of thermodynamics. A discussion of entropy change in terms of heat and microstates . Created by Sal Khan.

## Want to join the conversation?

- A small question, I think I get how an increase in volume increases entropy, but now I understand a little more this concept... can somebody explain to me how come an increase in temperature increases this combination of states?(29 votes)
- When the temperature of a gas is increased, the molecules have higher kinetic energies. When the molecules move around faster they can configure themselves in more ways than they could have if they had less kinetic energy. More specifically, molecules in an ideal gas follow Maxwell-Boltzmann statistics which imply that the molecules' velocity distribution broadens as the temperature of the system is increased.(52 votes)

- Can you do a lecture series on Shannon's information theory?(17 votes)
- So if I take the example of a TV screen with white noise has every pixel randomly black or white, with equal amounts of white and black pixels, the entropy would be at a maximum, even if the pixels randomly organize themselves at some point? What would low entropy look like in such a system?(5 votes)
- You're right - when half the pixels are black and half are white, this is the highest entropy. The reason for this is that, if you consider every different possible arrangement of pixels that would give 50% black and 50% white, there are more possibilities for this 50/50 split than for any other percentage split. This makes the 50/50 split the most probable, and thus it has the highest entropy.

You're right that some of these possibilities might look 'organized', for example a bunch of black pixels grouped together (though this arrangement is improbable). This would be one of many microstates (i.e. individual possible arrangements of pixels) that contributes to the maximum entropy macrostate (i.e. the big picture that there is a 50/50 split between black and white pixels). If you limited yourself to only having a bunch of black pixels grouped together, however, then the entropy would be lower, since the probability of this happening is lower once you introduce a restriction.

In the pixel system, low entropy would be if all of the pixels were black or all of the pixels were white.(7 votes)

- If you're cleaning the room, aren't you the engine, much the same way the AC compressor is?(4 votes)
- I think so too- and if you expend energy to put things in drawers and closets, aren't you decreasing entropy, or increasing order, by confining the things - ie- by limiting the places they can be in the room, the way intermolecular or ionic forces might order particles in a crystal?(4 votes)

- I think it would be nice to add that the bouncing ball also loses energy by friction with air. I mean, I know for some people is obvious, but just in case somebody doesn't know.

-J. Garcia(2 votes)- True, but the amount of energy lost from friction in the air is so small that you could hardly measure it. On the other hand the energy lost through contact with the ground pretty much stops the ball moving.(6 votes)

- Is being in Ordered state the same thing as being in least state of energy? If so then isn't it the natural tendency for matter to be in the least state of energy? So is itnot possible for it to return to ordered state unlike17:05.(3 votes)
- First, keep in mind that energy and entropy are TWO different things. Secondly, lay out all the variables in whatever problem you are dealing with - then if you calculate entropy of the universe, no matter what situation you are dealing with, you will always find the entropy of the UNIVERSE increasing. When talking about entropy, it is essential to be specific about your problem. Remember the example of hot outside and cold inside with an air conditioner that Sal talks about? If you miss out the heat that the air conditioner loses, you mess up.(3 votes)

- Is there a reason you use Q for heat? In my textbook, H is used for enthalpy..which ones the industry standard?(1 vote)
- Q and H refer to subtly different things. Q represents the heatflow in and out of a system while H is the overall energy within a system. You'll therefore usually see chemists using H (and consequently ΔH) instead of Q because enthalpy allows them to disregard what's going on outside of the system, something Q would make them keep track of.

Side-note: Q is a inherently a path variable while H is a state variable. However, adding Δ to H makes it a path variable since it is now keeping track of changes in the system.(7 votes)

- This video and several others on thermodynamics discuss path variables and state variables. Are these terms applicable only to thermodynamics? Is there a mathematical definition? I took calculus and differential equations many years ago, but I don't remember these types of variables being covered. What branch of mathematics covers this? Are they discussed on any of Kahn Academy's math videos. Thanks!(3 votes)
- This appears in multivariable calculus. It isn't exclusive to thermodynamics, it also appears when you're defining potential, for example. A 2 variable (x and y) function will be path independent if (∂²f/∂x∂y) = (∂²f/∂y∂x), I don't remember the general definition for n variables :p, but I think it's something analogous (like ∂³f/∂x∂y∂z = ∂³f/∂x∂z∂y = ∂³f/∂y∂x∂z = ...). The idea is that a small change in f will be the same independent of the order in which you took the small steps in x,y,z,w,...(3 votes)

- will the entropy of the universe continue to increase forever and continue to get more chaotic to infinitum?(1 vote)
- That is a theory, that one day, nuclear forces will cease to stop entropic forces, and all matter in the universe will decay into a quantum soup of protons, nuetrons, and electron.(4 votes)

- If entropy depends on volume (more the space, more potential states the particles have) then why isn't it included in the equation for entropy?(2 votes)

## Video transcript

I've now supplied you with two
definitions of the state variable entropy. And it's S for entropy. The thermodynamic definition
said that the change in entropy is equal to the heat
added to the system divided by the temperature at which
the heat is added. So obviously, if the temperature
is changing while we add the heat, which is
normally the case, we're going to have to do a little
bit of calculus. And then you can view this as
the mathematical, or the statistical, or the
combinatorical definition of entropy. And this essentially says that
entropy is equal to some constant times the natural log
of the number of states the system can take on. And this is the case when all
the states are equally probable, which is a pretty
good assumption. If you have just a gazillion
molecules that could have a gazillion gazillion states,
you can assume they're all roughly equally likely. There's a slightly more involved
definition if they had different probabilities,
but we won't worry about that now. So given that we've seen these
two definitions, it's a good time to introduce you to the
second law of thermodynamics. And that's this. And it's a pretty simple law,
but it explains a whole range of phenomena. It tells us that the change in
entropy for the universe when any process is undergone
is always greater than or equal to 0. So that tells us that when
anything ever happens in the universe, the net effect is that
there's more entropy in the universe itself. And this seems very deep,
and it actually is. So let's see if we can apply it
to see why it explains, or why it makes sense, relative
to some examples. So let's say I have two
reservoirs that are in contact with each other. So I have T1. And let's call this
our hot reservoir. And then I have T2. I'll call this our
cold reservoir. Well, we know from experience. What happens if I put a hot cup
of water, and it's sharing a wall with a cold glass of
water, or cold cube of water, what happens? Well, their temperatures
equalize. If these are the same substance,
we'll end up roughly in between, if they're
in the same phase. So essentially, we have a
transfer of heat from the hotter substance to the
colder substance. So we have some heat, Q, that
goes from the hotter substance to the colder substance. You don't see, in everyday
reality, heat going from a colder substance to a
hotter substance. If I put an ice cube in, let's
say, some hot tea, you don't see the ice cube getting
colder and the hot tea getting hotter. You see them both getting to
some equal temperature, which essentially the tea is giving
heat to the ice cube. Now in this situation there
are reservoirs, so I'm assuming that their temperatures
stay constant. Which would only be the case
if they were both infinite, which we know doesn't exist
in the real world. In the real world, T1's
temperature as it gave heat would go down, and T2's
temperature would go up. But let's just see whether the
second law of thermodynamics says that this should happen. So what's happening here? What's the net change
in entropy for T1? So the second law of
thermodynamics says that the change in entropy for the
universe is greater than 0. But in this case, that's equal
to the change in entropy for T1 plus the change in entropy
for-- oh, I shouldn't-- instead of T1, let me
call it just 1. For system 1, that's this hot
system up here, plus the change in entropy
for system 2. So what's the change in
entropy for system 1? It loses Q1 at a high
temperature. So this equals minus the heat
given to the system is Q over some hot temperature T1. And then we have the heat being
added to the system T2. So plus Q over T2. This is the change in entropy
for the system 2, right? This guy loses the heat, and is
at temperature 1, which is a higher temperature. This guy gains the heat, and
he is at a temperature 2, which is a colder temperature. Now, is this going to
be greater than 0? Let's think about
it a little bit. If I divide-- let
me rewrite this. So I can rearrange them, so that
we can write this as Q over T2 minus this one. I'm just rearranging it. Minus Q over T1. Now, which number is bigger? T2 to T1? Well, T1 is bigger, right? This is bigger. Now, if I have a bigger number,
bigger than this-- when we use the word
bigger, you have to compare it to something. Now, T1 is bigger than this. We have the same number
in the numerator in both cases, right? So if I take, let's say, 1
over some, let's say, 1/2 minus 1/3, we're going
to be bigger than 0. This is a larger number than
this number, because this has a bigger denominator. You're dividing by
a larger number. That's a good way to
think about it. You're dividing this Q by some
number here to get something, and then you're subtracting
this Q divided by a larger number. So this fraction is going to be
a smaller absolute number. So this is going to
be greater than 0. So that tells us the second
law of thermodynamics, it verifies this observation we
see in the real world, that heat will flow from the hot
body to the cold body. Now, you might say, hey, Sal. I have a case that will show
you that you are wrong. You could say, look. If I put an air conditioner in a
room-- Let's say this is the room, and this is outside. You'll say, look what the
air conditioner does. The room is already cold, and
outside is already hot. But what the air conditioner
does, is it makes the cold even colder, and it makes
the hot even hotter. It takes some Q and it goes
in that direction. Right? It takes heat from the cold
room, and puts it out into the hot air. And you're saying, this defies
the second law of thermodynamics. You have just disproved it. You deserve a Nobel Prize. And I would say to you, you're
forgetting one small fact. This air conditioner inside
here, it has some type of a compressor, some type
of an engine, that's actively doing this. It's putting in work to
make this happen. And this engine right here--
I'll do it in magenta-- it's also expelling some more heat. So let's call that
Q of the engine. So if you wanted to figure out
the total entropy created for the universe, it would be the
entropy of the cold room plus the change in entropy for
outside-- I'll call it outside, maybe I'll call
this, for the room. Right? So you might say, OK. This change in entropy for the
room, it's giving away heat-- let's see the room is roughly at
a constant temperature for that one millisecond we're
looking at it. It's giving away some Q at
some temperature T1. And then-- so that's a minus. And then this the outside is
gaining some heat at some temperature T2. And so you'll immediately
say, hey. This number right here is a
smaller number than this one. Right? Because the denominator
is higher. So if you just look at this,
this would be negative entropy, and you'd say hey, this
defies the second law of thermodynamics. No! But what you have to throw in
here is another notion. You have to throw in here the
notion that the outside is also getting this heat from the
engine over the outside temperature. And this term, I can guarantee
you-- I'm not giving you numbers right now--
will make this whole expression positive. This term will turn the total
net entropy to the universe to be positive. Now let's think a little bit how
about what entropy is and what entropy isn't in
terms of words. So when you take an intro
chemistry class, the teacher often says, entropy
equals disorder. Which is not incorrect. It is disorder, but you have
to be very careful what we mean by disorder. Because the very next example
that's often given is that they'll say, look. A clean room-- let's say your
bedroom is clean, and then it becomes dirty. And they'll say, look. The universe became
more disordered. The dirty room has more disorder
than the clean room. And this is not a case
of entropy increase. So this is not a good example. Why is that? Because clean and dirty are
just states of the room. Remember, entropy is a
macro state variable. It's something you use to
describe a system where you're not in the mood to sit there and
tell me what exactly every particle is doing. And this is a macro variable
that actually tells me how much time would it take for
me to tell you what every particle is doing. It actually tells you how many
states there are, or how much information I would have
to give you to tell you the exact state. Now, when you have a clean room
and a dirty room, these are two different states
of the same room. If the room has the same
temperature, and it has the same number of molecules in it
and everything, then they have the same entropy. So clean to dirty, it's
not more entropy. Now, for example, I could
have a dirty, cold room. And let's say I were to go into
that room and, you know, I work really hard
to clean it up. And by doing so, I add a lot of
heat to the system, and my sweat molecules drop all over
the place, and so there's just more stuff in that room, and
it's all warmed up to me-- so to a hot, clean room with sweat
in it-- so it's got more stuff in here that can be
configured in more ways, and because it's hot, every molecule
in the room can take on more states, right? Because the average kinetic
energy is up, so they can kind of explore the spaces of how
many kinetic energies it can have. There's more potential
energies that each molecule can take on. This is actually an increase
in entropy. From a dirty, cold room
to a hot, clean room. And this actually goes well
with what we know. I mean, when I go into room and
I start cleaning it, I am in putting heat into the room. And the universe is becoming
more-- I guess we could say it's the entropy
is increasing. So where does the term
disorder apply? Well, let's take a situation
where I take a ball. I take a ball, and it
falls to the ground. And then it hits the ground. And there should have been a
question that you've been asking all the time, since the
first law of thermodynamics. So the ball hits the
ground, right? It got thrown up, it had some
potential energy at the top, then that all gets turned into
kinetic energy and it hits the ground, and then it stops. And so your obvious question is,
what happened to all that energy, right? Law of conservation of energy. Where did all of it go? It had all that kinetic energy
right before it hit the ground, then it stopped. Right? It seems like it disappeared. But it didn't disappear. So when the ball was falling, it
had a bunch of-- you know, everything had a little
bit of heat. But let's say the ground
was reasonably ordered. The ground molecules were
vibrating with some kinetic energy and potential energies. And then our ball molecules
were also vibrating a little bit. But most of their motion
was downwards, right? Most of the ball molecules'
motion was downwards. Now, when it hits the ground,
what happens-- let me show you the interface of the ball. So the ball molecules at the
front of the ball are going to look like that. And there's a bunch of them. It's a solid. It will maybe be some
type of lattice. And then it hits the ground. And when it hits the ground-- so
the ground is another solid like that-- All right, we're
looking at the microstate. What's going to happen? These guys are going to rub
up against these guys, and they're going to transfer
their-- what was downward kinetic energy, and a very
ordered downward kinetic energy-- they're going
to transfer it to these ground particles. And they're going to bump into
the ground particles. And so when this guy bumps into
that guy, he might start moving in that direction. This guy will start oscillating
in that direction, and go back and forth
like that. That guy might bounce off of
this guy, and go in that direction, and bump
into that guy, and go into that direction. And then, because that guy
bumped here, this guy bumps here, and because this guy bumps
here, this guy bumps over there. And so what you have is, what
was relatively ordered motion, especially from the ball's point
of view, when it starts rubbing up against these
molecules of the ground, it starts making the kinetic
energy, or their movement, go in all sorts of random
directions. Right? This guy's going to make this
guy go like that, and that guy go like that. And so when the movement is no
longer ordered, if I have a lot of molecules-- let me do it
in a different color-- if I have a lot of molecules, and
they're all moving in the exact same direction, then my
micro state looks like my macro state. The whole thing moves
in that direction. Now, if I have a bunch of
molecules, and they're all moving in random directions,
my ball as a whole will be stationary. I could have the exact same
amount of kinetic energy at the molecular level, but
they're all going to be bouncing into each other. And in this case, we described
the kinetic energy as internal energy, or we describe it as
temperature, where temperature is the average kinetic energy. So in this case, when we talk
about, the world is becoming more disordered, you think about
the order of maybe the velocities or the energies
of the molecules. Before they were reasonably
ordered, the molecules-- they might have been vibrating a
little bit, but they were mainly going down in the ball. But when they bump into the
ground, all of a sudden they start vibrating in random
directions a little bit more. And they make the ground
vibrate in more random directions. So it makes-- at the
microstate-- everything became just that much more
disordered. Now there's an interesting
question here. There is some probability you
might think-- Look, this ball came down and hit the ground. Why doesn't the ball just--
isn't there some probability that if I have a ground, that
these molecules just rearrange themselves in just the right
way to just hit these ball molecules in just
the right way? There's some probability, just
from the random movement, that at get some second, all the
ground molecules just hit the ball molecules just right to
send the ball back up. And the answer is yes. There's actually some
infinitesimally small chance that that happens. That you could have a ball
that's sitting on the ground-- and this is interesting--
could have a ball that's sitting on the ground, and while
you're looking, you'll probably have to wait a few
gazillion years for it to happen, if it happens at all--
it could just randomly pop up. And there's some random, very
small chance that these molecules just randomly vibrate
in just the right way to be ordered for a second, and
then the ball will pop up. But the probability of this
happening, relative to everything else, is
essentially 0. So when people talk about
order and disorder, the disorder is increasing, because
now these molecules are going in more random
directions, and they can take on more potential states. And we saw that here. And you know, on some level,
entropy seems something kind of magical, but on some
level, it seems relatively common sense. In that video-- I think was the
last video-- I had a case where I had a bunch of
molecules, and then I had this extra space here, and then
I removed the wall. And we saw that these molecules
will-- we know, there's always some modules
that are bouncing off this wall before, because we probably
had some pressure associated with it. And then as soon as we remove
that wall, the molecule that would have bounced there
just keeps going. There's nothing to stop
it from there. In that direction, there's
a lot of stuff. It could bump into other
molecules, and it could bumping into these walls. But in this direction, the
odds of it bumping into everything is, especially for
these leading molecules, is essentially 0. So it's going to expand
to fill the container. So that's kind of
common sense. But the neat thing is that the
second law of thermodynamics, as we saw in that video, also
says that this will happen. That the molecules will all
expand to fill the container. And that the odds of this
happening are very low. That they all come back and
go into a ordered state. Now there is some chance, just
from the random movements once they fill, that they all just
happen to come back here. But it's a very, very
small probability. And even more-- and I want to
make this very clear-- S is a macro state. We never talk about
the entropy for an individual molecule. If we know what an individual
molecule is doing, we shouldn't be worrying
about entropy. We should be worrying about
the system as a whole. So even if we're looking at
the system, if we're not looking directly at the
molecules, we won't even know that this actually happened. All we can do is look
at the statistical properties of the molecules. How many molecules they are,
what their temperature is, all their macro dynamics,
the pressure, and say, you know what? A box that has these molecules
has more state than a smaller box, than the box when we
had the wall there. Even if, by chance, all of the
molecules happened to be collecting over there, we
wouldn't know that that happened, because we're not
looking at the micro states. And that's a really important
thing to consider. When someone says that a dirty
room has a higher entropy than a clean room, they're looking
at the micro states. And entropy essentially is
a macro state variable. You could just say
that a room has a certain amount of entropy. So entropy is associated with
the room, and it's only useful when you really don't
know exactly what's going on in the room. You just have a general sense of
how much stuff there is in the room, what's the temperature
of the room, what's the pressure
in the room. Just the general macro
properties. And then entropy will
essentially tell us how many possible micro states that
macro system can actually have. Or how much information--
and there's a notion of information entropy--
how much information would I have to give you to tell
you what the exact micro state is of a system at
that point in time. Well anyway. Hopefully you found this
discussion a little bit useful, and it clears up some
misconceptions about entropy, and gives you a little bit more
intuition about what it actually is. See you in the next video.