Eq. 3 introduced the quantity \(\Omega (N,V,E)\) as the number of states available to a system under the constraints of constant number of particles, \(N\), volume, \(V\), and energy \(E\). The fundamental postulate of statistical mechanics, also called the “rational basis” by Chandler, is the following:
In statistical equilibrium, all states consistent with the constraints of \(N\), \(V\), and \(E\) are equally probable.
or \begin{equation} P_\nu = 1/\Omega (N,V,E). \end{equation} This relation is often referred to as a statement of the “equal a priori probabilities in state space.” Another way of saying the same thing: The probability distribution for states in the microcanonical ensemble is uniform.
The link between statistical mechanics and classical thermodynamics is given by a definition of entropy: \begin{equation} \label {eq:entropy} S \equiv k_B\ln \Omega \end{equation} Note two important properties of \(S\). First, it is extensive: if we consider a compound system made of subsystems \(A\) and \(B\) with \(\Omega _A\) and \(\Omega _B\) as the respective number of states, the total number of states is \(\Omega _A\Omega _B\), and therefore \(S = S_A + S_B\). Second, it is consistent with the second law of thermodynamics: putting any constraint on the system lowers its entropy because the constraint lowers the number of accessible states.
Temperature is defined using entropy: \(1/T \equiv \left (\partial S/\partial E\right )_{N,V}\), or \begin{equation} \beta = \left (k_BT\right )^{-1} = \left (\partial \ln \Omega /\partial E\right ) \end{equation}
Now we will consider constraining our system not with constant \(E\), but with constant \(T\). The set of all possible states satisfying constraints of \(N\), \(V\), and \(T\) is called the canonical ensemble. Contrary to appearances based on their names, the canonical ensemble can be envisioned as a subsystem in a larger, microcanonical system. Consider such a system divided into a small subsystem \(A\), surrounded by a large “bath” \(B\). We imagine that these two subsystems are “weakly coupled,” meaning they exchange only thermal energy, but no particles, and their volumes remain fixed. We seek to compute the probability of finding the total system in a state such that subsystem \(A\) has energy \(E_A\). The entire system is microcanonical, so the total energy, \(E\) is constant, as is the total number of states available to the system, \(\Omega (E)\) (we omit the \(N\) and \(V\) for simplicity).
When \(A\) has energy \(E_A\), the total system energy is \(E = E_A + E_B\), where \(E_B\) is the energy of the bath. By constraining system \(A\)’s energy, we have reduced the number of states available to the whole system to \(\Omega (E-E_A)\). So, the probability of observing the system in a state in which subsystem \(A\) has energy \(E_A\) looks like \begin{equation} P_A = \frac {\left [\begin {array}{l} \mbox {Number of states for which}\\ \mbox {subsystem $A$ has energy $E_A$} \end {array}\right ]} {\left [\begin {array}{l} \mbox {Number of states available}\\ \mbox {to entire system} \end {array}\right ]} = \frac {\Omega \left (E - E_A\right )}{\Omega \left (E\right )} \end{equation} We can expand \(\Omega \left (E - E_A\right )\) in a Taylor series around \(E_A = 0\): \begin{equation} \begin {aligned} P_A \propto \Omega \left (E - E_A\right ) & = \exp \left [\ln \Omega \left (E-E_A\right )\right ] \\ & = \exp \left [\ln \Omega \left (E\right ) - E_A\frac {\partial \ln \Omega }{\partial E} + \cdots \right ], \end {aligned} \end{equation} where the partial derivative implies we are holding \(N\) and \(V\) fixed. We can truncate the Taylor expansion at the first-order term, because higher order terms become less and less important as the size of subsystem \(B\) becomes larger and larger. What results is the Boltzmann distribution law for energies of a system at constant temperature: \begin{equation} P_A \propto \exp \left (-\beta E_A\right ) \end{equation} The normalization condition requires that for all energies of subsystem \(A\), \(E_A\), \begin{equation} \sum _A P_A = 1 = \sum _A \exp \left (-\beta E_A\right ) \equiv Q\left (N,V,T\right ), \end{equation} which defines the canonical partition function, \(Q\). Therefore, \begin{equation} P_A = Q^{-1}\exp \left (-\beta E_A\right ) \end{equation}
Because some energies can correspond to more than one microstate, we should distinguish between “states” and “energy levels.” We can express the canonical partition function as \begin{equation} \label {eq:canonical_1} Q = \sum _{\begin {array}{cc}\nu \\\mbox {states}\end {array}} e^{-\beta E_\nu } = \sum _{\begin {array}{cc}l\\\mbox {levels}\end {array}} \Omega \left (E_l\right ) e^{-\beta E_l} \end{equation} where, as we have seen, \(\Omega \left (E\right )\) is the number of microstates with energy \(E\). Moving to the continuum limit, and assuming a reference energy of \(E_{ref} = 0\), \begin{equation} \label {eq:dos} Q \rightarrow \int _0^\infty dE \overline \Omega \left (E\right )e^{-\beta E} \end{equation} where \(\overline \Omega \left (E\right )\) is the density of states. What is this equation telling us? It is telling us that \(Q\) is the Laplace transform of \(\overline \Omega \). We know that transform pairs are unique, and hence, both \(Q\) and \(\overline \Omega \) contain the same information.
We recognize that for a system described by a canonical ensemble, the energy is a fluctuating quantity. And we now have the probability of observing a state with a given energy, so we can use Eq. 1 to compute the average energy, \(\left \langle E\right \rangle \). Consider \begin{equation} \begin {aligned} \left \langle E\right \rangle & = \left \langle E_\nu \right \rangle = \sum _\nu P_\nu E_\nu \\ & = \left [\sum _\nu E_\nu \exp \left (-\beta E_\nu \right )\right ] \left / \left [\sum _\nu \exp \left (-\beta E_\nu \right )\right ] \right . \end {aligned} \end{equation} Notice that \begin{equation} \sum _\nu E_\nu \exp \left (-\beta E_\nu \right ) = -\left (\partial Q \left / \partial \beta \right .\right ) \end{equation} Recalling that \(d\ln f(x) / dx = 1/f df/dx\), we see that \begin{equation}\label {eq:ave_ener_canon} \begin {aligned} \left \langle E\right \rangle &= -\left (\partial Q \left / \partial \beta \right .\right )\left /Q\right . \\ &= -\left (\partial \ln Q \left / \partial \beta \right .\right )_{N,V} \end {aligned} \end{equation}
Now, let us consider the average magnitude of the fluctuations in energy in the canonical ensemble. \begin{equation} \begin {aligned} \left \langle \left (\delta E\right )^2\right \rangle & = \left \langle \left (E - \left \langle E\right \rangle \right )^2\right \rangle \\ & = \left \langle E^2\right \rangle - \left \langle E\right \rangle ^2 \\ & = \sum _\nu P_\nu E_\nu ^2 - \left (\sum _\nu P_\nu E_\nu \right )^2 \\ & = Q^{-1}\left (\frac {\partial ^2Q}{\partial \beta ^2}\right )_{N,V} - Q^{-2}\left (\frac {\partial Q}{\partial \beta }\right )^2_{N,V} \\ & = \left (\frac {\partial \ln Q}{\partial \beta ^2}\right )_{N,V} = -\left (\frac {\partial \left \langle E\right \rangle }{\partial \beta }\right )_{N,V} \end {aligned} \end{equation} Now, noting that the definition of heat capacity at constant volume, \(C_v\), is \begin{equation} C_v = \left (\frac {\partial E}{\partial T}\right ) \end{equation} we see that \begin{equation} \left \langle \left (\delta E\right )^2\right \rangle = k_B T^2 C_v \end{equation} This is an interesting statement. It relates the magnitude of spontaneous fluctuations in the total energy of a system to that system’s capacity to store or release energy due to changing its temperature.
The fact (Eq. 22) that the average energy in the canonical ensemble is related to a derivative of the log of the partition function implies that \(\ln Q\) is an important thermodynamic quantity. So, let’s go back to our undergraduate thermodynamics course(s) and recall the following statement of the 1st and 2nd Law: \begin{equation} dA = -SdT - pdV + \mu dN \end{equation} where \(A\) is the Helmholtz free energy, defined in terms of internal energy and entropy as \begin{equation} \label {eq:helmholtz} A = \left \langle E\right \rangle - TS \end{equation} Now, consider the following derivative of \(A\): \begin{equation} \begin {aligned} \left (\frac {\partial \left (A/T\right )}{\partial \left (1/T\right )}\right )_{N,V} & = A + \frac {1}{T}\left (\frac {\partial A}{\partial \left (1/T\right )}\right )_{N,V} \\ & = A - T\left (\frac {\partial A}{\partial T}\right )_{N,V} = A - TS = \left \langle E\right \rangle . \end {aligned} \end{equation} Therefore, \begin{equation} \label {eq:dAdBeta_E} \left (\frac {\partial \left (\beta A\right )}{\partial \beta }\right )_{N,V} = \left \langle E\right \rangle . \end{equation} Considering Eq. 22, we see that \begin{equation} \label {eq:C} \ln Q + C = -\beta A \end{equation} which does indeed suggest an important link between \(\ln Q\) and the important thermodynamic quantity, the Helmholtz free energy. But what is the constant \(C\)? To evaluate it, consider the “boundary condition” as \(T \rightarrow 0\): \begin{equation} Q = \sum _\nu e^{-\beta E_\nu } \stackrel {T\rightarrow 0}{\longrightarrow } e^{-\beta E_{\rm ground}}. \end{equation} Here, we have assumed that the degeneracy of the ground state, \(\Omega \left (E_{\rm ground}\right )\) is 1. This tells us that \begin{equation} \lim _{T\rightarrow 0} \ln Q = -\beta E_{\rm ground} \end{equation} Using this fact, and combining Eqs. 27 and 30, as \(T \rightarrow 0\), we see that \begin{equation} -\beta E_{\rm ground} + C = -\beta \underbrace {\left \langle E\right \rangle }_{E_{\rm ground}} - \underbrace {\frac {S}{k_B}}_{\rightarrow 0\ (\Omega = 1)}, \end{equation} Hence, \(C\) = 0. So, \begin{equation} \ln Q = -\beta A. \end{equation} The quantity \(-\beta ^{-1}\ln Q\) is the Helmholtz free energy, \(A\). This is denoted \(F\) in Frenkel & Smit [1].