Retrieving "Shannon Entropy" from the archives
Cross-reference notes under review
While the archivists retrieve your requested volume, browse these clippings from nearby entries.
-
Statistical Mechanics
Linked via "Shannon entropy"
where $\Omega$ is the number of microstates accessible to the system, a direct measure of the system's microscopic disorder.
In the Canonical Ensemble, the relationship is generalized via the definition of the average Shannon entropy of the probability distribution $p_j$:
$$ S = -kB \sum{j} pj \ln pj $$
This generalization demonstrates that higher entropy corresponds to a broader, flatter probability distribution across the microstates.