Dark Energy

In 1998, two independent teams studying distant Type Ia supernovae made one of the most startling discoveries in the history of physics: the expansion of the universe is not slowing down, it is accelerating. Something is pushing the universe apart, counteracting the gravitational attraction of all the matter within it. We call this mysterious agent dark energy, and it constitutes approximately 68% of the total energy content of the universe. Understanding its nature is perhaps the deepest open problem in fundamental physics.

The Discovery: Type Ia Supernovae

Type Ia supernovae are thermonuclear explosions of white dwarf stars that reach a characteristic peak luminosity, making them excellent "standard candles." By measuring their apparent brightness, we can determine their distance, and from their redshift, we know how much the universe has expanded since the light was emitted.

The Supernova Cosmology Project (led by Saul Perlmutter) and the High-z Supernova Search Team (led by Brian Schmidt and Adam Riess) both found that distant supernovae ($z \sim 0.5$-$1$) were fainter than expected in a decelerating universe. The supernovae were farther away than they should have been, meaning the expansion had been speeding up. Perlmutter, Schmidt, and Riess received the 2011 Nobel Prize for this discovery.

The luminosity distance $d_L$ of a supernova at redshift $z$ depends on the cosmological parameters:

$$d_L(z) = (1+z) \int_0^z \frac{c \, dz'}{H(z')}$$

where $H(z) = H_0 \sqrt{\Omega_m(1+z)^3 + \Omega_\Lambda}$ in the flat $\Lambda$CDM model. The supernova data clearly favor $\Omega_\Lambda \approx 0.7$.

The Cosmological Constant

The simplest explanation for dark energy is Einstein's cosmological constant $\Lambda$, which he originally introduced in 1917 to achieve a static universe and later called his "greatest blunder." It appears in the Einstein field equations as:

$$G_{\mu\nu} + \Lambda g_{\mu\nu} = 8\pi G \, T_{\mu\nu}$$

The cosmological constant can be interpreted as the energy of the vacuum. Its energy-momentum tensor is:

$$T_{\mu\nu}^{(\Lambda)} = -\frac{\Lambda}{8\pi G} g_{\mu\nu} \implies \rho_\Lambda = \frac{\Lambda}{8\pi G}, \quad p_\Lambda = -\rho_\Lambda$$

This gives an equation of state $w = p/\rho = -1$ exactly. Unlike matter or radiation, the vacuum energy density does not dilute as the universe expands, it is a property of space itself. This is why dark energy, though negligible in the early universe, eventually dominates as matter dilutes.

The Cosmological Constant Problem

Quantum field theory predicts that the vacuum has a non-zero energy density from zero-point fluctuations of all quantum fields. A naive estimate, cutting off at the Planck scale, gives:

$$\rho_{\text{vacuum}}^{\text{QFT}} \sim \frac{M_{\text{Pl}}^4}{(2\pi)^2} \sim 10^{74} \text{ GeV}^4$$

The observed dark energy density is:

$$\rho_\Lambda^{\text{obs}} \sim 10^{-47} \text{ GeV}^4$$

The Equation of State

The dark energy equation of state parameter $w = p/\rho$ characterizes its behavior:

Value of $w$	Type	Behavior
$w = -1$	Cosmological constant	Constant energy density; $\rho = \text{const}$
$-1 < w < -1/3$	Quintessence	Energy density slowly decreases; $\rho \propto a^{-3(1+w)}$
$w < -1$	Phantom energy	Energy density increases; leads to "Big Rip"

Current observations constrain $w = -1.03 \pm 0.03$, consistent with a cosmological constant. Determining whether $w$ is exactly $-1$ or deviates slightly is one of the primary goals of modern observational cosmology.

Quintessence and Dynamical Dark Energy

Perhaps the cosmological constant problem hints that dark energy is not truly constant. Quintessence models propose that dark energy is a slowly rolling scalar field $\phi$ (reminiscent of the inflaton), with:

$$\rho_\phi = \frac{1}{2}\dot{\phi}^2 + V(\phi), \qquad w_\phi = \frac{\frac{1}{2}\dot{\phi}^2 - V(\phi)}{\frac{1}{2}\dot{\phi}^2 + V(\phi)}$$

If $V(\phi) \gg \frac{1}{2}\dot{\phi}^2$, then $w \approx -1$, mimicking a cosmological constant. But as the field evolves, $w$ can change with time. Tracker models, where the field energy tracks the dominant component, can alleviate the "coincidence problem", why dark energy and matter have comparable densities today despite scaling differently.

Phantom energy ($w < -1$) requires exotic physics (fields with negative kinetic energy). If $w$ remains below $-1$, the dark energy density would increase without bound, eventually tearing apart galaxies, stars, atoms, and even nuclei in a catastrophic "Big Rip" at a finite time in the future.

de Sitter Space

If the universe is dominated by a positive cosmological constant, it asymptotically approaches de Sitter space: a universe expanding exponentially forever:

$$a(t) \propto e^{Ht}, \qquad H = \sqrt{\frac{\Lambda}{3}}$$

De Sitter space has remarkable properties. It possesses a cosmological horizon: objects beyond a distance $d_H = c/H$ are receding faster than light and can never be reached. The observable universe slowly empties as galaxies cross beyond our horizon. De Sitter space also has a temperature, analogous to Hawking radiation:

$$T_{\text{dS}} = \frac{H}{2\pi k_B} \sim 10^{-30} \text{ K}$$

Observational Constraints

Multiple independent probes constrain dark energy:

• Type Ia supernovae: The original evidence; modern surveys (DES, Pan-STARRS, LSST/Rubin) continue to improve the measurement of $w$
• CMB: The CMB constrains the total energy budget of the universe; combined with other probes, it tightly constrains $\Omega_\Lambda$
• Baryon acoustic oscillations (BAO): The imprint of sound waves in the distribution of galaxies provides a standard ruler, measuring the expansion history at multiple redshifts
• Galaxy cluster counts: The number of massive clusters as a function of redshift depends on both the growth of structure and the expansion history
• Weak gravitational lensing: The distortion of galaxy shapes by foreground mass measures the growth of structure, which is sensitive to dark energy

The Fate of the Universe

The nature of dark energy determines the ultimate fate of the cosmos:

If $w = -1$ (cosmological constant): The universe expands exponentially forever. Galaxies beyond our local group recede beyond the cosmological horizon. Stars burn out. The universe approaches a cold, empty de Sitter space, the "heat death."

If $w > -1$ (quintessence): Dark energy may eventually fade, potentially leading to deceleration or even recollapse (a "Big Crunch"), depending on the details of the scalar field potential.

If $w < -1$ (phantom energy): The accelerated expansion intensifies without bound, eventually ripping apart all bound structures, galaxy clusters, galaxies, stars, planets, atoms, in a "Big Rip" at a finite time in the future.

Key Insights

• Type Ia supernovae revealed in 1998 that the expansion of the universe is accelerating
• Dark energy constitutes ~68% of the universe and has negative pressure ($w \approx -1$)
• The cosmological constant $\Lambda$ is the simplest model: vacuum energy with $w = -1$ exactly
• The cosmological constant problem, a 120-order-of-magnitude discrepancy between theory and observation, is one of the deepest puzzles in physics
• Quintessence models propose dark energy is a dynamical scalar field with time-varying $w$
• A $\Lambda$-dominated universe asymptotes to de Sitter space with an exponentially expanding, emptying cosmos
• Determining whether $w = -1$ exactly or varies with time is a primary goal of modern observational cosmology

Looking Ahead

We have now surveyed the major components of the universe: ordinary matter, dark matter, and dark energy. But how did the tiny density perturbations from inflation grow into the rich tapestry of galaxies, clusters, and voids we see today? In the next lesson, we explore structure formation: the gravitational amplification of primordial fluctuations into the cosmic web.