|q⟩ Bad Qubits

advanced · Programming · Advanced VQE & Ansatz Design

Barren Plateaus

A variational algorithm trains by following the gradient of a cost C(θ)=ψ(θ)Hψ(θ)C(\boldsymbol{\theta}) = \langle\psi(\boldsymbol{\theta})|H|\psi(\boldsymbol{\theta})\rangle. A barren plateau is a landscape in which that gradient is exponentially small almost everywhere: C/θk0\partial C/\partial\theta_k \approx 0 to within the precision you can afford to measure. When this happens the optimizer wanders aimlessly on a flat plain, and no amount of classical cleverness rescues it. McClean and collaborators identified this as a fundamental obstacle to scaling VQE and quantum neural networks.

The variance argument

The diagnosis is statistical. For a sufficiently random ansatz the gradient component kC\partial_k C has mean zero when averaged over parameters,

E[kC]=0,\mathbb{E}\bigl[\partial_k C\bigr] = 0,

so the issue is not bias but vanishing variance. McClean et al. showed that when the ansatz forms (approximately) a 2-design — which deep, generic hardware-efficient circuits do — the variance of each gradient component shrinks exponentially in the number of qubits:

Var[kC]12n.\mathrm{Var}\bigl[\partial_k C\bigr] \sim \frac{1}{2^{\,n}}.

Because the typical gradient magnitude is Var\sqrt{\mathrm{Var}}, you would need on the order of 2n2^{n} shots just to resolve the slope from shot noise. At, say, n=50n = 50 qubits that is hopeless.

Three things that cause plateaus

Research since 2018 has mapped several distinct mechanisms, all of which flatten the landscape:

A small illustration

Imagine measuring a single Pauli Z0Z_0 on a state produced by a deep random circuit. The reduced state of qubit 0 is, on average, the maximally mixed state I/2I/2, for which Z0=0\langle Z_0\rangle = 0 exactly. Perturbing one angle nudges this expectation by an amount that, averaged over the random parameters, has variance 1/2n\sim 1/2^n because the perturbation is "diluted" across the exponentially large Hilbert space. The expectation sits pinned near zero, and so does its derivative.

Mitigation strategies (previewed here, used later)

You do not simply give up. The rest of this module is, in part, a toolbox against plateaus:

Key takeaways

Sign in on the full site to ask questions and join the discussion.