Complex Systems · 2/7 · Series index · Notation

The finite-variance baseline and MGF method are developed in Central limit theorem.

Scale-Free Distributions: Stability, Power Laws, and Extreme Events

Stable distributions describe how a distribution can retain its shape under addition and rescaling. Power laws describe tails without a characteristic scale. Together, these ideas explain why a normal approximation may fail and how to calculate probabilities and moments for heavy-tailed variables.

Stable Distributions and Domains of Attraction: What Survives Addition?

Let X1,…,XnX_1,\ldots,X_n be independent and identically distributed, and define

Sn=∑i=1nXi,Xˉn=Snn.S_n=\sum_{i=1}^nX_i,\qquad \bar X_n=\frac{S_n}{n}.

A distribution is stable if addition preserves its shape up to a shift and a change of scale. More precisely, for every nn, there are constants an>0,bn∈Ra_n>0,b_n\in\mathbb R such that

Sn=danX+bn.S_n\overset{d}{=}a_nX+b_n.

The symbol =d\overset{d}{=} means “equal in distribution”; it does not mean that the two sides take identical values in each realization. If one can choose bn=0b_n=0, the distribution is strictly stable. Stability is an exact property for every finite nn; attraction is a limiting property as n→∞n\to\infty. For example, the uniform distribution is not stable, but its standardized sums approach a normal distribution, so it belongs to the normal distribution's domain of attraction.

Stability of the Normal Distribution

If Xi∼N(μ,σ2)X_i\sim\mathcal N(\mu,\sigma^2), then

MX(t)=E[etX]=exp⁡ ⁣(μt+σ2t22),MSn(t)=∏i=1nMXi(t)=exp⁡ ⁣(nμt+nσ2t22).\begin{aligned} M_X(t)&=\mathbb E[e^{tX}] =\exp\!\left(\mu t+\frac{\sigma^2t^2}{2}\right),\\ M_{S_n}(t)&=\prod_{i=1}^nM_{X_i}(t) =\exp\!\left(n\mu t+\frac{n\sigma^2t^2}{2}\right). \end{aligned}

Independence allows the expectation of a product to factor into the product of expectations. Therefore,

Sn∼N(nμ,nσ2),Xˉn∼N ⁣(μ,σ2n),Sn−nμσn∼N(0,1).\begin{aligned} S_n&\sim\mathcal N(n\mu,n\sigma^2),\\ \bar X_n&\sim\mathcal N\!\left(\mu,\frac{\sigma^2}{n}\right),\\ \frac{S_n-n\mu}{\sigma\sqrt n}&\sim\mathcal N(0,1). \end{aligned}

For a standard normal distribution, μ=0,σ=1\mu=0,\sigma=1, the identity MSn(t)=MX(n t)M_{S_n}(t)=M_X(\sqrt n\,t) holds. It shows that the width of the sum increases by a factor of n\sqrt n. The width of the sample mean decreases by a factor of 1/n1/\sqrt n.

Self-Similarity Must Include Density Normalization

If Sn=danXS_n\overset{d}{=}a_nX, then

fSn(s)=1anfX ⁣(san).f_{S_n}(s)=\frac1{a_n}f_X\!\left(\frac{s}{a_n}\right).

The factor 1/an1/a_n comes from the change of variable and ensures that the density still integrates to 11. For standard normal summands,

fSn(s)=12πne−s2/(2n),fXˉn(x)=n2πe−nx2/2.\begin{aligned} f_{S_n}(s)&=\frac{1}{\sqrt{2\pi n}}e^{-s^2/(2n)},\\ f_{\bar X_n}(x)&=\sqrt{\frac n{2\pi}}e^{-nx^2/2}. \end{aligned}

Common mistake: the expression p(n xˉ)p(\sqrt n\,\bar x) illustrates rescaling the argument of a function. It cannot be used directly as the density of Xˉn\bar X_n, because that would omit the Jacobian. For nonnormal XiX_i, the unstandardized sum SnS_n also generally does not converge to a fixed normal distribution: it must first be centered and rescaled.

Why Do Domains of Attraction Matter?

Macroscopic observations are often sums of many small contributions. If different microscopic distributions approach the same limit under the same rescaling, predicting the macroscopic shape does not require knowing every microscopic detail. This is the probabilistic starting point for universality. Independence, dependence, and tail conditions must still be checked.

How Can the Assumptions of the Central Limit Theorem Be Relaxed?

The ordinary i.i.d. version assumes E[Xi]=μ\mathbb E[X_i]=\mu and 0<Var⁡(Xi)=σ2<∞0<\operatorname{Var}(X_i)=\sigma^2<\infty, and concludes that

Sn−nμσn→dN(0,1).\frac{S_n-n\mu}{\sigma\sqrt n}\xrightarrow{d}\mathcal N(0,1).

The following three changes require separate consideration. “There are many terms” alone does not justify applying the CLT.

Nonidentical Distributions: The Lyapunov CLT

Suppose the XiX_i are independent but may have different means μi\mu_i and variances σi2\sigma_i^2. Define

sn2=∑i=1nσi2.s_n^2=\sum_{i=1}^n\sigma_i^2.

If there exists δ>0\delta>0 such that the Lyapunov condition holds,

lim⁡n→∞1sn2+δ∑i=1nE ⁣[∣Xi−μi∣2+δ]=0,\lim_{n\to\infty}\frac{1}{s_n^{2+\delta}} \sum_{i=1}^n\mathbb E\!\left[|X_i-\mu_i|^{2+\delta}\right]=0,

then

∑i=1n(Xi−μi)sn→dN(0,1).\frac{\sum_{i=1}^n(X_i-\mu_i)}{s_n}\xrightarrow{d}\mathcal N(0,1).

The condition says that the aggregate contribution of large deviations, measured by a higher moment, becomes small relative to the overall fluctuation scale. It prevents a few terms from completely dominating the sum. Here sns_n is the standard deviation of the sum, not the sum of the individual standard deviations. The Lyapunov condition is sufficient, but it is not necessary for every possible CLT.

Example: Independent Bernoulli Variables with Different Parameters

Let the Xi∼Bernoulli⁡(pi)X_i\sim\operatorname{Bernoulli}(p_i) be independent, and suppose sn2≥cns_n^2\ge cn for some c>0c>0. Choose δ=1\delta=1. Since ∣Xi−pi∣≤1|X_i-p_i|\le1,

∑iE∣Xi−pi∣3sn3≤n(cn)3/2⟶0.\frac{\sum_i\mathbb E|X_i-p_i|^3}{s_n^3} \le\frac{n}{(cn)^{3/2}}\longrightarrow0.

The standardized sum therefore approaches a normal distribution even when the pip_i differ. To answer such a question, write down the means, variances, and sns_n; choose δ\delta; bound the ratio; and state the limiting distribution.

Weak Dependence: The Coarse-Graining Intuition

If dependence persists only over short distances, grouping many observations into large blocks can make sufficiently separated blocks nearly independent, allowing a normal limit to survive. Condition: “small correlation” or “correlation tending to zero” alone is not sufficient to guarantee a CLT. Appropriate mixing or other dependence conditions are still needed. Being uncorrelated is also not the same as being independent.

For a stationary sequence, let C(k)=Cov⁡(Xt,Xt+k)C(k)=\operatorname{Cov}(X_t,X_{t+k}). Then the exact variance is

Var⁡(Sn)=nC(0)+2∑k=1n−1(n−k)C(k).\operatorname{Var}(S_n)=nC(0)+2\sum_{k=1}^{n-1}(n-k)C(k).

When the covariances are absolutely summable and suitable CLT conditions hold, one typically obtains

Var⁡(Sn)∼nσLR2,σLR2=C(0)+2∑k=1∞C(k)>0.\begin{aligned} \operatorname{Var}(S_n)&\sim n\sigma_{\mathrm{LR}}^2,\\ \sigma_{\mathrm{LR}}^2&=C(0)+2\sum_{k=1}^{\infty}C(k)>0. \end{aligned}

The normalization must use the long-run variance σLR2\sigma_{\mathrm{LR}}^2. Long-range dependence can change the n\sqrt n scaling and may even change the limiting distribution.

Infinite Mean or Variance

The assumptions of the ordinary finite-variance CLT fail, so a normal approximation cannot be used automatically. The Cauchy distribution in the next section provides a concrete counterexample. More generally, normalized sums may approach a non-Gaussian stable distribution. However, “the assumptions of this theorem fail” does not mean that “every possible form of a normal limit is impossible.”

Cauchy / Lorentz: Averaging More Does Not Always Improve Accuracy

The Cauchy, or Lorentz, distribution centered at 00 with scale γ>0\gamma>0 has density

fX(x)=γπ(x2+γ2),−∞<x<∞.f_X(x)=\frac{\gamma}{\pi(x^2+\gamma^2)},\qquad -\infty<x<\infty.

Its center is its median and mode, not its expectation. Normalization can be checked using
∫(x2+γ2)−1 dx=γ−1arctan⁡(x/γ)\int (x^2+\gamma^2)^{-1}\,dx=\gamma^{-1}\arctan(x/\gamma).

Why Does the Cauchy Mean Not Exist?

The positive and negative halves of the integral must be checked separately:

∫0RxfX(x) dx=γ2πlog⁡ ⁣(R2+γ2γ2)→R→∞+∞.\int_0^R x f_X(x)\,dx =\frac{\gamma}{2\pi}\log\!\left(\frac{R^2+\gamma^2}{\gamma^2}\right) \xrightarrow{R\to\infty}+\infty.

The negative half-line contributes −∞-\infty, so the ordinary expectation is the undefined expression ∞−∞\infty-\infty. The symmetric principal value
lim⁡R→∞∫−RRxfX(x) dx=0\lim_{R\to\infty}\int_{-R}^{R}xf_X(x)\,dx=0 does not establish the existence of the expectation. Also, x2fX(x)→γ/πx^2f_X(x)\to\gamma/\pi, so E[X2]=∞\mathbb E[X^2]=\infty. The logarithmic antiderivative has coefficient γ/(2π)\gamma/(2\pi).

Why Switch to the Characteristic Function?

For this distribution, the moment-generating function MX(t)=E[etX]M_X(t)=\mathbb E[e^{tX}] diverges at every nonzero real tt. The characteristic function always exists, because ∣eiqX∣=1|e^{iqX}|=1:

φX(q)=E[eiqX]=∫−∞∞fX(x)eiqx dx,fX(x)=12π∫−∞∞φX(q)e−iqx dq.\begin{aligned} \varphi_X(q)&=\mathbb E[e^{iqX}] =\int_{-\infty}^{\infty}f_X(x)e^{iqx}\,dx,\\ f_X(x)&=\frac1{2\pi}\int_{-\infty}^{\infty}\varphi_X(q)e^{-iqx}\,dq. \end{aligned}

The inversion formula requires appropriate integrability conditions. Those conditions hold here because the Cauchy characteristic function is integrable. The forward and inverse Fourier transforms use opposite signs, with a factor 1/(2π)1/(2\pi) in the inverse transform.

For the Cauchy distribution, φX(q)=e−γ∣q∣\varphi_X(q)=e^{-\gamma|q|}. Verification: the inverse transform gives an elementary check without requiring contour integration:

12π∫−∞∞e−γ∣q∣e−iqx dq=1π∫0∞e−γqcos⁡(qx) dq=1πRe⁡1γ+ix=γπ(γ2+x2).\begin{aligned} &\frac1{2\pi}\int_{-\infty}^{\infty}e^{-\gamma|q|}e^{-iqx}\,dq\\ &\quad=\frac1\pi\int_0^\infty e^{-\gamma q}\cos(qx)\,dq\\ &\quad=\frac1\pi\operatorname{Re}\frac1{\gamma+ix} =\frac{\gamma}{\pi(\gamma^2+x^2)}. \end{aligned}

The Key Calculation for Independent Sums

φSn(q)=[φX(q)]n=e−nγ∣q∣,⟹fSn(s)=nγπ[s2+(nγ)2].\begin{aligned} \varphi_{S_n}(q)&=[\varphi_X(q)]^n=e^{-n\gamma|q|},\\ \Longrightarrow\quad f_{S_n}(s)&=\frac{n\gamma}{\pi[s^2+(n\gamma)^2]}. \end{aligned}

Thus Sn∼Cauchy⁡(0,nγ)S_n\sim\operatorname{Cauchy}(0,n\gamma), whereas

φXˉn(q)=φSn(q/n)=e−γ∣q∣,Xˉn=dX1.\begin{aligned} \varphi_{\bar X_n}(q)&=\varphi_{S_n}(q/n)=e^{-\gamma|q|},\\ &\boxed{\bar X_n\overset{d}{=}X_1}. \end{aligned}

The width of the sample-mean distribution does not shrink with sample size. For example, whatever the value of nn, Pr⁡(∣Xˉn∣>γ)=1/2\Pr(|\bar X_n|>\gamma)=1/2. This does not contradict the usual law of large numbers, because the Cauchy distribution does not satisfy the sufficient condition of a finite first absolute moment.

Lévy Stable Distributions, the Generalized CLT, and Scaling Exponents

A symmetric stable family centered at zero has characteristic function

φX(q)=exp⁡(−γ∣q∣α),γ>0,0<α≤2.\boxed{\varphi_X(q)=\exp(-\gamma|q|^\alpha)}, \qquad \gamma>0,\quad 0<\alpha\le2.

Here α\alpha is the stability index, also associated with the tail exponent, while γ\gamma controls scale and has the same physical dimensions as XαX^\alpha. In this stable-family formula, γ\gamma is a scale parameter, distinct from its use for a density-tail exponent. A location parameter of zero does not imply that the mean exists: a symmetric stable distribution has no finite mean when α≤1\alpha\le1. General stable distributions may also have location and skewness parameters.

Independence and uniqueness of characteristic functions give

φSn(q)=e−nγ∣q∣α=φX(n1/αq)⟹Sn=dn1/αX.\varphi_{S_n}(q)=e^{-n\gamma|q|^\alpha} =\varphi_X(n^{1/\alpha}q) \quad\Longrightarrow\quad S_n\overset{d}{=}n^{1/\alpha}X.

The density and sample mean therefore scale as

fSn(s)=n−1/αfX(s/n1/α),Xˉn=dn1/α−1X.\begin{aligned} f_{S_n}(s)&=n^{-1/\alpha}f_X(s/n^{1/\alpha}),\\ \bar X_n&\overset{d}{=}n^{1/\alpha-1}X. \end{aligned}

This derivation explains three important cases:

  • α=2\alpha=2: the normal distribution. Comparing e−γq2e^{-\gamma q^2} with the normal characteristic function gives σ2=2γ\sigma^2=2\gamma. The width of the sample mean decreases as n−1/2n^{-1/2}.
  • α=1\alpha=1: the Cauchy distribution. The sum scales by nn, while the scale of the sample mean remains unchanged.
  • 1<α<21<\alpha<2: the mean exists, but the fluctuation scale of the sample mean decreases as n−(1−1/α)n^{-(1-1/\alpha)}, more slowly than in the normal case. For 0<α<10<\alpha<1, this scale instead increases.

Here “width” may be measured by a quantile-based scale such as the interquartile range. It cannot mean a standard deviation that does not exist. For example, with α=3/2\alpha=3/2, the scale of SnS_n is n2/3n^{2/3} and that of Xˉn\bar X_n is n−1/3n^{-1/3}.

Power-Law Tails and Moments

Symmetric non-Gaussian stable distributions satisfy

fX(x)∼Cα∣x∣−1−α(∣x∣→∞),0<α<2,f_X(x)\sim C_\alpha |x|^{-1-\alpha}\quad (|x|\to\infty), \qquad 0<\alpha<2,

and, for r>0r>0, E∣X∣r<∞\mathbb E|X|^r<\infty if and only if r<αr<\alpha. Thus every non-Gaussian stable distribution has a divergent second moment. In the symmetric case, a finite mean exists only when α>1\alpha>1. Important endpoint: when α=2\alpha=2, the tail is Gaussian. Substituting α=2\alpha=2 into the non-Gaussian power-law expression to obtain ∣x∣−3|x|^{-3} is incorrect. The normal distribution has finite absolute moments of every order.

The Generalized Central Limit Theorem

If the tails of i.i.d. random variables place them in the domain of attraction of a stable distribution, constants an>0,bna_n>0,b_n can be chosen so that

Sn−bnan→dZα.\frac{S_n-b_n}{a_n}\xrightarrow{d}Z_\alpha.

For regular power-law tails with index α∈(0,2)\alpha\in(0,2), the typical growth of ana_n is n1/αn^{1/\alpha}, possibly accompanied by a slowly varying factor in more general cases. When α>1\alpha>1, the usual centering is bn=nE[X]b_n=n\mathbb E[X]. The earlier equality for every finite nn applies to exactly symmetric stable distributions.

Stable Distributions and Other Distribution Families

“Stable distributions are either normal or have power-law tails” describes the stable family. It cannot be extended to “all observations of complex systems must be normal or power-law distributed.” Empirical distributions may also have exponential tails, lognormal tails, mixture shapes, or finite cutoffs. The reverse claim, “every power-law distribution is strictly stable,” is also false: the Pareto distribution is generally not stable, although for suitable tail indices it can belong to a stable domain of attraction.

Calculating with Power Laws: Exponents, Tail Probabilities, and Moments

To avoid an off-by-one error in the exponent, write

fX(x)=Cx−τ,τ=1+α,x≥xmin⁡>0.f_X(x)=C x^{-\tau},\qquad \tau=1+\alpha, \qquad x\ge x_{\min}>0.

Here τ\tau is the density exponent, while α\alpha is the cumulative-tail exponent. For τ>1\tau>1, normalization gives

1=C∫xmin⁡∞x−τ dx=Cxmin⁡1−ττ−1,⟹C=(τ−1)xmin⁡τ−1.\begin{aligned} 1&=C\int_{x_{\min}}^\infty x^{-\tau}\,dx =\frac{C x_{\min}^{1-\tau}}{\tau-1},\\ \Longrightarrow\quad C&=(\tau-1)x_{\min}^{\tau-1}. \end{aligned}

A pure power law cannot be integrable at both ends of the entire interval (0,∞)(0,\infty). A lower cutoff or another modification at small scales is therefore essential.

What Does “Scale-Free” Mean?

Within the range where the power law holds,

fX(cx)=c−τfX(x),Pr⁡(X>cx)Pr⁡(X>x)=c−α(c≥1).f_X(cx)=c^{-\tau}f_X(x),\qquad \frac{\Pr(X>cx)}{\Pr(X>x)}=c^{-\alpha}\quad(c\ge1).

Multiplying the threshold by a fixed factor produces the same relative reduction in probability, regardless of the starting value xx. The tail has no single exponential decay scale of the kind found in e−x/x0e^{-x/x_0}. This does not mean that the distribution has no scale parameters at all, or that its mean must fail to exist. The Pareto lower cutoff xmin⁡x_{\min}, a stable distribution's scale parameter, and quantile-based widths can all exist.

From the Density to the Complementary CDF

F‾X(x)=Pr⁡(X>x)=∫x∞Cu−τ du=Cτ−1x−(τ−1)∝x−α.\begin{aligned} \overline F_X(x)&=\Pr(X>x)=\int_x^\infty Cu^{-\tau}\,du\\ &=\frac{C}{\tau-1}x^{-(\tau-1)}\propto x^{-\alpha}. \end{aligned}

Consequently, on logarithmic axes,

log⁡fX(x)=log⁡C−τlog⁡x,log⁡F‾X(x)=const−αlog⁡x.\begin{aligned} \log f_X(x)&=\log C-\tau\log x,\\ \log\overline F_X(x)&=\mathrm{const}-\alpha\log x. \end{aligned}

The PDF slope is −(1+α)-(1+\alpha); the CCDF slope is −α-\alpha; the CDF F=1−F‾F=1-\overline F itself is generally not a straight line. Identify the vertical-axis quantity before reading off an exponent. With logarithmic binning, raw bin counts also include the bin width, which increases with xx; divide by bin width to estimate a density. A straight line is a diagnostic clue for a power law, but approximate linearity over a finite range is not a rigorous proof.

One Integral Gives the Moment Condition

For r>0r>0,

E[Xr]=C∫xmin⁡∞xr−τ dx<∞⟺r−τ<−1⟺r<τ−1=α.\begin{aligned} \mathbb E[X^r]&=C\int_{x_{\min}}^\infty x^{r-\tau}\,dx<\infty\\ &\Longleftrightarrow r-\tau<-1\\ &\Longleftrightarrow \boxed{r<\tau-1=\alpha}. \end{aligned}

At r=αr=\alpha, the integral is of the form ∫dx/x\int dx/x, which diverges logarithmically; equality does not count as finite. A finite mean therefore requires α>1\alpha>1, and a finite second moment and variance require α>2\alpha>2. For a positive random variable with α≤1\alpha\le1, the expectation is +∞+\infty. For a symmetric distribution with two heavy tails, the mean may instead be undefined. These are different statements.

Finite-System Cutoffs

If xmin⁡≤X≤xmax⁡<∞x_{\min}\le X\le x_{\max}<\infty, all positive-order moments are finite, even though a broad intermediate range may still follow a power law. For f(x)=Cx−1−αf(x)=C x^{-1-\alpha},

E[Xr]={Cr−α(xmax⁡r−α−xmin⁡r−α),r≠α,Clog⁡(xmax⁡/xmin⁡),r=α.\mathbb E[X^r]= \begin{cases} \displaystyle\frac{C}{r-\alpha}\left(x_{\max}^{r-\alpha}-x_{\min}^{r-\alpha}\right),&r\ne\alpha,\\[4pt] \displaystyle C\log(x_{\max}/x_{\min}),&r=\alpha. \end{cases}

Thus a cutoff removes mathematically infinite moments, but their estimated values can remain highly sensitive to the upper limit and to extreme observations.

Pareto Wealth Distributions and Microscopic Exchange Models

The Pareto model has parameters α>0,xm>0\alpha>0,x_m>0:

fX(x)={αxmαxα+1,x≥xm,0,x<xm,FX(x)={1−(xm/x)α,x≥xm,0,x<xm.\begin{aligned} f_X(x)&=\begin{cases} \dfrac{\alpha x_m^\alpha}{x^{\alpha+1}},&x\ge x_m,\\ 0,&x<x_m, \end{cases}\\ F_X(x)&=\begin{cases} 1-(x_m/x)^\alpha,&x\ge x_m,\\ 0,&x<x_m. \end{cases} \end{aligned}

For x≥xmx\ge x_m, the CDF follows by integrating ∫xmxfX(u) du\int_{x_m}^{x}f_X(u)\,du, and the tail probability is (xm/x)α(x_m/x)^\alpha. For any r<αr<\alpha, the moment is

E[Xr]=αxmrα−r.\mathbb E[X^r]=\frac{\alpha x_m^r}{\alpha-r}.

The mean, median, and variance are

E[X]=αxmα−1(α>1),Med⁡(X)=xm21/α,Q(u)=xm(1−u)−1/α(0<u<1),Var⁡(X)=αxm2(α−1)2(α−2)(α>2).\begin{aligned} \mathbb E[X]&=\frac{\alpha x_m}{\alpha-1}\quad(\alpha>1),\\ \operatorname{Med}(X)&=x_m2^{1/\alpha},\\ Q(u)&=x_m(1-u)^{-1/\alpha}\quad(0<u<1),\\ \operatorname{Var}(X)&=\frac{\alpha x_m^2}{(\alpha-1)^2(\alpha-2)}\quad(\alpha>2). \end{aligned}

The final expression follows by simplifying E[X2]−(E[X])2\mathbb E[X^2]-(\mathbb E[X])^2. Do not substitute α≤2\alpha\le2 into this formula and interpret a negative result as a “variance.” For 1<α≤21<\alpha\le2, the variance is infinite. For α≤1\alpha\le1, a finite mean already fails to exist.

The Gini Coefficient and Lorenz Curve

Assume α>1\alpha>1. Let uu be the cumulative population share counted from the poorest individuals upward. The Lorenz curve L(u)L(u) gives the share of wealth held by those individuals:

L(u)=∫0uQ(v) dvE[X]=1−(1−u)(α−1)/α.L(u)=\frac{\int_0^u Q(v)\,dv}{\mathbb E[X]} =1-(1-u)^{(\alpha-1)/\alpha}.

Under perfect equality, L(u)=uL(u)=u. The Gini coefficient is twice the area between the equality line and the Lorenz curve:

G=1−2∫01L(u) du=12α−1.G=1-2\int_0^1L(u)\,du=\boxed{\frac1{2\alpha-1}}.

A smaller α\alpha means a heavier tail and greater concentration of wealth. For an ideal Pareto distribution with α≤1\alpha\le1, the population Gini coefficient cannot be calculated directly from this finite-mean definition.

Worked Example: A Pareto Distribution with α=1.5\alpha=1.5

Take α=1.5,xm=1\alpha=1.5,x_m=1. Then

F(x)=1−x−3/2,Pr⁡(X>4)=4−3/2=18,E[X]=3,Med⁡(X)=22/3≈1.587,G=12.\begin{aligned} F(x)&=1-x^{-3/2},\\ \Pr(X>4)&=4^{-3/2}=\frac18,\\ \mathbb E[X]&=3,\\ \operatorname{Med}(X)&=2^{2/3}\approx1.587,\\ G&=\frac12. \end{aligned}

The second moment and variance diverge, while the mean remains finite. The density has log-log slope −2.5-2.5, and the CCDF has slope −1.5-1.5. Interpretation: α≈1.5\alpha\approx1.5 is one possible model of a heavy wealth tail. It does not imply that all countries, periods, or wealth ranges follow exactly this distribution. A finite sample also cannot prove that the true population variance of wealth is infinite.

Why Consider an Agent-Based Model?

Wealth-exchange models describe how trading and saving rules generate a distribution of wealth across individuals. When two individuals i,ji,j are selected,

xi′=xi−Δx,xj′=xj+Δx,xi′+xj′=xi+xj.x_i'=x_i-\Delta x,\qquad x_j'=x_j+\Delta x, \qquad x_i'+x_j'=x_i+x_j.

This closed model conserves total wealth, much as colliding molecules exchange energy. A simulation must also constrain its trading rules so that it does not inadvertently produce wealth values that the model forbids, such as negative wealth. Conservation alone does not imply a power law: the exchange and saving rules determine the eventual distribution.

Kinetic theory and wealth exchange have the following correspondence:

Kinetic theory of gases Wealth-exchange model
Particles Individuals or agents
Kinetic energy KK Wealth xx
Collisions Trades
Geometric dimension DD Effective parameter DλD_\lambda

The corresponding temperature scales are

kBT=2⟨K⟩D↔Tλ=2⟨x⟩Dλ.k_BT=\frac{2\langle K\rangle}{D} \quad\leftrightarrow\quad T_\lambda=\frac{2\langle x\rangle}{D_\lambda}.

The dimensionless variables are K/(kBT)K/(k_BT) and x/Tλx/T_\lambda, respectively. A Gamma-distribution shape function may be written γD/2\gamma_{D/2}; it is distinct from the stable-distribution scale parameter γ\gamma. Simple exchange rules can generate population-level statistics with an approximately Gibbs-like body and a Pareto-like upper tail.

Earthquakes and Aftershocks: Identify the Variable Before Calling It a Power Law

Earthquake magnitude, amplitude, cumulative event counts, and probability densities are different quantities. Distinguishing them is essential because a change of variable changes the tail exponent and can change whether the mean is finite.

The Gutenberg–Richter Law

For a fixed region, observation period, and completeness threshold m0m_0, the cumulative number of earthquakes satisfies

log⁡10N(M≥m)=a−bm,b≈1 as an illustrative value.\log_{10}N(M\ge m)=a-bm,\qquad b\approx1\text{ as an illustrative value}.

Normalizing within the set of events with M≥m0M\ge m_0 gives

Pr⁡(M≥m∣M≥m0)=10−b(m−m0),m≥m0.\Pr(M\ge m\mid M\ge m_0)=10^{-b(m-m_0)},\qquad m\ge m_0.

The magnitude density and mean are therefore

fM(m)=bln⁡10 10−b(m−m0),E[M]=m0+1bln⁡10<∞.\begin{aligned} f_M(m)&=b\ln10\,10^{-b(m-m_0)},\\ \mathbb E[M]&=m_0+\frac1{b\ln10}<\infty. \end{aligned}

The tail of magnitude MM is exponential, not a power law. For b>0b>0 and a finite lower threshold, this magnitude distribution has a finite mean.

Using the simplified relation M−m0=log⁡10(A/A0)M-m_0=\log_{10}(A/A_0), the amplitude AA instead satisfies

Pr⁡(A>a)=(A0a)b,fA(a)=bA0ba−b−1,a≥A0.\begin{aligned} \Pr(A>a)&=\left(\frac{A_0}{a}\right)^b,\\ f_A(a)&=bA_0^b a^{-b-1},\qquad a\ge A_0. \end{aligned}

The same result follows from fA(a)=fM(m(a))∣dm/da∣f_A(a)=f_M(m(a))|dm/da|, where ∣dm/da∣=1/(aln⁡10)|dm/da|=1/(a\ln10). Omitting this Jacobian changes the power-law exponent by one. The amplitude-tail index is α=b\alpha=b. In the ideal untruncated case with b=1b=1, the amplitude mean diverges, while the magnitude mean remains finite. Actual magnitude definitions also include instrumental, distance, and other corrections, so M=log⁡10AM=\log_{10}A is not a complete measurement formula.

The meaning of the cumulative count can be checked against the USGS description of the Gutenberg–Richter law. The probability transformation and mean above then follow directly from the equations.

Omori's Law for Aftershocks

An aftershock decay law Nt∼t−pN_t\sim t^{-p}, with p≈1p\approx1, describes the event rate per unit time. A commonly used regularized form is

r(t)=K(t+c)p,K>0, c>0,r(t)=\frac{K}{(t+c)^p},\qquad K>0,\ c>0,

where cc removes the singularity at t=0t=0. When p=1p=1, the expected event count over [t1,t2][t_1,t_2] is

E[N(t1,t2)]=∫t1t2r(t) dt=Kln⁡ ⁣t2+ct1+c.\mathbb E[N(t_1,t_2)]=\int_{t_1}^{t_2}r(t)\,dt =K\ln\!\frac{t_2+c}{t_1+c}.

A rate is not a normalized probability density. The relation r(t)∝1/tr(t)\propto1/t alone does not establish that “the mean aftershock time is infinite, so aftershocks never stop.” If a separate probability model is defined by fT(t)∝t−pf_T(t)\propto t^{-p} for t≥tmin⁡>0t\ge t_{\min}>0, normalization requires p>1p>1, and a finite mean requires p>2p>2. With p=1p=1, a model over an infinite time interval cannot even be normalized. This is another reason to handle exponent boundaries carefully.

Consequences of Having No Characteristic Scale

The St Petersburg paradox. The first head of a fair coin appears on toss nn, where n=1,2,…n=1,2,\ldots, and the payout is W=2n−1W=2^{n-1}. Then

Pr⁡(N=n)=2−n,E[W]=∑n=1∞2n−12−n=∑n=1∞12=∞.\begin{aligned} \Pr(N=n)&=2^{-n},\\ \mathbb E[W]&=\sum_{n=1}^{\infty}2^{n-1}2^{-n} =\sum_{n=1}^{\infty}\frac12=\infty. \end{aligned}

Nevertheless, Pr⁡(W<∞)=1\Pr(W<\infty)=1: a finite outcome almost surely is entirely consistent with an infinite expectation. For example, Pr⁡(W≤2)=3/4\Pr(W\le2)=3/4. Pricing only by risk-neutral expected break-even value gives no finite fair entry fee. Wealth limits, payout caps, risk preferences, or utility functions change the pricing problem. If NN is the toss on which the first head occurs, the number of preceding tails is N−1N-1; consistent indexing is essential.

Extreme events are not automatically outliers to discard. A heavy-tailed distribution assigns much greater probabilities to large events than a Gaussian model does. If very large and small events arise from the same mechanism, removing the largest observations simply because of their size systematically underestimates tail risk. Biological extinctions and large market crashes illustrate extreme events. In financial models, option prices can be sensitive to distribution tails and volatility. The methodological lesson is: check data quality and the generating mechanism before deciding that a point is anomalous; “rare” is not equivalent to “bad data.” A single histogram or market crash does not rigorously establish an exact power law for the entire tail.

Econophysics: returns, memory, and volatility. The efficient-market hypothesis, Brownian motion, normality of returns, existence of variance, and short or long memory are distinct questions. The efficient-market hypothesis does not itself imply normally distributed returns. GARCH is a family of models for a conditional variance that changes over time, allowing volatility clustering: large fluctuations tend to be followed by further large fluctuations. A volatility smile describes implied volatility, inferred through the same underlying pricing model, varying with strike price.

Structures across scales and the motivation for modeling. Cosmic superstructures raise questions about patterns across scales. Avalanche distributions in systems of coupled pendulums show how local interactions can generate a population-level power law. Simple mechanisms can therefore explain collective phenomena and statistical patterns without predicting every individual catastrophe. A power law alone does not uniquely identify the microscopic mechanism.


← Central limit theorem · Series index · Scale-free networks →