The SIMSYSTEM Procedure

Pearson System of Distributions

The Pearson system of continuous distributions was introduced by Karl Pearson beginning in the 1890s (Pearson 1895, 1901, 1916). For an explanation of Pearson’s derivation, see Chapter 4 of Elderton and Johnson (1969) and Chapter 12 of Johnson, Kotz, and Balakrishnan (1994). Rodriguez (2006) and Ord (2006) provide overviews of the Pearson system.

Each probability density function p left-parenthesis y right-parenthesis in the Pearson system is a solution of the differential equation

StartFraction d log p left-parenthesis y right-parenthesis Over d y EndFraction equals StartFraction a plus y Over c 0 plus c 1 y plus c 2 y squared EndFraction

The location, scale, and shape parameters of the density function depend on the constants a, c 0, c 1, and c 2. Solving the equation for various combinations of these constants gives rise to different families of distributions, which Pearson designated by using roman numerals. As pointed out by Johnson, Kotz, and Balakrishnan (1994), this numbering scheme does not have a clear basis, but it is well established in the statistical literature.

Subsequent to Pearson’s work, most families in the Pearson system were re-derived in other contexts, where they received other names that are familiar in modern statistical work. For instance, the distributions in the Pearson Type III family are now commonly known as the gamma distributions. The parameters table that is produced by the SIMSYSTEM procedure identifies each Pearson distribution used for simulation by its Pearson type and its common name (if there is one). This table also provides the location, scale, and shape parameter(s) for each distribution.

There are three main types of distributions in the Pearson system:

  • the Type I family, known as beta distributions

  • the Type IV family, which has no familiar counterpart

  • the Type VI family, known as F distributions

Each of these three families has two shape parameters. Their regions in the left-parenthesis StartRoot beta 1 EndRoot comma beta 2 right-parenthesis plane complement each other and completely cover the feasible region.

The Pearson system also includes families of distributions that are limiting forms of the main types and are referred to as transition types:

  • the normal distribution (no associated type number)

  • the Type II family, known as symmetric beta distributions

  • the Type III family, known as gamma distributions

  • the Type V family, known as inverse gamma distributions

  • the Type VII family, known as Student’s t distributions

Finally, the Pearson system also includes families of distributions that are special cases of the more important types:

  • Type VIII, known as power distributions

  • Type IX, known as power distributions

  • Type X, known as exponential distributions

  • Type XI, known as power distributions

  • Type XII, a special case of Type I

These additional types are not required for defining distributions that cover the full skewness/kurtosis range, so they are not included in the PROC SIMSYSTEM results.

The following subsections provide the probability density function for each Pearson family. The parameter notation matches that of the parameters table produced by the procedure.

Pearson Normal Family

The family of normal distributions belongs to the Pearson system in the sense that it is a limiting form of each of the three main types of Pearson distributions. Pearson did not assign a roman numeral to the normal family, but it could be referred to as the "Type 0 family."

The probability density function for the normal family is

p left-parenthesis y right-parenthesis equals StartFraction 1 Over StartRoot 2 pi EndRoot sigma EndFraction exp left-bracket minus one-half left-parenthesis StartFraction y minus mu Over sigma EndFraction right-parenthesis squared right-bracket comma sigma greater-than 0

For normal distributions, StartRoot beta 1 EndRoot equals 0 and beta 2 equals 3.

Pearson Type I Family

Pearson Type I probability density functions are obtained as solutions to Pearson’s differential equation when the roots of c 0 plus c 1 y plus c 2 y squared equals 0 are real and have opposite signs.

The Type I family is composed of the beta distributions, whose probability density functions are of the form

p left-parenthesis y right-parenthesis equals StartFraction 1 Over upper B left-parenthesis alpha comma beta right-parenthesis EndFraction StartFraction left-parenthesis y minus a right-parenthesis Superscript alpha minus 1 Baseline left-parenthesis b minus y right-parenthesis Superscript beta minus 1 Baseline Over left-parenthesis b minus a right-parenthesis Superscript alpha plus beta minus 1 Baseline EndFraction comma a less-than-or-equal-to y less-than-or-equal-to b

where a is the location parameter, b minus a is the scale parameter, and alpha and beta are shape parameters (alpha greater-than 0 and beta greater-than 0). The range of the distribution is bounded below by a and above by b.

The standard form of the beta distribution is obtained by setting a equals 0 and b equals 1, and the standard beta density function is

p left-parenthesis y right-parenthesis equals StartFraction 1 Over upper B left-parenthesis alpha comma beta right-parenthesis EndFraction y Superscript alpha minus 1 Baseline left-parenthesis 1 minus y right-parenthesis Superscript beta minus 1 Baseline comma 0 less-than-or-equal-to y less-than-or-equal-to 1

Beta density functions come in a variety of shapes:

  • unimodal (bell-shaped) when alpha greater-than 1 and beta greater-than 1

  • unimodal and symmetric when alpha greater-than 1, beta greater-than 1, and alpha equals beta

  • rectangular when alpha equals beta equals 1 (uniform distributions)

  • bimodal (U-shaped) when alpha less-than 1 and beta less-than 1

  • U-shaped and symmetric when alpha less-than 1, beta less-than 1, and alpha equals beta

  • J-shaped or reverse J-shaped when left-parenthesis alpha minus 1 right-parenthesis left-parenthesis beta minus 1 right-parenthesis is not positive

For more information about beta distributions, see Chapter 25 of Johnson, Kotz, and Balakrishnan (1995).

Pearson Type II Family

The Pearson Type II family is a limiting form of the Type I family. It is composed of the symmetric beta distributions, which have identical shape parameters alpha equals beta, and its probability density functions are of the general form

p left-parenthesis y right-parenthesis equals StartFraction 1 Over upper B left-parenthesis alpha comma alpha right-parenthesis EndFraction StartFraction left-parenthesis y minus a right-parenthesis Superscript alpha minus 1 Baseline left-parenthesis b minus y right-parenthesis Superscript alpha minus 1 Baseline Over left-parenthesis b minus a right-parenthesis Superscript 2 alpha minus 1 Baseline EndFraction comma a less-than-or-equal-to y less-than-or-equal-to b

where a is the location parameter, b minus a is the scale parameter, and alpha greater-than 0. The range of the distribution is bounded below by a and above by b.

Setting a equals negative 1 and b equals 1 gives the particular form

p left-parenthesis y right-parenthesis equals StartFraction 1 Over upper B left-parenthesis alpha comma alpha right-parenthesis EndFraction StartFraction left-parenthesis 1 plus y right-parenthesis Superscript alpha minus 1 Baseline left-parenthesis 1 minus y right-parenthesis Superscript alpha minus 1 Baseline Over 2 Superscript 2 alpha minus 1 Baseline EndFraction comma negative 1 less-than-or-equal-to y less-than-or-equal-to 1

which can be rewritten as

p left-parenthesis y right-parenthesis equals StartFraction 1 Over upper B left-parenthesis alpha comma alpha right-parenthesis EndFraction StartFraction left-parenthesis 1 minus y squared right-parenthesis Superscript alpha minus 1 Baseline Over 2 Superscript 2 alpha minus 1 Baseline EndFraction comma negative 1 less-than-or-equal-to y less-than-or-equal-to 1

Some references present this as the standard form of the Type II density function.

For distributions in the Type II family, StartRoot beta 1 EndRoot equals 0 and beta 2 less-than 3. The uniform distribution is a special case of the Type II family.

Pearson Type III Family

The Pearson Type III family is composed of the gamma distributions, whose probability density functions are of the form

p left-parenthesis y right-parenthesis equals StartFraction left-bracket left-parenthesis y minus xi right-parenthesis slash lamda right-bracket Superscript alpha minus 1 Baseline exp left-bracket minus left-parenthesis y minus xi right-parenthesis slash lamda right-bracket Over lamda normal upper Gamma left-parenthesis alpha right-parenthesis EndFraction comma y greater-than xi

where xi is the location parameter, lamda is the scale parameter, and alpha is the shape parameter (alpha greater-than 0). The range of the distribution is bounded below by xi.

For distributions in the Type III family,

2 beta 2 minus 3 beta 1 minus 6 equals 0

The standard form of the gamma distribution is obtained by setting xi equals 0 and lamda equals 1:

p left-parenthesis y right-parenthesis equals StartFraction y Superscript alpha minus 1 Baseline exp left-parenthesis negative y right-parenthesis Over normal upper Gamma left-parenthesis alpha right-parenthesis EndFraction comma y greater-than 0

Gamma density functions come in a variety of shapes:

  • unimodal (bell-shaped) when alpha greater-than 1

  • reverse J-shaped and finite at y equals 0 when alpha equals 1 (exponential distributions)

  • reverse J-shaped and tending to infinity as y tends to 0

Within the gamma family, three subfamilies are particularly well-known by other names:

  • Gamma distributions where alpha equals 1 are referred to as exponential distributions and form the Pearson Type X family.

  • Gamma distributions for which alpha is an integer are referred to as Erlang distributions.

  • Standard gamma distributions where lamda equals 2 and alpha equals nu slash 2 for nu greater-than 0 are referred to as chi-square distributions with nu degrees of freedom.

For more information about gamma distributions, see Chapter 17 of Johnson, Kotz, and Balakrishnan (1994).

Pearson Type IV Family

Pearson Type IV probability density functions are obtained as solutions to Pearson’s differential equation when the roots of c 0 plus c 1 y plus c 2 y squared equals 0 are complex.

The Pearson Type IV family is composed of distributions whose probability density functions are of the form

p left-parenthesis y right-parenthesis equals upper K left-parenthesis 1 plus left-parenthesis StartFraction y minus xi Over lamda EndFraction right-parenthesis squared right-parenthesis Superscript negative m Baseline exp left-parenthesis minus nu tangent Superscript negative 1 Baseline left-parenthesis StartFraction y minus xi Over lamda EndFraction right-parenthesis right-parenthesis comma negative normal infinity less-than y less-than normal infinity

where xi is the location parameter, lamda is the scale parameter, m and nu are shape parameters (m greater-than 5 slash 2), and K is the constant of integration.

Elderton and Johnson (1969, pp. 58–66) explain how to compute K and the parameters given mu, mu 2, StartRoot beta 1 EndRoot, and beta 2. Johnson, Kotz, and Balakrishnan (1994, pp. 18–19) note that integrating the expression for p left-parenthesis y right-parenthesis to obtain the cumulative distribution function leads to intractable mathematics. The SIMSYSTEM procedure uses specialized numerical techniques to compute K, the distribution function, and the corresponding quantile function.

Type IV distributions are unimodal and bell-shaped. No common statistical distributions are of the Type IV form.

Pearson Type V Family

Pearson Type V probability density functions are obtained as solutions to Pearson’s differential equation when c 1 squared equals 4 c 0 c 2.

The Pearson Type V family includes the inverse gamma distributions, whose probability density functions are of the form

p left-parenthesis y right-parenthesis equals StartFraction lamda Superscript alpha Baseline Over normal upper Gamma left-parenthesis alpha right-parenthesis EndFraction left-parenthesis StartFraction y minus xi Over lamda EndFraction right-parenthesis Superscript negative alpha minus 1 Baseline exp left-parenthesis minus left-parenthesis StartFraction y minus xi Over lamda EndFraction right-parenthesis Superscript negative 1 Baseline right-parenthesis comma y greater-than xi

where xi is the location parameter, lamda is the scale parameter (lamda greater-than 0), and alpha is the shape parameter (alpha greater-than 0). Inverse gamma densities are unimodal and either bell-shaped or skewed.

The Type V family is a transition family; its values of skewness and kurtosis lie on a curve in the left-parenthesis StartRoot beta 1 EndRoot comma beta 2 right-parenthesis plane that separates the regions of the Type IV and Type VI families. The equation for this curve is

beta 1 left-parenthesis beta 2 plus 3 right-parenthesis squared equals 4 left-parenthesis 4 beta 2 minus 3 beta 1 right-parenthesis left-parenthesis 2 beta 2 minus 3 beta 1 minus 6 right-parenthesis

Pearson Type VI Family

Pearson Type VI probability density functions are obtained as solutions to Pearson’s differential equation when the roots of c 0 plus c 1 y plus c 2 y squared equals 0 are real and have the same sign. If the roots a 1 and a 2 are both negative and a 1 less-than a 2 less-than 0, then the densities have the general form

p left-parenthesis y right-parenthesis equals upper K left-parenthesis y minus a 1 right-parenthesis Superscript m 1 Baseline left-parenthesis y minus a 2 right-parenthesis Superscript m 2

where K is a constant of integration, m 2 less-than negative 1, and m 1 plus m 2 less-than 0. For more information, see Johnson, Kotz, and Balakrishnan (1994, chap. 12).

Pearson Type VI probability density functions can be expressed as

p left-parenthesis y right-parenthesis equals StartFraction 1 Over upper B left-parenthesis nu 1 slash 2 comma nu 2 slash 2 right-parenthesis EndFraction StartFraction left-parenthesis StartFraction y minus xi Over lamda EndFraction right-parenthesis Superscript left-parenthesis nu 1 slash 2 right-parenthesis minus 1 Baseline Over left-parenthesis 1 plus StartFraction y minus xi Over lamda EndFraction right-parenthesis Superscript left-parenthesis nu 1 plus nu 2 right-parenthesis slash 2 Baseline EndFraction comma y greater-than xi

where xi is the location parameter, lamda is the scale parameter (lamda greater-than 0), and nu 1 and nu 2 are shape parameters (nu 1 greater-than 0, nu 2 greater-than 0). For xi equals 0 and lamda equals 1, this reduces to the standard form

p Subscript upper G Baseline left-parenthesis y right-parenthesis equals StartFraction 1 Over upper B left-parenthesis nu 1 slash 2 comma nu 2 slash 2 right-parenthesis EndFraction StartFraction y Superscript left-parenthesis nu 1 slash 2 right-parenthesis minus 1 Baseline Over 1 plus y Superscript left-parenthesis nu 1 plus nu 2 right-parenthesis slash 2 Baseline EndFraction comma y greater-than 0

which is the density function of upper G equals upper X 1 slash upper X 2, the ratio of two independent variables upper X 1 and upper X 2 with chi-square distributions whose degrees of freedom are nu 1 and nu 2, respectively (Johnson, Kotz, and Balakrishnan 1995, chap. 27). Pearson Type VI distributions are also known as beta distributions of the second kind (Johnson, Kotz, and Balakrishnan 1995, chap. 25).

Pearson Type VI distributions are closely related to F distributions (Johnson, Kotz, and Balakrishnan 1995, chap. 27). The ratio

upper F equals StartFraction upper X 1 slash nu 1 Over upper X 2 slash nu 2 EndFraction

has the F distribution with degrees of freedom nu 1 and nu 2. The density function of F is

p Subscript upper F Baseline left-parenthesis y right-parenthesis equals StartFraction left-parenthesis nu 1 slash nu 2 right-parenthesis Superscript nu 1 slash 2 Baseline Over upper B left-parenthesis nu 1 slash 2 comma nu 2 slash 2 right-parenthesis EndFraction StartFraction y Superscript left-parenthesis nu 1 slash 2 right-parenthesis minus 1 Baseline Over left-parenthesis 1 plus nu 1 y slash nu 2 right-parenthesis Superscript left-parenthesis nu 1 plus nu 2 right-parenthesis slash 2 Baseline EndFraction comma y greater-than 0

Pearson Type VII Family

Pearson Type VII probability density functions are obtained as solutions to Pearson’s differential equation when c 1 equals a equals 0, c 0 greater-than 0, and c 2 greater-than 0.

Pearson Type VII densities have the general form

p left-parenthesis y right-parenthesis equals upper K left-parenthesis c 0 plus c 2 y squared right-parenthesis Superscript negative 1 slash left-parenthesis 2 c 2 right-parenthesis

where K is a constant of integration.

For distributions in the Type VII family, StartRoot beta 1 EndRoot equals 0 and beta 2 greater-than 3.

Pearson Type VII distributions are closely related to Student’s t distributions, which have the form

p Subscript t Sub Subscript nu Baseline left-parenthesis y right-parenthesis equals StartFraction normal upper Gamma left-parenthesis left-parenthesis nu plus 1 right-parenthesis slash 2 right-parenthesis Over normal upper Gamma left-parenthesis nu slash 2 right-parenthesis EndFraction left-parenthesis 1 plus StartFraction y squared right-parenthesis Over 2 EndFraction right-parenthesis Superscript minus left-parenthesis nu plus 1 right-parenthesis slash 2 Baseline y greater-than 0

Note that nu must be positive but does not need to be an integer. The t distributions have skewness StartRoot beta 1 EndRoot equals 0 and kurtosis beta 2 equals 3 left-parenthesis nu minus 2 right-parenthesis slash left-parenthesis nu minus 4 right-parenthesis, which exist if nu greater-than 4. For more information about the t family, see Johnson, Kotz, and Balakrishnan (1995, chap. 28) .

Parameter Values for Pearson Distributions

The purpose of this subsection is to explain how parameter values that the SIMSYSTEM procedure computes for the well-known distributions that underlie most of the Pearson system are related to the parameters used by the other functions in SAS to work with these distributions. These distributions are special cases of the Pearson system, and they are identified in the parameters table when the combination of skewness and kurtosis specified matches the theoretical skewness and kurtosis for these cases. The tables that are provided are helpful for understanding what the procedure is computing in each particular case, and they are also helpful if you want to reuse parameter values from the procedure to compute your own simulations in DATA step code by using the RAND function.

Table 2 summarizes the Pearson types, their corresponding standard distributions, and the mathematical form of the density for these standard distributions in terms of the parameters displayed in the "Parameters for Pearson Distributions" table. In Table 2, normal upper Gamma left-parenthesis alpha right-parenthesis denotes the gamma function, and upper B left-parenthesis alpha comma beta right-parenthesis equals normal upper Gamma left-parenthesis alpha right-parenthesis normal upper Gamma left-parenthesis beta right-parenthesis slash normal upper Gamma left-parenthesis alpha plus beta right-parenthesis denotes the beta function. The one exception is Type IV, which is essentially a skewed version of Student’s t distribution. There is no closed form for the constant C in the Type IV density; internally, it is computed by using specialized methods.

Table 2: Pearson Distributions for y equals left-parenthesis x minus xi right-parenthesis slash lamda

Type Standard Distribution Probability Density Function Constant C
Type I Beta(alpha,beta) upper C y Superscript alpha minus 1 Baseline left-parenthesis 1 minus y right-parenthesis Superscript beta minus 1 1 slash upper B left-parenthesis alpha comma beta right-parenthesis
Type II Beta(alpha,alpha) upper C y Superscript alpha minus 1 Baseline left-parenthesis 1 minus y right-parenthesis Superscript alpha minus 1 1 slash upper B left-parenthesis alpha comma alpha right-parenthesis
Type III Gamma(alpha) upper C y Superscript alpha minus 1 Baseline exp left-parenthesis negative y right-parenthesis 1 slash normal upper Gamma left-parenthesis alpha right-parenthesis
Type IV upper C left-parenthesis 1 plus y squared right-parenthesis Superscript negative m Baseline exp left-parenthesis minus alpha tangent Superscript negative 1 Baseline left-parenthesis y right-parenthesis right-parenthesis No closed form
Type V Inverse gamma(alpha) upper C left-parenthesis 1 slash y right-parenthesis Superscript alpha plus 1 Baseline exp left-parenthesis negative 1 slash y right-parenthesis 1 slash normal upper Gamma left-parenthesis alpha right-parenthesis
Type VI upper F Subscript d 1 comma d 2 upper C y Superscript d 1 slash 2 minus 1 Baseline left-parenthesis d 2 plus d 1 y right-parenthesis Superscript minus left-parenthesis d 1 plus d 2 right-parenthesis slash 2 d 1 Superscript d 1 slash 2 Baseline d 2 Superscript d 2 slash 2 Baseline slash upper B left-parenthesis d 1 slash 2 comma d 2 slash 2 right-parenthesis right-parenthesis
Type VII Student’s t Subscript d upper C left-parenthesis 1 plus y squared slash d right-parenthesis Superscript left-parenthesis d plus 1 right-parenthesis slash 2 StartRoot d EndRoot upper B left-parenthesis d slash 2 comma 1 slash 2 right-parenthesis


The precise numeric values of these parameters are available as hidden columns named Shap1Val and Shap2Val in the underlying ODS object for this table. For illustration, Table 3 shows DATA step code that is equivalent to how PROC SIMSYSTEM generates random variates for these distributions, after it determines the appropriate values of these shape parameters.

Table 3: Pearson Sampling for y equals left-parenthesis x minus xi right-parenthesis slash lamda

Type Standard Distribution Standard Random Variate
Type I Beta(alpha,beta) rand(’beta’,Shap1Val,Shap2Val)
Type II Beta(alpha,alpha) rand(’beta’,Shap1Val,Shap1Val)
Type III Gamma(alpha) rand(’gamma’,Shap1Val)
Type IV
Type V Inverse gamma(alpha) 1/rand(’gamma’,Shap1Val)
Type VI upper F Subscript d 1 comma d 2 rand(’f’,Shap1Val,Shap2Val)
Type VII Student’s t Subscript d rand(’t’,Shap1Val)


Again, the standard random variate for the Type IV distribution is blank because there is no standard distribution that corresponds to this type.

In order to achieve the specified mean and standard deviation, the argument for these standard distributions is further shifted by a value xi and scaled by a value lamda; these values are displayed as the Shift and Scale columns in the "Parameters for Pearson Distributions" table. If the specified value of skewness is negative, then internally, the procedure solves for a distribution that has a mean and skewness of the opposite sign, and it adjusts the sign of xi and lamda values to produce a distribution that has the specified moments.

The manner in which the distributions in the Pearson system partition the space of possible skewness/kurtosis values is shown in Figure 10.

Figure 10: Pearson Distributions

Pearson Distributions


Last updated: September 13, 2022