The BGLIMM Procedure

Notation for the Generalized Linear Mixed Model

This section introduces the mathematical notation that the chapter uses to describe the generalized linear mixed model. For a description of the statistical details and sampling algorithms, see the section Details: BGLIMM Procedure.

First consider the simple normal linear model. The quantity of primary interest, y Subscript i, is called the response or outcome variable for the ith individual. The variable bold x Subscript i is the 1 times p covariate vector for the fixed effects. The distribution of y Subscript i given bold x Subscript i is normal with a mean that is a linear function of bold x Subscript i,

StartLayout 1st Row 1st Column y Subscript i Baseline equals 2nd Column bold x Subscript i Baseline bold-italic beta plus epsilon Subscript i Baseline comma i equals 1 comma ellipsis comma upper I 2nd Row 1st Column epsilon Subscript i Baseline tilde 2nd Column upper N left-parenthesis bold 0 comma sigma squared right-parenthesis EndLayout

where bold-italic beta is a p times 1 vector of regression coefficients (also known as fixed effects) and epsilon Subscript i is the noise with a variance sigma squared.

The normal linear model can be expanded to include random effects, and the model becomes a normal linear mixed model,

StartLayout 1st Row 1st Column y Subscript i Baseline equals 2nd Column bold x Subscript i Baseline bold-italic beta plus bold z Subscript i Baseline bold-italic gamma Subscript i plus epsilon Subscript i 2nd Row 1st Column bold-italic gamma Subscript i Baseline tilde 2nd Column upper N left-parenthesis bold 0 comma bold upper G Subscript i Baseline right-parenthesis 3rd Row 1st Column epsilon Subscript i Baseline tilde 2nd Column upper N left-parenthesis 0 comma sigma squared right-parenthesis EndLayout

where bold-italic gamma Subscript i is a q times 1 vector of random effects, bold z Subscript i is a 1 times q matrix of covariates for the bold-italic gamma Subscript i, and bold upper G Subscript i is the covariance matrix of the random effects bold-italic gamma Subscript i (bold upper G is a block diagonal matrix where each block is bold upper G Subscript i).

When an individual i has n Subscript i repeated measurements, the random-effects model for outcome vector bold y Subscript i is given by

bold y Subscript i Baseline equals bold upper X Subscript i Baseline bold-italic beta plus bold upper Z Subscript i Baseline bold-italic gamma Subscript i Baseline plus bold-italic epsilon Subscript i Baseline comma i equals 1 comma ellipsis comma upper I

where bold y Subscript i is n Subscript i Baseline times 1, bold upper X Subscript i is an n Subscript i Baseline times p matrix of fixed covariates, bold-italic beta is a p times 1 vector of regression coefficients (also known as fixed effects), bold-italic gamma Subscript i is a q times 1 vector of random effects, bold upper Z Subscript i is an n Subscript i Baseline times q matrix of covariates for the bold-italic gamma Subscript i, and bold-italic epsilon Subscript i is an n Subscript i Baseline times 1 vector of random errors.

It is further assumed that

StartLayout 1st Row 1st Column bold-italic gamma Subscript i Baseline tilde 2nd Column upper N left-parenthesis bold 0 comma bold upper G Subscript i Baseline right-parenthesis 2nd Row 1st Column bold-italic epsilon Subscript i Baseline tilde 2nd Column upper N left-parenthesis bold 0 comma bold upper R Subscript i Baseline right-parenthesis EndLayout

where bold upper G Subscript i is the covariance matrix of bold-italic gamma Subscript i (bold upper G is a block diagonal matrix where each block is bold upper G Subscript i) and bold upper R Subscript i is the covariance matrix of the residual errors for the ith subject (bold upper R is a block diagonal matrix where each block is bold upper R Subscript i).

There are cases where the relationship between the design matrix (bold upper X and bold upper Z) and the expectation of the response is not linear, or where the distribution for the response is far from normal, even after transformation of the data. The class of generalized linear mixed models unifies the approaches that you need in order to analyze data in those cases. Let bold y be the collection of all bold y Subscript i; and let bold upper X and bold upper Z be the collection of all bold upper X Subscript i and bold upper Z Subscript i, respectively. A generalized linear mixed model consists of the following:

  • the linear predictor bold-italic eta equals bold upper X bold-italic beta plus bold upper Z bold-italic gamma

  • the link function g left-parenthesis dot right-parenthesis that relates the linear predictor to the mean of the outcome via a monotone link function,

    normal upper E left-bracket upper Y vertical-bar bold-italic beta comma bold-italic gamma right-bracket equals g Superscript negative 1 Baseline left-parenthesis bold-italic eta right-parenthesis equals g Superscript negative 1 Baseline left-parenthesis bold upper X bold-italic beta plus bold upper Z bold-italic gamma right-parenthesis

    where g left-parenthesis dot right-parenthesis is a differentiable monotone link function and g Superscript negative 1 Baseline left-parenthesis dot right-parenthesis is its inverse

  • a response distribution in the exponential family of distributions. The distribution can also depend on a scale parameter, phi.

The conditional distribution of the response variable, given bold-italic gamma, is a member of the exponential family of distributions, including the normal distribution. You specify the distribution by using the DIST= option in the MODEL statement and specify the link function g left-parenthesis dot right-parenthesis by using the LINK= option.

The BGLIMM procedure distinguishes two types of covariance structure: the "G-side" and the "R-side." The G-side matrix is the covariance matrix of the random effects; the R-side matrix is the covariance matrix of the residuals. Models without G-side effects are also known as marginal (or population-averaged) models.

The columns of bold upper X are constructed from effects that are listed on the right side in the MODEL statement. Columns of bold upper Z and the G-side covariance matrix bold upper G are constructed from the RANDOM statement. The R-side covariance matrix bold upper R is constructed from the REPEATED statement, or from the RANDOM statement with the RESIDUAL option.

By default, the bold upper R matrix is the scaled identity matrix, bold upper R equals phi bold upper I. The scale parameter phi is set to 1 if the distribution does not have a scale parameter, such as in the case of the binary, binomial, Poisson, and exponential distributions.

For the normal distribution, for which you can specify various types of covariance structure for bold upper R, use the REPEATED statement. For example, to specify that the Time effect for each patient is an R-side effect with a first-order autoregressive covariance structure, use the following statement:

repeated Time / type=ar(1) subject=Patient;

Unknown quantities subject to estimation are the fixed-effects parameter vector bold-italic beta, the random-effects parameter bold-italic gamma, and the covariance parameters that constitute all unknowns in bold upper G and bold upper R.

Last updated: December 09, 2022