The GLIMMIX Procedure

Exploring and Comparing Covariance Matrices

If you use an empirical (sandwich) estimator with the EMPIRICAL= option in the PROC GLIMMIX statement, the procedure replaces the model-based estimator of the covariance of the fixed effects with the sandwich estimator. This affects aspects of inference, such as prediction standard errors, tests of fixed effects, estimates, contrasts, and so forth. Similarly, if you choose the DDFM=KENWARDROGER degrees-of-freedom method in the MODEL statement, PROC GLIMMIX adjusts the model-based covariance matrix of the fixed effects according to Kenward and Roger (1997) or according to Kackar and Harville (1984) and Harville and Jeske (1992).

In this situation, the COVB(DETAILS) option in the MODEL statement has two effects. The GLIMMIX procedure displays the (adjusted) covariance matrix of the fixed effects and the model-based covariance matrix (the ODS name of the table with the model-based covariance matrix is CovBModelBased). The procedure also displays a table of statistics for the unadjusted and adjusted covariance matrix and for their comparison. The ODS name of this table is CovBDetails.

If the model-based covariance matrix is not replaced with an adjusted estimator, the COVB(DETAILS) option displays the model-based covariance matrix and provides diagnostic measures for it in the CovBDetails table.

The table generated by the COVB(DETAILS) option consists of several sections. See Example 52.8 for an application.

The trace and log determinant of covariance matrices are general scalar summaries that are sometimes used in direct comparisons, or in formulating other statistics, such as the difference of log determinants. The trace simply represents the sum of the variances of all fixed-effects parameters. If a matrix is indefinite, the determinant is reported instead of the log determinant.

The model-based and adjusted covariance matrices should have the same general makeup of eigenvalues. There should not be any negative eigenvalues, and they should have the same numbers of positive and zero eigenvalues. A reduction in rank due to the adjustment is troublesome for aspects of inference. Negative eigenvalues are listed in the table only if they occur, because a covariance matrix should be at least positive semi-definite. However, the GLIMMIX procedure examines the model-based and adjusted covariance matrix for negative eigenvalues. The condition numbers reported by PROC GLIMMIX for positive (semi-)definite matrices are computed as the ratio of the largest and smallest nonzero eigenvalue. A large condition number reflects poor conditioning of the matrix.

Matrix norms are extensions of the concept of vector norms to measure the "length" of a matrix. The Frobenius norm of an left-parenthesis n times m right-parenthesis matrix bold upper A is the direct equivalent of the Euclidean vector norm, the square root of the sum of the squared elements,

StartAbsoluteValue EndAbsoluteValue bold upper A StartAbsoluteValue EndAbsoluteValue Subscript upper F Baseline equals StartRoot sigma-summation Underscript i equals 1 Overscript n Endscripts sigma-summation Underscript j equals 1 Overscript n Endscripts a Subscript i j Superscript 2 Baseline EndRoot

The normal infinity- and 1-norms of matrix bold upper A are the maximum absolute row and column sums, respectively:

StartLayout 1st Row 1st Column StartAbsoluteValue EndAbsoluteValue bold upper A StartAbsoluteValue EndAbsoluteValue Subscript normal infinity 2nd Column equals max left-brace sigma-summation Underscript j equals 1 Overscript m Endscripts StartAbsoluteValue a Subscript i j Baseline EndAbsoluteValue colon i equals 1 comma ellipsis comma n right-brace 2nd Row 1st Column StartAbsoluteValue EndAbsoluteValue bold upper A StartAbsoluteValue EndAbsoluteValue Subscript 1 2nd Column equals max left-brace sigma-summation Underscript i equals 1 Overscript n Endscripts StartAbsoluteValue a Subscript i j Baseline EndAbsoluteValue colon j equals 1 comma ellipsis comma m right-brace EndLayout

These two norms are identical for symmetric matrices.

The "Comparison" section of the CovBDetails table provides several statistics that set the matrices in relationship. The concordance correlation reported by the GLIMMIX procedure is a standardized measure of the closeness of the model-based and adjusted covariance matrix. It is a slight modification of the covariance concordance correlation in Vonesh, Chinchilli, and Pu (1996) and Vonesh and Chinchilli (1997, Ch. 8.3). Denote as bold upper Omega the left-parenthesis p times p right-parenthesis model-based covariance matrix and as bold upper Omega Subscript a the adjusted matrix. Suppose that bold upper K is the matrix obtained from the identity matrix of size p by replacing diagonal elements corresponding to singular rows in bold upper Omega with zeros. The lower triangular portion of bold upper Omega Superscript negative 1 slash 2 Baseline bold upper Omega Subscript a Baseline bold upper Omega Superscript negative 1 slash 2 is stored in vector bold-italic omega and the lower triangular portion of bold upper K is stored in vector bold k. The matrix bold upper Omega Superscript negative 1 slash 2 is constructed from an eigenanalysis of bold upper Omega and is symmetric. The covariance concordance correlation is then

r left-parenthesis bold-italic omega right-parenthesis equals 1 minus StartFraction StartAbsoluteValue EndAbsoluteValue bold-italic omega minus bold k StartAbsoluteValue EndAbsoluteValue squared Over StartAbsoluteValue EndAbsoluteValue bold-italic omega StartAbsoluteValue EndAbsoluteValue squared plus StartAbsoluteValue EndAbsoluteValue bold k StartAbsoluteValue EndAbsoluteValue squared EndFraction

This measure is 1 if bold upper Omega = bold upper Omega Subscript a. If bold-italic omega is orthogonal to bold k, there is total disagreement between the model-based and the adjusted covariance matrix and r left-parenthesis bold-italic omega right-parenthesis is zero.

The discrepancy function reported by PROC GLIMMIX is computed as

d equals log left-brace StartAbsoluteValue bold upper Omega EndAbsoluteValue right-brace minus log left-brace StartAbsoluteValue bold upper Omega Subscript a Baseline EndAbsoluteValue right-brace plus normal t normal r normal a normal c normal e StartSet bold upper Omega Subscript a Baseline bold upper Omega Superscript minus Baseline EndSet minus normal r normal a normal n normal k StartSet bold upper Omega EndSet

In diagnosing departures between an assumed covariance structure and normal upper V normal a normal r left-bracket bold upper Y right-bracket—using an empirical estimator—Vonesh, Chinchilli, and Pu (1996) find that the concordance correlation is useful in detecting gross departures and propose lamda equals n Subscript s Baseline d to test the correctness of the assumed model, where n Subscript s denotes the number of subjects.

Last updated: December 09, 2022