The Four Types of Estimable Functions

Type I SS and Estimable Functions

In PROC GLM, the Type I SS and the associated hypotheses they test are byproducts of the modified sweep operator used to compute a generalized g 2-inverse of bold upper X prime bold upper X and a solution to the normal equations. For the model normal upper E left-bracket upper Y right-bracket equals x 1 beta 1 plus x 2 beta 2 plus x 3 beta 3, the Type I SS for each effect are as follows:

Effect Type I SS
x 1 upper R left-parenthesis beta 1 right-parenthesis
x 2 upper R left-parenthesis beta 2 vertical-bar beta 1 right-parenthesis
x 3 upper R left-parenthesis beta 3 vertical-bar beta 1 comma beta 2 right-parenthesis

Note that some other SAS/STAT procedures compute Type I hypotheses by sweeping bold upper X prime bold upper X (for example, PROC MIXED and PROC GLIMMIX), but their test statistics are not necessarily equivalent to the results of using those procedures to fit models that contain successively more effects.

The Type I SS are model-order dependent; each effect is adjusted only for the preceding effects in the model.

There are numerous ways to obtain a Type I hypothesis matrix bold upper L for each effect. One way is to form the bold upper X prime bold upper X matrix and then reduce bold upper X prime bold upper X to an upper triangular matrix by row operations, skipping over any rows with a zero diagonal. The nonzero rows of the resulting matrix associated with x 1 provide an bold upper L such that

SS left-parenthesis upper H 0 colon bold upper L bold-italic beta equals bold 0 right-parenthesis equals upper R left-parenthesis beta 1 right-parenthesis

The nonzero rows of the resulting matrix associated with x 2 provide an bold upper L such that

SS left-parenthesis upper H 0 colon bold upper L bold-italic beta equals bold 0 right-parenthesis equals upper R left-parenthesis beta 2 vertical-bar beta 1 right-parenthesis

The last set of nonzero rows (associated with x 3) provide an bold upper L such that

SS left-parenthesis upper H 0 colon bold upper L bold-italic beta equals bold 0 right-parenthesis equals upper R left-parenthesis beta 3 vertical-bar beta 1 comma beta 2 right-parenthesis

Another more formalized representation of Type I generating sets for x 1, x 2, and x 3, respectively, is

StartLayout 1st Row 1st Column bold upper G 1 2nd Column equals 3rd Column left-parenthesis 4th Column bold upper X prime 1 bold upper X 1 5th Column vertical-bar 6th Column bold upper X prime 1 bold upper X 2 7th Column vertical-bar 8th Column bold upper X prime 1 bold upper X 3 9th Column right-parenthesis 2nd Row 1st Column bold upper G 2 2nd Column equals 3rd Column left-parenthesis 4th Column 0 5th Column vertical-bar 6th Column bold upper X prime 2 bold upper M 1 bold upper X 2 7th Column vertical-bar 8th Column bold upper X prime 2 bold upper M 1 bold upper X 3 9th Column right-parenthesis 3rd Row 1st Column bold upper G 3 2nd Column equals 3rd Column left-parenthesis 4th Column 0 5th Column vertical-bar 6th Column 0 7th Column vertical-bar 8th Column bold upper X prime 3 bold upper M 2 bold upper X 3 9th Column right-parenthesis EndLayout

where

bold upper M 1 equals bold upper I minus bold upper X 1 left-parenthesis bold upper X prime 1 bold upper X 1 right-parenthesis Superscript minus Baseline bold upper X prime 1

and

bold upper M 2 equals bold upper M 1 minus bold upper M 1 bold upper X 2 left-parenthesis bold upper X prime 2 bold upper M 1 bold upper X 2 right-parenthesis Superscript minus Baseline bold upper X prime 2 bold upper M 1

Using the Type I generating set bold upper G 2 (for example), if an bold upper L is formed from linear combinations of the rows of bold upper G 2 such that bold upper L is of full row rank and of the same row rank as bold upper G 2, then SSleft-parenthesis upper H 0 colon bold upper L bold-italic beta equals bold 0 right-parenthesis equals upper R left-parenthesis beta 2 vertical-bar beta 1 right-parenthesis.

In the GLM procedure, the Type I estimable functions displayed symbolically when the E1 option is requested are

StartLayout 1st Row 1st Column bold upper G 1 Superscript asterisk 2nd Column equals 3rd Column left-parenthesis bold upper X prime 1 bold upper X 1 right-parenthesis Superscript minus Baseline bold upper G 1 2nd Row 1st Column bold upper G 2 Superscript asterisk 2nd Column equals 3rd Column left-parenthesis bold upper X prime 2 bold upper M 1 bold upper X 2 right-parenthesis Superscript minus Baseline bold upper G 2 3rd Row 1st Column bold upper G 3 Superscript asterisk 2nd Column equals 3rd Column left-parenthesis bold upper X prime 3 bold upper M 2 bold upper X 3 right-parenthesis Superscript minus Baseline bold upper G 3 EndLayout

As can be seen from the nature of the generating sets bold upper G 1, bold upper G 2, and bold upper G 3, only the Type I estimable functions for beta 3 are guaranteed not to involve the beta 1 and beta 2 parameters. The Type I hypothesis for beta 2 can (and often does) involve beta 3 parameters, and likewise the Type I hypothesis for beta 1 often involves beta 2 and beta 3 parameters.

There are, however, a number of models for which the Type I hypotheses are considered appropriate. These are as follows:

  • balanced ANOVA models specified in proper sequence (that is, interactions do not precede main effects in the MODEL statement and so forth)

  • purely nested models (specified in the proper sequence)

  • polynomial regression models (in the proper sequence)

Last updated: December 09, 2022