The REG Procedure

Model Fit and Diagnostic Statistics

This section gathers the formulas for the statistics available in the MODEL, PLOT, and OUTPUT statements. The model to be fit is bold upper Y equals bold upper X bold-italic beta plus bold-italic epsilon, and the parameter estimate is denoted by bold b equals left-parenthesis bold upper X prime bold upper X bold right-parenthesis Superscript bold minus Baseline bold upper X prime bold upper Y. The subscript i denotes values for the ith observation, the parenthetical subscript left-parenthesis i right-parenthesis means that the statistic is computed by using all observations except the ith observation, and the subscript jj indicates the jth diagonal matrix entry. The ALPHA= option in the PROC REG or MODEL statement is used to set the alpha value for the t statistics.

Table 7 contains the summary statistics for assessing the fit of the model.

Table 7: Formulas and Definitions for Model Fit Summary Statistics

Model Option or Statistic Definition or Formula
n The number of observations
p The number of parameters including the intercept
i 1 if there is an intercept, 0 otherwise
ModifyingAbove sigma With caret squared The estimate of pure error variance from the SIGMA=
option or from fitting the full model
SST Subscript 0 The uncorrected total sum of squares for the dependent
variable
SST Subscript 1 The total sum of squares corrected for the mean for the
dependent variable
SSE The error sum of squares
MSE StartFraction SSE Over n minus p EndFraction
upper R squared 1 minus StartFraction SSE Over SST Subscript i Baseline EndFraction
ADJRSQ 1 minus StartFraction left-parenthesis n minus i right-parenthesis left-parenthesis 1 minus upper R squared right-parenthesis Over n minus p EndFraction
AIC n ln left-parenthesis StartFraction SSE Over n EndFraction right-parenthesis plus 2 p
BIC n ln left-parenthesis StartFraction SSE Over n EndFraction right-parenthesis plus 2 left-parenthesis p plus 2 right-parenthesis q minus 2 q squared where q equals StartFraction n ModifyingAbove sigma With caret squared Over SSE EndFraction
CP left-parenthesis upper C Subscript p Baseline right-parenthesis StartFraction SSE Over ModifyingAbove sigma With caret squared EndFraction plus 2 p minus n
GMSEP StartFraction MSE left-parenthesis n plus 1 right-parenthesis left-parenthesis n minus 2 right-parenthesis Over n left-parenthesis n minus p minus 1 right-parenthesis EndFraction equals StartFraction 1 Over n EndFraction upper S Subscript p Baseline left-parenthesis n plus 1 right-parenthesis left-parenthesis n minus 2 right-parenthesis
JP left-parenthesis upper J Subscript p Baseline right-parenthesis StartFraction n plus p Over n EndFraction MSE
PC StartFraction n plus p Over n minus p EndFraction left-parenthesis 1 minus upper R squared right-parenthesis equals upper J Subscript p Baseline left-parenthesis StartFraction n Over SST Subscript i Baseline EndFraction right-parenthesis
PRESS The sum of squares of predr Subscript i (see Table 8)
RMSE StartRoot MSE EndRoot
SBC n ln left-parenthesis StartFraction SSE Over n EndFraction right-parenthesis plus p ln left-parenthesis n right-parenthesis
SP left-parenthesis upper S Subscript p Baseline right-parenthesis StartFraction MSE Over n minus p minus 1 EndFraction


Table 8 contains the diagnostic statistics and their formulas; these formulas and further information can be found in ChapterĀ 4, Introduction to Regression Procedures, and in the section Influence Statistics. Each statistic is computed for each observation.

Table 8: Formulas and Definitions for Diagnostic Statistics

MODEL Option or Statistic Formula
PRED (ModifyingAbove bold upper Y With caret Subscript i) bold upper X Subscript i Baseline bold b
RES (r Subscript i) bold upper Y Subscript i Baseline minus ModifyingAbove bold upper Y With caret Subscript i
H (h Subscript i) bold x Subscript i Baseline left-parenthesis bold upper X prime bold upper X right-parenthesis Superscript minus Baseline bold x prime Subscript i
STDP StartRoot h Subscript i Baseline ModifyingAbove sigma With caret squared EndRoot
STDI StartRoot left-parenthesis 1 plus h Subscript i Baseline right-parenthesis ModifyingAbove sigma With caret squared EndRoot
STDR StartRoot left-parenthesis 1 minus h Subscript i Baseline right-parenthesis ModifyingAbove sigma With caret squared EndRoot
LCL ModifyingAbove upper Y With caret Subscript i Baseline minus t Subscript StartFraction alpha Over 2 EndFractionSTDI
LCLM ModifyingAbove upper Y With caret Subscript i Baseline minus t Subscript StartFraction alpha Over 2 EndFractionSTDP
UCL ModifyingAbove upper Y With caret Subscript i Baseline plus t Subscript StartFraction alpha Over 2 EndFractionSTDI
UCLM ModifyingAbove upper Y With caret Subscript i Baseline plus t Subscript StartFraction alpha Over 2 EndFractionSTDP
STUDENT StartFraction r Subscript i Baseline Over STDR Subscript i Baseline EndFraction
RSTUDENT StartFraction r Subscript i Baseline Over ModifyingAbove sigma With caret Subscript left-parenthesis i right-parenthesis Baseline StartRoot 1 minus h Subscript i Baseline EndRoot EndFraction
COOKD StartFraction 1 Over p EndFraction STUDENT squared StartFraction STDP squared Over STDR squared EndFraction
COVRATIO StartFraction det left-parenthesis ModifyingAbove sigma With caret squared Subscript left-parenthesis i right-parenthesis Baseline left-parenthesis bold x prime Subscript left-parenthesis i right-parenthesis Baseline bold x Subscript left-parenthesis i right-parenthesis Baseline right-parenthesis Superscript negative 1 Baseline Over det left-parenthesis ModifyingAbove sigma With caret squared left-parenthesis bold upper X prime bold upper X right-parenthesis Superscript negative 1 Baseline right-parenthesis EndFraction
DFFITS StartFraction left-parenthesis ModifyingAbove bold upper Y With caret Subscript i Baseline minus ModifyingAbove bold upper Y With caret Subscript left-parenthesis i right-parenthesis Baseline right-parenthesis Over left-parenthesis ModifyingAbove sigma With caret Subscript left-parenthesis i right-parenthesis Baseline StartRoot h Subscript i Baseline EndRoot right-parenthesis EndFraction
DFBETASSubscript j StartFraction bold b Subscript j Baseline minus bold b Subscript left-parenthesis i right-parenthesis j Baseline Over ModifyingAbove sigma With caret Subscript left-parenthesis i right-parenthesis Baseline StartRoot left-parenthesis bold upper X prime bold upper X right-parenthesis Subscript j j Baseline EndRoot EndFraction
PRESS(predr Subscript i) StartFraction r Subscript i Baseline Over 1 minus h Subscript i Baseline EndFraction


Last updated: December 09, 2022