The PHREG Procedure

Example 86.2 Best Subset Selection

(View the complete code for this example.)

An alternative to stepwise selection of variables is best subset selection. This method uses the branch-and-bound algorithm of Furnival and Wilson (1974) to find a specified number of best models containing one, two, or three variables, and so on, up to the single model containing all of the explanatory variables. The criterion used to determine the "best" subset is based on the global score chi-square statistic. For two models A and B, each having the same number of explanatory variables, model A is considered to be better than model B if the global score chi-square statistic for A exceeds that for B.

In the following statements, best subset selection analysis is requested by specifying the SELECTION=SCORE option in the MODEL statement. The BEST=3 option requests the procedure to identify only the three best models for each size. In other words, PROC PHREG will list the three models having the highest score statistics of all the models possible for a given number of covariates.

proc phreg data=Myeloma;
   model Time*VStatus(0)=LogBUN HGB Platelet Age LogWBC
                         Frac LogPBM Protein SCalc
                         / selection=score best=3;
run;

Output 86.2.1 displays the results of this analysis. The number of explanatory variables in the model is given in the first column, and the names of the variables are listed on the right. The models are listed in descending order of their score chi-square values within each model size. For example, among all models containing two explanatory variables, the model that contains the variables LogBUN and HGB has the largest score value (12.7252), the model that contains the variables LogBUN and Platelet has the second-largest score value (11.1842), and the model that contains the variables LogBUN and SCalc has the third-largest score value (9.9962).

Output 86.2.1: Best Variable Combinations

The PHREG Procedure

Regression Models Selected by Score Criterion
Number of
Variables
Score
Chi-Square
Variables Included in Model
18.5164LogBUN
15.0664HGB
13.1816Platelet
212.7252LogBUN HGB
211.1842LogBUN Platelet
29.9962LogBUN SCalc
315.3053LogBUN HGB SCalc
313.9911LogBUN HGB Age
313.5788LogBUN HGB Frac
416.9873LogBUN HGB Age SCalc
416.0457LogBUN HGB Frac SCalc
415.7619LogBUN HGB LogPBM SCalc
517.6291LogBUN HGB Age Frac SCalc
517.3519LogBUN HGB Age LogPBM SCalc
517.1922LogBUN HGB Age LogWBC SCalc
617.9120LogBUN HGB Age Frac LogPBM SCalc
617.7947LogBUN HGB Age LogWBC Frac SCalc
617.7744LogBUN HGB Platelet Age Frac SCalc
718.1517LogBUN HGB Platelet Age Frac LogPBM SCalc
718.0568LogBUN HGB Age LogWBC Frac LogPBM SCalc
718.0223LogBUN HGB Platelet Age LogWBC Frac SCalc
818.3925LogBUN HGB Platelet Age LogWBC Frac LogPBM SCalc
818.1636LogBUN HGB Platelet Age Frac LogPBM Protein SCalc
818.1309LogBUN HGB Platelet Age LogWBC Frac Protein SCalc
918.4550LogBUN HGB Platelet Age LogWBC Frac LogPBM Protein SCalc