The FMM Procedure

Example 40.3 Enforcing Homogeneity Constraints: Count and Dispersion—It Is All Over!

(View the complete code for this example.)

The following example demonstrates how you can use either the EQUATE= option in the MODEL statement or the RESTRICT statement to impose homogeneity constraints on chosen model effects.

The data for this example were presented by Margolin, Kaplan, and Zeiger (1981) and analyzed by various authors applying a number of techniques. The following DATA step shows the number of revertant salmonella colonies (variable num) at six levels of quinoline dosing (variable dose). There are three replicate plates at each dose of quinoline.

data assay;
   label dose = 'Dose of quinoline (microg/plate)'
         num  = 'Observed number of colonies';
   input dose @;
   logd = log(dose+10);
   do i=1 to 3; input num@; output; end;
   datalines;
   0  15 21 29
  10  16 18 21
  33  16 26 33
 100  27 41 60
 333  33 38 41
1000  20 27 42
;

The basic notion is that the data are overdispersed relative to a Poisson distribution in which the logarithm of the mean count is modeled as a linear regression in dose (in plate) and in the derived variable (Lawless 1987). The log of the expected count of revertants is thus

The following statements fit a standard Poisson regression model to these data:

proc fmm data=assay;
   model num = dose logd / dist=Poisson;
run;

The Pearson statistic for this model is rather large compared to the number of degrees of freedom (). The ratio indicates an overdispersion problem in the Poisson model (Output 40.3.1).

Output 40.3.1: Result of Fitting Poisson Regression Models

The FMM Procedure

Number of Observations Read18
Number of Observations Used18

Fit Statistics
-2 Log Likelihood136.3
AIC (Smaller is Better)142.3
AICC (Smaller is Better)144.0
BIC (Smaller is Better)144.9
Pearson Statistic46.2707

Parameter Estimates for Poisson Model
EffectEstimateStandard
Error
z ValuePr > |z|
Intercept2.17280.21849.95<.0001
dose-0.001010.000245-4.13<.0001
logd0.31980.057005.61<.0001


Breslow (1984) accounts for overdispersion by including a random effect in the predictor for the log rate and applying a quasi-likelihood technique to estimate the parameters. Wang et al. (1996) examine these data using mixtures of Poisson regression models. They fit several two- and three-component Poisson regression mixtures. Examining the log likelihoods, AIC, and BIC criteria, they eventually settle on a two-component model in which the intercepts vary by category and the regression coefficients are the same. This mixture model can be written as

This model is fit with the FMM procedure with the following statements:

proc fmm data=assay;
   model num = dose logd / dist=Poisson k=2
                           equate=effects(dose logd);
run;

The EQUATE= option in the MODEL statement places constraints on the optimization and makes the coefficients for dose and logd homogeneous across components in the model. Output 40.3.2 displays the "Fit Statistics" and parameter estimates in the mixture. The Pearson statistic is drastically reduced compared to the Poisson regression model in Output 40.3.1. With degrees of freedom, the ratio of the Pearson and the degrees of freedom is now . Note that the effective number of parameters was used to compute the degrees of freedom, not the total number of parameters, because of the equality constraints.

Output 40.3.2: Result for Two-Component Poisson Regression Mixture

The FMM Procedure

Fit Statistics
-2 Log Likelihood121.8
AIC (Smaller is Better)131.8
AICC (Smaller is Better)136.8
BIC (Smaller is Better)136.3
Pearson Statistic16.1573
Effective Parameters5
Effective Components2

Parameter Estimates for Poisson Model
ComponentEffectEstimateStandard
Error
z ValuePr > |z|
1Intercept1.90970.26547.20<.0001
1dose-0.001260.000273-4.62<.0001
1logd0.36390.066025.51<.0001
2Intercept2.47700.27319.07<.0001
2dose-0.001260.000273-4.62<.0001
2logd0.36390.066025.51<.0001

Parameter Estimates for Mixing Probabilities
Component
Mixing
Probability
Linked Scale
Logit(Prob)Standard
Error
z ValuePr > |z|
10.81731.49840.68752.180.0293
20.1827-1.4984   


You could also have used RESTRICT statements to impose the homogeneity constraints on the model fit, as shown in the following statements:

proc fmm data=assay;
   model num = dose logd / dist=Poisson k=2;
   restrict 'common dose' dose 1, dose -1;
   restrict 'common logd' logd 1, logd -1;
run;

The first RESTRICT statement equates the coefficients for the dose variable in the two components, and the second RESTRICT statement accomplishes the same for the coefficients of the logd variable. If the right-hand side of a restriction is not specified, PROC FMM defaults to equating the left-hand side of the restriction to zero. The "Linear Constraints" table in Output 40.3.3 shows that both linear equality constraints are active. The parameter estimates match the previous FMM run.

Output 40.3.3: Result for Two-Component Mixture with RESTRICT Statements

The FMM Procedure

Linear Constraints at Solution
Labelk = 1k = 2 Constraint
Active
common dosedose- dose=0Yes
common logdlogd- logd=0Yes

Parameter Estimates for Poisson Model
ComponentEffectEstimateStandard
Error
z ValuePr > |z|
1Intercept1.90970.26547.20<.0001
1dose-0.001260.000273-4.62<.0001
1logd0.36390.066025.51<.0001
2Intercept2.47700.27319.07<.0001
2dose-0.001260.000273-4.62<.0001
2logd0.36390.066025.51<.0001

Parameter Estimates for Mixing Probabilities
Component
Mixing
Probability
Linked Scale
Logit(Prob)Standard
Error
z ValuePr > |z|
10.81731.49840.68752.180.0293
20.1827-1.4984   


Wang et al. (1996) note that observation 12 with a revertant colony count of 60 is comparably high. The following statements remove the observation from the analysis and fit their selected model:

proc fmm data=assay(where=(num ne 60));
   model num = dose logd / dist=Poisson k=2
                           equate=effects(dose logd);
run;

Output 40.3.4: Result for Two-Component Model without Outlier

The FMM Procedure

Fit Statistics
-2 Log Likelihood111.5
AIC (Smaller is Better)121.5
AICC (Smaller is Better)126.9
BIC (Smaller is Better)125.6
Pearson Statistic16.5987
Effective Parameters5
Effective Components2

Parameter Estimates for Poisson Model
ComponentEffectEstimateStandard
Error
z ValuePr > |z|
1Intercept2.22720.30227.37<.0001
1dose-0.000650.000445-1.460.1440
1logd0.24320.10452.330.0199
2Intercept2.54770.33317.65<.0001
2dose-0.000650.000445-1.460.1440
2logd0.24320.10452.330.0199

Parameter Estimates for Mixing Probabilities
Component
Mixing
Probability
Linked Scale
Logit(Prob)Standard
Error
z ValuePr > |z|
10.57770.31341.72610.180.8559
20.4223-0.3134   


The ratio of Pearson Statistic over degrees of freedom (12) is only slightly worse than in the previous model; the loss of 5% of the observations carries a price (Output 40.3.4). The parameter estimates for the two intercepts are now fairly close. If the intercepts were identical, then the two-component model would collapse to the Poisson regression model:

proc fmm data=assay(where=(num ne 60));
   model num = dose logd / dist=Poisson;
run;

Output 40.3.5: Result of Fitting Poisson Regression Model without Outlier

The FMM Procedure

Number of Observations Read17
Number of Observations Used17

Fit Statistics
-2 Log Likelihood114.1
AIC (Smaller is Better)120.1
AICC (Smaller is Better)121.9
BIC (Smaller is Better)122.5
Pearson Statistic27.8008

Parameter Estimates for Poisson Model
EffectEstimateStandard
Error
z ValuePr > |z|
Intercept2.31640.224410.32<.0001
dose-0.000720.000258-2.780.0055
logd0.26030.059964.34<.0001


Compared to the same model applied to the full data, the Pearson statistic is much reduced (compare 46.2707 in Output 40.3.1 to 27.8008 in Output 40.3.5). The outlier—or overcount, if you will—induces at least some of the overdispersion.