The FACTOR Procedure

Example 38.3 Maximum Likelihood Factor Analysis

(View the complete code for this example.)

This example uses maximum likelihood factor analyses for one, two, and three factors. It is already apparent from the principal factor analysis that the best number of common factors is almost certainly two. The one- and three-factor ML solutions reinforce this conclusion and illustrate some of the numerical problems that can occur. The following statements produce Output 38.3.1 through Output 38.3.3:

title3 'Maximum Likelihood Factor Analysis with One Factor';
proc factor data=SocioEconomics method=ml heywood n=1;
run;
title3 'Maximum Likelihood Factor Analysis with Two Factors';
proc factor data=SocioEconomics method=ml heywood n=2;
run;
title3 'Maximum Likelihood Factor Analysis with Three Factors';
proc factor data=SocioEconomics method=ml heywood n=3;
run;

Output 38.3.1 displays the results of the analysis with one factor.

Output 38.3.1: Maximum Likelihood Factor Analysis

Maximum Likelihood Factor Analysis with One Factor

The FACTOR Procedure

Input Data TypeRaw Data
Number of Records Read12
Number of Records Used12
N for Significance Tests12

Maximum Likelihood Factor Analysis with One Factor

The FACTOR Procedure
Initial Factor Method: Maximum Likelihood

Prior Communality Estimates: SMC
PopulationSchoolEmploymentServicesHouseValue
0.968591600.822285140.969180820.785724400.84701921

Preliminary Eigenvalues: Total = 76.1165859
Average = 15.2233172
 EigenvalueDifferenceProportionCumulative
163.701008650.64628950.83690.8369
213.054719112.72707980.17151.0084
30.32763930.67491990.00431.0127
4-0.34728050.2722202-0.00461.0081
5-0.6195007 -0.00811.0000


1 factor will be retained by the NFACTOR criterion.

IterationCriterionRidgeChangeCommunalities
16.54292180.00000.10330.938280.722271.000000.719400.74371
23.12326990.00000.72880.945660.023801.000000.264930.01487

Convergence criterion satisfied.

Significance Tests Based on 12 Observations
TestDFChi-SquarePr >
ChiSq
H0: No common factors1054.2517<.0001
HA: At least one common factor   
H0: 1 Factor is sufficient524.46560.0002
HA: More factors are needed   

Chi-Square without Bartlett's Correction34.355969
Akaike's Information Criterion24.355969
Schwarz's Bayesian Criterion21.931436
Tucker and Lewis's Reliability Coefficient0.120231

Squared Canonical
Correlations
Factor1
1.0000000

Eigenvalues of the Weighted Reduced
Correlation Matrix: Total = 0
Average = 0
 EigenvalueDifference
1InftyInfty
21.927160322.15547340
3-.228313080.56464322
4-.792956300.11293464
5-.90589094 

Factor Pattern
 Factor1
Population0.97245
School0.15428
Employment1.00000
Services0.51472
HouseValue0.12193

Variance Explained by Each Factor
FactorWeightedUnweighted
Factor117.80106292.24926004

Final Communality Estimates and Variable
Weights
Total Communality: Weighted = 17.801063
Unweighted = 2.249260
VariableCommunalityWeight
Population0.9456556118.4011648
School0.023803491.0243839
Employment1.00000000Infty
Services0.264934991.3604239
HouseValue0.014865951.0150903


The solution on the second iteration is so close to the optimum that PROC FACTOR cannot find a better solution; hence you receive this message:

   Convergence criterion satisfied.

When this message appears, you should try rerunning PROC FACTOR with different prior communality estimates to make sure that the solution is correct. In this case, other prior estimates lead to the same solution or possibly to worse local optima, as indicated by the information criteria or the chi-square values.

The variable Employment has a communality of 1.0 and, therefore, an infinite weight that is displayed next to the final communality estimate as a missing/infinite value. The first eigenvalue is also infinite. Infinite values are ignored in computing the total of the eigenvalues and the total final communality.

Output 38.3.2 displays the results of the analysis with two factors. The analysis converges without incident. This time, however, the Population variable is a Heywood case.

Output 38.3.2: Maximum Likelihood Factor Analysis: Two Factors

Input Data TypeRaw Data
Number of Records Read12
Number of Records Used12
N for Significance Tests12

Prior Communality Estimates: SMC
PopulationSchoolEmploymentServicesHouseValue
0.968591600.822285140.969180820.785724400.84701921

Preliminary Eigenvalues: Total = 76.1165859
Average = 15.2233172
 EigenvalueDifferenceProportionCumulative
163.701008650.64628950.83690.8369
213.054719112.72707980.17151.0084
30.32763930.67491990.00431.0127
4-0.34728050.2722202-0.00461.0081
5-0.6195007 -0.00811.0000


2 factors will be retained by the NFACTOR criterion.

IterationCriterionRidgeChangeCommunalities
10.34312210.00000.04711.000000.806720.950580.793480.89412
20.30721780.00000.03071.000000.808210.960230.810480.92480
30.30678600.00000.00631.000000.811490.959480.816770.92023
40.30673730.00000.00221.000000.809850.959630.814980.92241
50.30673210.00000.00071.000000.810190.959550.815690.92187

Convergence criterion satisfied.

Significance Tests Based on 12 Observations
TestDFChi-SquarePr >
ChiSq
H0: No common factors1054.2517<.0001
HA: At least one common factor   
H0: 2 Factors are sufficient12.19820.1382
HA: More factors are needed   

Chi-Square without Bartlett's Correction3.3740530
Akaike's Information Criterion1.3740530
Schwarz's Bayesian Criterion0.8891463
Tucker and Lewis's Reliability Coefficient0.7292200

Squared Canonical Correlations
Factor1Factor2
1.00000000.9518891

Eigenvalues of the Weighted Reduced Correlation Matrix: Total = 19.7853157 Average = 4.94632893
 EigenvalueDifferenceProportionCumulative
1InftyInfty  
219.785314319.24212921.00001.0000
30.54318510.58295640.02751.0275
4-0.03977130.4636411-0.00201.0254
5-0.5034124 -0.02541.0000

Factor Pattern
 Factor1Factor2
Population1.000000.00000
School0.009750.90003
Employment0.972450.11797
Services0.438870.78930
HouseValue0.022410.95989

Variance Explained by Each Factor
FactorWeightedUnweighted
Factor124.43297072.13886057
Factor219.78531432.36835294

Final Communality Estimates and Variable
Weights
Total Communality: Weighted = 44.218285
Unweighted = 4.507214
VariableCommunalityWeight
Population1.00000000Infty
School0.810144895.2682940
Employment0.9595714224.7246669
Services0.815603485.4256462
HouseValue0.9218937212.7996793


The results of the three-factor analysis are shown in Output 38.3.3.

Output 38.3.3: Maximum Likelihood Factor Analysis: Three Factors

Input Data TypeRaw Data
Number of Records Read12
Number of Records Used12
N for Significance Tests12

Prior Communality Estimates: SMC
PopulationSchoolEmploymentServicesHouseValue
0.968591600.822285140.969180820.785724400.84701921

Preliminary Eigenvalues: Total = 76.1165859
Average = 15.2233172
 EigenvalueDifferenceProportionCumulative
163.701008650.64628950.83690.8369
213.054719112.72707980.17151.0084
30.32763930.67491990.00431.0127
4-0.34728050.2722202-0.00461.0081
5-0.6195007 -0.00811.0000


3 factors will be retained by the NFACTOR criterion.


Warning:Too many factors for a unique solution.

IterationCriterionRidgeChangeCommunalities
10.17980290.03130.05010.960810.841841.000000.801750.89716
20.00164050.03130.06780.980810.887131.000000.795590.96500
30.00000410.03130.00940.981950.886031.000000.804980.96751
40.00000000.03130.00060.982020.885851.000000.805610.96735

ERROR: Converged, but not to a proper optimum.


Try a different 'PRIORS' statement.

Significance Tests Based on 12 Observations
TestDFChi-SquarePr >
ChiSq
H0: No common factors1054.2517<.0001
HA: At least one common factor   
H0: 3 Factors are sufficient-20.0000.
HA: More factors are needed   

Chi-Square without Bartlett's Correction0.0000003
Akaike's Information Criterion4.0000003
Schwarz's Bayesian Criterion4.9698136
Tucker and Lewis's Reliability Coefficient0.0000000

Squared Canonical Correlations
Factor1Factor2Factor3
1.00000000.97518950.6894465

Eigenvalues of the Weighted Reduced Correlation Matrix: Total = 41.5254193 Average = 10.3813548
 EigenvalueDifferenceProportionCumulative
1InftyInfty  
239.305482637.08542580.94650.9465
32.22005682.21996930.05351.0000
40.00008750.00029490.00001.0000
5-0.0002075 -0.00001.0000

Factor Pattern
 Factor1Factor2Factor3
Population0.97245-0.11233-0.15409
School0.154280.891080.26083
Employment1.000000.000000.00000
Services0.514720.72416-0.12766
HouseValue0.121930.97227-0.08473

Variance Explained by Each Factor
FactorWeightedUnweighted
Factor154.61152412.24926004
Factor239.30548262.27634375
Factor32.22005680.11525433

Final Communality Estimates and Variable
Weights
Total Communality: Weighted = 96.137063
Unweighted = 4.640858
VariableCommunalityWeight
Population0.9820166055.6066901
School0.885851658.7607194
Employment1.00000000Infty
Services0.805643015.1444261
HouseValue0.9673468730.6251078


In the results, a warning message is displayed:

   WARNING:  Too many factors for a unique solution.

The number of parameters in the model exceeds the number of elements in the correlation matrix from which they can be estimated, so an infinite number of different perfect solutions can be obtained. The criterion approaches zero at an improper optimum, as indicated by this message:

   Converged, but not to a proper optimum.

The degrees of freedom for the chi-square test are –2, so a probability level cannot be computed for three factors. Note also that the variable Employment is a Heywood case again.

The probability levels for the chi-square test are 0.0001 for the hypothesis of no common factors, 0.0002 for one common factor, and 0.1382 for two common factors. Therefore, the two-factor model seems to be an adequate representation. Akaike’s information criterion and Schwarz’s Bayesian criterion attain their minimum values at two common factors, so there is little doubt that two factors are appropriate for these data.