Selecting Path Models in SEM: A Comparison of Model Selection Criteria

Abstract

Model comparison is one useful approach in applications of structural equation modeling. Akaike’s information criterion (AIC) and the Bayesian information criterion (BIC) are commonly used for selecting an optimal model from the alternatives. We conducted a comprehensive evaluation of various model selection criteria, including AIC, BIC, and their extensions, in selecting an optimal path model under a wide range of conditions over different compositions of candidate set, distinct values of misspecified parameters, and diverse sample sizes. The chance of selecting an optimal model rose as the values of misspecified parameters and sample sizes increased. The relative performance of AIC and BIC type criteria depended on the magnitudes of the parameter misspecified. The BIC family in general outperformed AIC counterparts unless under small values of omitted parameters and sample sizes, where AIC performed better. Scaled unit information prior BIC (SPBIC) and Haughton's BIC (HBIC) demonstrated the highest accuracy ratios across most of the conditions investigated in this simulation.

Keywords:

• AIC
• BIC
• model comparison
• model selection criterion
• path model
• structural equation modeling

FUNDING

This research was supported in part by grants NSC 99-2410-H-002-083-MY3 and NSC 102-2410-H-002-053 from the National Science Council in Taiwan.

Supplemental data for this article can be accessed at www.tandfonline.com/HSEM.

Notes

¹ Dudley and Haughton (1997) developed an adjustment of BIC, BICR, by retaining the second term , the third term , and the fifth term in Equation 4. Haughton et al. (1997) indicated that selecting a suitable prior distribution for was difficult and found BICR to perform worse than BIC across all the simulation conditions. This study therefore did not include BICR.

Additional information

Funding

This research was supported in part by grants NSC 99-2410-H-002-083-MY3 and NSC 102-2410-H-002-053 from the National Science Council in Taiwan.