Alternative methods for interpreting Monte Carlo experiments

Abstract

Research methodologists typically use descriptive statistics and plots to report the findings of Monte Carlo experiments. But previous literature suggests that Monte Carlo results deserve careful analysis rather than relying on simple descriptive statistics and plots of results, given the complex data conditions in simulation studies. As an alternative, data mining methods can also help readers digest Monte Carlo experiments. Therefore, our paper uses data mining methods to provide two novel contributions. First, we use detailed descriptions and code to illustrate how to use two data mining methods to analyze results from Monte Carlo experiments. Second, we demonstrate how data mining methods can be used in conjunction with interpreting plots, performing analysis of variance tests, and calculating effect sizes. Our study raises the awareness that there are alternative methods to interpretation and serves as a guide to readers for explaining the importance of manipulated conditions in Monte Carlo experiments.

Keywords:

• Data mining
• Mixture model
• Monte Carlo simulation