Technical Validation of Plot Designs by Use of Deep Learning

References

• Buja, A., Cook, D., Hofmann, H., Lawrence, M., Lee, E.-K., Swayne, D. F., and Wickham, H. (2009), “Statistical Inference for Exploratory Data Analysis and Model Diagnostics,” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 367, 4361–4383. DOI: 10.1098/rsta.2009.0120.
   PubMed Web of Science ®Google Scholar
• Chen, J. J., Menezes, N. J., Bradley, A. D., and North, T. (2011), “Opportunities for Crowdsourcing Research on Amazon Mechanical Turk,” Interfaces, 5, 1.
   Google Scholar
• Chollet, F., and Allaire, J. (2017), “R Interface to keras,” available at https://github.com/rstudio/keras.
   Google Scholar
• Efron, B., and Hastie, T. (2016), Computer Age Statistical Inference (Vol. 5), Cambridge: Cambridge University Press.
   Google Scholar
• Ekstrøm, C. T. (2014), “Teaching ‘Instant Experience’ with Graphical Model Validation Techniques,” Teaching Statistics, 36, 23–26. DOI: 10.1111/test.12027.
   Google Scholar
• Faraway, J. J. (2014), Linear Models with R, Boca Raton, FL: CRC Press.
   Google Scholar
• Haehn, D., Tompkin, J., and Pfister, H. (2018), “Evaluating ‘Graphical Perception’ with CNNs,” IEEE Transactions on Visualization and Computer Graphics, 25, 641–650. DOI: 10.1109/TVCG.2018.2865138.
   Web of Science ®Google Scholar
• Heer, J., and Bostock, M. (2010), “Crowdsourcing Graphical Perception: Using Mechanical Turk to Assess Visualization Design,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 203–212.
   Google Scholar
• Hofmann, H., Follett, L., Majumder, M., and Cook, D. (2012), “Graphical Tests for Power Comparison of Competing Designs,” IEEE Transactions on Visualization and Computer Graphics, 18, 2441–2448. DOI: 10.1109/TVCG.2012.230.
   PubMed Web of Science ®Google Scholar
• Hornik, K., Stinchcombe, M., and White, H. (1989), “Multilayer Feedforward Networks are Universal Approximators,” Neural Networks, 2, 359–366. DOI: 10.1016/0893-6080(89)90020-8.
   Web of Science ®Google Scholar
• Hullman, J., Resnick, P., and Adar, E. (2015), “Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering,” PloS One, 10, e0142444. DOI: 10.1371/journal.pone.0142444.
   PubMed Web of Science ®Google Scholar
• Kale, A., Kay, M., and Hullman, J. (2020), “Visual Reasoning Strategies and Satisficing: How Uncertainty Visualization Design Impacts Effect Size Judgments and Decisions,” arXiv preprint arXiv:2007.14516.
   Google Scholar
• Loy, A., Hofmann, H., and Cook, D. (2017), “Model Choice and Diagnostics for Linear Mixed-Effects Models Using Statistics on Street Corners,” Journal of Computational and Graphical Statistics, 26, 478–492. DOI: 10.1080/10618600.2017.1330207.
   Web of Science ®Google Scholar
• Majumder, M., Hofmann, H., and Cook, D. (2013), “Validation of Visual Statistical Inference, Applied to Linear Models,” Journal of the American Statistical Association, 108, 942–956. DOI: 10.1080/01621459.2013.808157.
   Web of Science ®Google Scholar
• Manly, B. F. (2006), Randomization, Bootstrap and Monte Carlo Methods in Biology (Vol. 70), Boca Raton, FL: CRC Press.
   Google Scholar
• Microsoft and Weston, S. (2020), foreach: Provides Foreach Looping Construct, R package version 1.5.0.
   Google Scholar
• R Core Team (2020), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing.
   Google Scholar
• Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015), “Imagenet Large Scale Visual Recognition Challenge,” International Journal of Computer Vision, 115, 211–252. DOI: 10.1007/s11263-015-0816-y.
   Web of Science ®Google Scholar
• Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015), “Going Deeper with Convolutions,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9.
   Google Scholar
• Revolution Analytics and Weston, S. (2019), doMC: Foreach Parallel Adaptor for ‘parallel’, R package version 1.3.6.
   Google Scholar
• VanderPlas, S., and Hofmann, H. (2017), “Clusters Beat Trend!? Testing Feature Hierarchy in Statistical Graphics,” Journal of Computational and Graphical Statistics, 26, 231–242. DOI: 10.1080/10618600.2016.1209116.
   Web of Science ®Google Scholar
• Wickham, H. (2016), ggplot2: Elegant Graphics for Data Analysis, New York: Springer-Verlag.
   Google Scholar