In-depth examination of spatiotemporal figures in open reproducible research

References

• Adnan, M., Just, M., & Baillie, L. (2016). Investigating time series visualisations to improve the user experience. In J. Kaye & A. Druin (Eds.), Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 5444–5455. New York:ACM. doi:10.1145/2858036.2858300
   Google Scholar
• Barba, L. A. (2016). The hard road to reproducibility. Science, 354(6308), 142. doi:10.1126/science.354.6308.142
   PubMed Web of Science ®Google Scholar
• Baumer, B., & Udwin, D. (2015). R markdown. Wiley Interdisciplinary Reviews: Computational Statistics, 7(3), 167–177. doi:10.1002/wics.1348
   Google Scholar
• Bik, E. M., Casadevall, A., & Fang, F. C. (2016). The prevalence of inappropriate image duplication in biomedical research publications. MBio, 7(3). doi:10.1128/mBio.00809-16
   PubMed Web of Science ®Google Scholar
• Bishop, A. P. (1999). Document structure and digital libraries: How researchers mobilize information in journal articles. Information Processing & Management, 35(3), 255–279. doi:10.1016/S0306-4573(98)00061-2
   Web of Science ®Google Scholar
• Bizer, C., Heath, T., & Berners-Lee, T. (2009). Linked Data - the story so far. International Journal on Semantic Web and Information Systems, 5(3), 1–22. https://ideas.repec.org/a/igg/jswis0/v5y2009i3p1-22.html
   Web of Science ®Google Scholar
• Claerbout, J. F., & Karrenbach, M. (1992). Electronic documents give reproducible research a new meaning. In SEG Technical Program Expanded Abstracts 1992, 601–604. Tulsa, OK: Society of Exploration Geophysicists. doi:10.1190/1.1822162
   Google Scholar
• Cleveland, W. S. (1984). Graphs in scientific publications. The American Statistician, 38(4), 261–269. doi:10.1080/00031305.1984.10483223
   Web of Science ®Google Scholar
• Conn, V. S., Isaramalai, S. A., Rath, S., Jantarakupt, P., Wadhawan, R., & Dash, Y. (2003). Beyond MEDLINE for literature searches. Journal of Nursing Scholarship, 35(2), 177–182. doi:10.1111/j.1547-5069.2003.00177.x
   PubMed Web of Science ®Google Scholar
• DiBiase, D. (1990). Visualization in the earth sciences. Earth and Mineral Sciences, 59(2), 13–18. http://www.geovista.psu.edu/publications/others/dibiase90/swoopy.html
   Google Scholar
• DiBiase, D., MacEachren, A. M., Krygier, J. B., & Reeves, C. (1992). Animation and the role of map design in scientific visualization. Cartography and Geographic Information Systems, 19(4), 201–214. doi:10.1559/152304092783721295
   Web of Science ®Google Scholar
• Donoho, D. L., Maleki, A., Rahman, I. U., Shahram, M., & Stodden, V. (2009). Reproducible research in computational harmonic analysis. Computing in Science and Engineering, 11(1). doi:10.1109/MCSE.2009.15
   Web of Science ®Google Scholar
• ElMadany, T. S., Walk, J. B., Deventer, M. J., Degefie, D. T., Chang, S. C., Juang, J. Y., … Klemm, O. (2016). Canopy atmosphere interactions under foggy condition size resolved fog droplet fluxes and their implications. Journal of Geophysical Research: Biogeosciences, 121(3), 796–808. doi:10.1002/2015JG003221
   Web of Science ®Google Scholar
• Faniel, I. M., & Jacobsen, T. E. (2010). Reusing scientific data: How earthquake engineering researchers assess the reusability of colleagues’ data. Computer Supported Cooperative Work (CSCW), 19(3–4), 355–375. doi:10.1007/s10606-010-9117-8
   Web of Science ®Google Scholar
• Franzblau, L. E., & Chung, K. C. (2012). Graphs, tables, and figures in scientific publications: The good, the bad, and how not to be the latter. The Journal of Hand Surgery, 37(3), 591–596. doi:10.1016/j.jhsa.2011.12.041
   PubMedGoogle Scholar
• Gewin, V. (2016). Data sharing: An open mind on open data. Nature, 529(7584), 117–119. doi:10.1038/nj7584-117a
   PubMed Web of Science ®Google Scholar
• Gil, Y., David, C. H., Demir, I., Essawy, B. T., Fulweiler, R. W., Goodall, J. L., & Pierce, S. A. (2016). Toward the geoscience paper of the future: Best practices for documenting and sharing research from data to software to provenance. Earth and Space Science, 3(10), 388–415. doi:10.1002/2015EA000136
   Web of Science ®Google Scholar
• Giraud, T., & Lambert, N. (2017). Reproducible cartography. In M. Peterson (Ed.), Advances in Cartography and GIScience. ICACI 2017, (pp., 173–183. ). Cham, Switzerland: Springer, doi:10.1007/978-3-319-57336-6_13.
   Google Scholar
• Glaser, B., & Strauss, A. (1967). Grounded theory: The discovery of grounded theory. Sociology The Journal Of The British Sociological Association, 12, 27–49.
   Google Scholar
• Goodman, S. N., Fanelli, D., & Ioannidis, J. P. (2016). What does research reproducibility mean? Science Translational Medicine, 8(341), 341ps12–341ps12. doi:10.1126/scitranslmed.aaf5027
   PubMed Web of Science ®Google Scholar
• Hearst, M. (2006), August. Design recommendations for hierarchical faceted search interfaces. In ACM SIGIR workshop on faceted search, 1–5. http://flamenco.sims.berkeley.edu/papers/faceted-workshop06.pdf
   Google Scholar
• Hegarty, M., Smallman, H. S., Stull, A. T., & Canham, M. S. (2009). Naïve cartography: How intuitions about display configuration can hurt performance. Cartographica: the International Journal for Geographic Information and Geovisualization, 44(3), 171–186. doi:10.3138/carto.44.3.171
   Google Scholar
• Ioannidis, J. P., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., & Mangion, J. (2009). Repeatability of published microarray gene expression analyses. Nature Genetics, 41(2), 149. doi:10.1038/ng.295
   PubMed Web of Science ®Google Scholar
• Keshav, S. (2007). How to read a paper. ACM SIGCOMM Computer Communication Review, 37(3), 83–84. doi:10.1145/1273445
   Web of Science ®Google Scholar
• Kircz, J. G. (1998). Modularity: The next form of scientific information presentation? Journal of Documentation, 54(2), 210–235. doi:10.1108/EUM0000000007185
   Web of Science ®Google Scholar
• Kluyver, T., Ragan-Kelley, B., Pez, F., Granger, B. E., Bussonnier, M., Frederic, J., & Ivanov, P. (2016). Jupyter Notebooks-a publishing format for reproducible computational workflows. In ELPUB, 87–90. doi:10.4093/dmj.2016.40.1.87
   Google Scholar
• Konkol, M., Nüst, D., Schutzeichel, M., Pebesma, E., Kray, C., Przibytzin, H., & Lorenz, J. (2017). Opening the publication process with executable research compendia. D-Lib Magazine, 23(1/2). doi:10.1045/january2017-nuest
   Google Scholar
• Kules, B., & Shneiderman, B. (2008). Users can change their web search tactics: Design guidelines for categorized overviews. Information Processing & Management, 44(2), 463–484. doi:10.1016/j.ipm.2007.07.014
   Web of Science ®Google Scholar
• Kwakkel, J. H., Carley, S., Chase, J., & Cunningham, S. W. (2014). Visualizing geo-spatial data in science, technology and innovation. Technological Forecasting and Social Change, 81, 67–81. doi:10.1016/j.techfore.2012.09.007
   Web of Science ®Google Scholar
• Lazar, J., Feng, J. H., & Hochheiser, H. (2017). Research methods in human-computer interaction. Cambridge, MA: Morgan Kaufmann.
   Google Scholar
• Lee, P. S., West, J. D., & Howe, B. (2017). Viziometrics: Analyzing visual information in the scientific literature. Piscataway, NJ: IEEE Transactions on Big Data.
   Google Scholar
• Leek, J. T., & Peng, R. D. (2015). Opinion: Reproducible research can still be wrong: Adopting a prevention approach. Proceedings of the National Academy of Sciences, 112(6), 1645–1646. doi:10.1073/pnas.1421412111
   PubMed Web of Science ®Google Scholar
• MacEachren, A. M., & Kraak, M. J. (1997). Exploratory cartographic visualization: Advancing the agenda. Computers & Geosciences, 23(4), 335–343. doi:10.1016/S0098-3004(97)00018-6
   Web of Science ®Google Scholar
• Mack, C. (2014). How to write a good scientific paper: Figures, part 2. Journal of Micro/ Nanolithography,MEMS, and MOEMS, 13(1). 010102-1-010102-4. doi:10.1117/1.JMM.13.1.010102
   PubMed Web of Science ®Google Scholar
• Markowetz, F. (2015). Five selfish reasons to work reproducibly. Genome Biology, 16(1), 274. doi:10.1186/s13059-015-0667-4
   PubMed Web of Science ®Google Scholar
• Matarese, V. (2006). Introductory course on getting to know journals and on browsing a research paper: First steps to proficiency in scientific communication. Croatian Medical Journal, 47(5), 767–775. https://hrcak.srce.hr/4746
   PubMed Web of Science ®Google Scholar
• Merali, Z. (2010). Computational science: Error, why scientific programming does not compute. Nature, 467(7317), 775–777. doi:10.1038/467775a
   PubMedGoogle Scholar
• Monge, A. E., & Elkan, C. P. (1996). The webfind tool for finding scientific papers over the worldwide web. In Proceedings of the 3rd International Congress on Computer Science Research, 41–46.
   Google Scholar
• Murray, D. G. (2013). Tableau your data!: Fast and easy visual analysis with Tableau software. Hoboken, NJ: Wiley.
   Google Scholar
• Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., … Contestabile, M. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. doi:10.1126/science.aab2374
   PubMed Web of Science ®Google Scholar
• Ostermann, F. O., & Granell, C. (2017). Advancing science with VGI: Reproducibility and replicability of recent studies using VGI. Transactions in GIS, 21(2), 224–237. doi:10.1111/tgis.2017.21.issue-2
   Web of Science ®Google Scholar
• Pain, E. (2016, March 21). How to (seriously) read a scientific paper. Retrieved from http://www.sciencemag.org/careers/2016/03/how-seriously-read-scientific-paper. doi:10.1126/science.caredit.a1600047
   Google Scholar
• Patil, P., Peng, R. D., & Leek, J. (2016). A statistical definition for reproducibility and replicability. New York bioRxiv. doi:10.1101/066803
   Google Scholar
• Pebesma, E. (2012). spacetime: Spatio-Temporal Data in R. Journal of Statistical Software, 51(7), 1–30. doi:10.18637/jss.v051.i07
   PubMed Web of Science ®Google Scholar
• Perin, C., Vernier, F., & Fekete, J. D. (2013). Interactive horizon graphs: Improving the compact visualization of multiple time series. In W. Mackay, S. Brewster & S. Bødker (Eds.), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (pp. 3217–3226) New York: ACM. doi:10.1145/2470654.2466441
   Google Scholar
• Pham, Q., Malik, T., Foster, I., Di Lauro, R., Montella, R. (2012). SOLE: Linking Research Papers with Science Objects. In: Groth P., Frew J. (Eds.) Provenance and Annotation of Data and Processes. IPAW 2012. Lecture Notes in Computer Science, vol 7525. Berlin: Springer. doi:10.1007/978-3-642-34222-6_16
   Google Scholar
• Piwowar, H. A., Day, R. S., & Fridsma, D. B. (2007). Sharing detailed research data is associated with increased citation rate. PloS One, 2(3). doi:10.1371/journal.pone.0000308
   PubMed Web of Science ®Google Scholar
• QGIS Development Team. (2018). QGIS geographic information system. Beaverton, OR: Open Source Geospatial Foundation Project.
   Google Scholar
• R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna as a capital of a Great Power in 1914, Vienna gets a free pass. R Foundation for Statistical Computing.
   Google Scholar
• Reichman, O. J., Jones, M. B., & Schildhauer, M. P. (2011). Challenges and opportunities of open data in ecology. Science, 331(6018), 703–705. doi:10.1126/science.1197962
   PubMed Web of Science ®Google Scholar
• Renear, A. H., & Palmer, C. L. (2009). Strategic reading, ontologies, and the future of scientific publishing. Science, 325(5942), 828–832. doi:10.1126/science.1157784
   PubMed Web of Science ®Google Scholar
• Rodriguez, N. (2015, August 5). Infographic: How to read a scientific paper. Retrieved April 10, 2018, from https://www.elsevier.com/connect/infographic-how-to-read-a-scientific-paper
   Google Scholar
• Rolandi, M., Cheng, K., & Pérez‐Kriz, S. (2011). A brief guide to designing effective figures for the scientific paper. Advanced Materials, 23(38), 4343–4346. doi:10.1002/adma.201102518
   PubMed Web of Science ®Google Scholar
• Sandusky, R. J., & Tenopir, C. (2008). Finding and using journal article components: Impacts of disaggregation on teaching and research practice. Journal of the Association for Information Science and Technology, 59(6), 970–982. doi:10.1002/asi.20804
   Web of Science ®Google Scholar
• Sandusky, R. J., Tenopir, C., & Casado, M. M. (2007). Figure and table retrieval from scholarly journal articles: User needs for teaching and research. Proceedings of the American Society for Information Science and Technology, 44(3), 1 13. doi:10.1002/meet.1450440390
   Google Scholar
• Savage, C. J., & Vickers, A. J. (2009). Empirical study of data sharing by authors publishing in PLoS journals. PloS One, 4(9). doi:10.1371/journal.pone.0007078
   Web of Science ®Google Scholar
• Stodden, V., McNutt, M., Bailey, D. H., Deelman, E., Gil, Y., Hanson, B., & Taufer, M. (2016). Enhancing reproducibility for computational methods. Science, 354(6317), 1240–1241. doi:10.1126/science.aah6168
   PubMed Web of Science ®Google Scholar
• Studio, R. (2017). Shiny: Web Application Framework for R (R package). https://shiny.rstudio.com/.
   Google Scholar
• Tenopir, C., King, D. W., Edwards, S., & Wu, L. (2009). Electronic journals and changes in scholarly article seeking and reading patterns. In Aslib Proceedings, 61(1), 5–32. Emerald Group Publishing Limited. doi:10.1108/00012530910932267
   Web of Science ®Google Scholar
• Tversky, B., Morrison, J. B., & Betrancourt, M. (2002). Animation: Can it facilitate? International journal of human-computer studies, 57(4), 247–262. doi:10.1006/ijhc.2002.1017
   Google Scholar
• Vandewalle, P. (2012). Code sharing is associated with research impact in image processing. Computing in Science & Engineering, 14(4), 42–47. doi:10.1109/MCSE.2012.63
   Web of Science ®Google Scholar
• Wacharamanotham, C., Subramanian, K., Völkel, S. T., & Borchers, J. (2015). Statsplorer: Guiding novices in statistical analysis. In B. Begole & J. Kim (Eds.), Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, (pp. 2693–2702). New York: ACM. doi:10.1145/2702123.2702347
   Google Scholar
• Weissgerber, T. L., Garovic, V. D., Savic, M., Winham, S. J., & Milic, N. M. (2016). From static to interactive: Transforming data visualization to improve transparency. PLoS Biology, 14(6), 553–557. doi:10.1371/journal.pbio.1002484
   Web of Science ®Google Scholar
• Wu, Y. P., Aylward, B. S., Roberts, M. C., & Evans, S. C. (2012). Searching the scientific literature: Implications for quantitative and qualitative reviews. Clinical Psychology Review, 32(6), 553–557. doi:10.1016/j.cpr.2012.06.007
   PubMed Web of Science ®Google Scholar