Watermain breaks and data: the intricate relationship between data availability and accuracy of predictions

References

• Achim, D., F. Ghotb, and K. J. McManus. 2007. “Prediction of Water Pipe Asset Life Using Neural Networks.” Journal of Infrastructure Systems 13 (1): 26–30. doi:10.1017/CBO9781107415324.004.
   Web of Science ®Google Scholar
• Ahn, J., S. Lee, G. Lee, and J. Koo. 2005. “Predicting Water Pipe Breaks Using Neural Network.” Water Science & Technology: Water Supply 5 (3–4): 159–172.
   Google Scholar
• Alvisi, S., and M. Franchini. 2010. “Comparative Analysis of Two Probabilistic Pipe Breakage Models Applied to a Real Water Distribution System.” Civil Engineering and Environmental Systems 27 (1): 1–22. doi:10.1080/10286600802224064.
   Web of Science ®Google Scholar
• Asnaashari, A., E. A. McBean, B. Gharabaghi, and D. Tutt. 2013. “Forecasting Watermain Failure Using Artificial Neural Network Modelling.” Canadian Water Resources Journal 38 (1): 24–33. doi:10.1080/07011784.2013.774153.
   Web of Science ®Google Scholar
• Asnaashari, A., E. A. McBean, I. Shahrour, and B. Gharabaghi. 2009. “Prediction of Water Main Failure Frequencies Using Multiple and Poisson Regression.” Water Science and Technology Water Supply 9 (1): 9–19. doi:10.2166/ws.2009.020.
   Google Scholar
• AWWA. 2012. “Buried No Longer: Confronting America’s Water Infrastructure Challenge.” 37.
   Google Scholar
• Berardi, L., O. Kapelan, O. Giustolisi, and D. Savic. 2008. “Development of Pipe Deterioration Models for Water Distribution Systems Using EPR.” Journal of Hydroinformatics 10 (2): 113–126. doi:10.2166/hydro.2008.012.
   Web of Science ®Google Scholar
• Boxall, J. B., A. O’Hagan, S. Pooladsaz, A. J. Saul, and D. M. Unwin. 2007. “Estimation of Burst Rates in Water Distribution Mains.” Institution of Civil Engineers Water Management 160 (2): 73–82. doi:10.1680/wama.2007.160.2.73.
   Web of Science ®Google Scholar
• Chen, T., T. He, M. Benesty, V. Khotilovich, and Y. Tang. 2018. “Xgboost: Extreme Gradient Boosting.”
   Google Scholar
• Clark, R., J. Carson, R. Thurnau, R. Krishnan, and S. Panguluri. 2010. “Condition Assessment Modeling for Distribution Systems Using Shared Frailty Analysis.” Journal-American Water Works Association 102 (7): 81. doi:10.1002/j.1551-8833.2010.tb10151.x.
   Web of Science ®Google Scholar
• Dawood, T., E. Elwakil, H. Novoa, and J. Delgado. 2019. “Water Pipe Failure Prediction and Risk Models: State-of-the-Art Review”. Canadian Journal of Civil Engineering, no. ja. doi:10.1139/cjce-2019-0481.
   Google Scholar
• Debón, A., A. Carrión, E. Cabrera, and H. Solano. 2010. “Comparing Risk of Failure Models in Water Supply Networks Using ROC Curves.” Reliability Engineering and System Safety 95 (1): 43–48. doi:10.1016/j.ress.2009.07.004.
   Web of Science ®Google Scholar
• EPA. 2010. “Control and Mitigation of Drinking Water Losses in Distribution Systems.”
   Google Scholar
• Folkman, S. 2018. “Water Main Break Rates in the USA and Canada: A Comprehensive Study.” Mechanical and Aerospace Engineering Faculty Publications, no. March: 1–49.
   Google Scholar
• Fracta. 2019. “Machine Learning Comes of Age in the Water Industry - A White Paper with Business Case Studies.” Redwood City.
   Google Scholar
• Fuchs-Hanusch, D., B. Kornberger, F. Friedl, and R. Scheucher. 2012. “Whole of Life Cost Calculations for Water Supply Pipes.” Water Asset Management International 8 (2): 19–24.
   Google Scholar
• Harrell, F., K. Lee, and D. Mark. 1996. “Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors.” Statistics in Medicine 15 (4): 361–387. doi:10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.
   PubMed Web of Science ®Google Scholar
• Hastie, T., R. Tibshirani, K. Friedman, and J. Franklin. 2005. The Elements of Statistical Learning: Data Mining, Inference and Prediction. 2nd ed. New York, NY: Springer.
   Google Scholar
• Hatler, D. 2019. “The Accuracy and Business Value of Fracta Machine Learning Drinking Water Main Condition Assessment.” https://blog.fracta.ai/condition-assessment-accuracy-value
   Google Scholar
• Hosmer, D., S. Lemeshow, and R. Sturdivant. 2013. Applied Logistic Regression. Hoboken, New Jersey: John Wiley & Sons.
   Google Scholar
• Hu, Y., and D. Hubble. 2007. “Factors Contributing to the Failure of Asbestos Cement Water Mains.” Canadian Journal of Civil Engineering 34 (5): 608–621. doi:10.1139/l06-162.
   Web of Science ®Google Scholar
• Jafar, R., I. Shahrour, and I. Juran. 2010. “Application of Artificial Neural Networks (ANN) to Model the Failure of Urban Water Mains.” Mathematical and Computer Modelling 51 (9–10): 1170–1180. doi:10.1016/j.mcm.2009.12.033.
   Google Scholar
• Kimutai, E., G. Betrie, R. Brander, R. Sadiq, and S. Tesfamariam. 2015. “Comparison of Statistical Models for Predicting Pipe Failures: Illustrative Example with the City of Calgary Water Main Failure.” Journal of Pipeline Systems Engineering and Practice 6: 4. doi:10.1061/(ASCE)PS.1949-1204.0000196.
   Web of Science ®Google Scholar
• Kirmeyer, G. J., W. Richards, and C. D. Smith. 1994. Assessment of Water Distribution Systems and Associated Research Needs. Denver, Colorado: AWWA.
   Google Scholar
• Kleiner, Y., and B. Rajani. 2000. “Considering Time-Dependent Factors in the Statistical Prediction of Water Main Breaks.” American Water Works Association Infrastructure Conference Proceedings , Baltimore, Maryland, 1–12.
   Google Scholar
• Kleiner, Y., and B. Rajani. 2001. “Comprehensive Review of Structural Deterioration of Water Mains: Statistical Models.” Urban Water 3 (3): 131–150. doi:10.1016/S1462-0758(01)00033-4.
   Google Scholar
• Kleiner, Y., and B. Rajani. 2002. “Forecasting Variations and Trends in Water-Main Breaks.” Journal of Infrastructure Systems 8 (4): 122–131. doi:10.1061/(ASCE)1076-0342(2002)8:4(122).
   Google Scholar
• Kleiner, Y., and B. Rajani. 2012. “Comparison of Four Models to Rank Failure Likelihood of Individual Pipes.” Journal of Hydroinformatics 14 (3): 659–681. doi:10.2166/hydro.2011.029.
   Web of Science ®Google Scholar
• Kumar, A., S. Rizvi, B. Brooks, R. Vanderveld, K. Wilson, C. Kenney, S. Edelstein, et al. 2018. “Using Machine Learning to Assess the Risk of and Prevent Water Main Breaks.” In SIGKDD’18, 1–9. London, UK. doi:10.1145/nnnnnnn.nnnnnnn.
   Google Scholar
• Laucelli, D., B. Rajani, Y. Kleiner, and O. Giustolisi. 2014. “Study on Relationships between Climate-Related Covariates and Pipe Bursts Using Evolutionary-Based Modelling.” Journal of Hydroinformatics 16 (4): 743. doi:10.2166/hydro.2013.082.
   Web of Science ®Google Scholar
• Le Gat, Y., and P. Eisenbeis. 2000. “Using Maintenance Records to Forecast Failures in Water Networks.” Urban Water 2 (3): 173–181. doi:10.1016/S1462-0758(00)00057-1.
   Google Scholar
• Nishiyama, M., and Y. Filion. 2014. “Forecasting Breaks in Cast Iron Water Mains in the City of Kingston with an Artificial Neural Network Model.” Canadian Journal of Civil Engineering 41 (10): 918–923. doi:10.1139/cjce-2014-0114.
   Web of Science ®Google Scholar
• Oliveira, D. P., D. Neill, J. Garrett, and L. Soibelman. 2011. “Detection of Patterns in Water Distribution Pipe Breakage Using Spatial Scan Statistics for Point Events in a Physical Network.” Journal of Computing in Civil Engineering 25 (1): 21–30. doi:10.1061/(ASCE)CP.1943-5487.0000079.
   Web of Science ®Google Scholar
• Park, S., H. Jun, N. Agbenowosi, B. J. Kim, and K. Lim. 2011. “The Proportional Hazards Modeling of Water Main Failure Data Incorporating the Time-Dependent Effects of Covariates.” Water Resources Management 25 (1): 1–19. doi:10.1007/s11269-010-9684-y.
   Web of Science ®Google Scholar
• Park, S., J. Kim, A. Newland, B. J. Kim, and H. Jun. 2008. “SurvivalAnalysis of Water Distribution Pipe Failure Data Using the Proportional Hazards Model.” World Environmental and Water Resources Congress, Ahupua’a.
   Google Scholar
• Park, S., J. Kim, A. Newland, and H. Jun. 2007. “A Methodology to Estimate Economically Optimal Replacement Time Interval of Water Distribution Pipes.” Water Science & Technology: Water Supply 7 (5–6): 149–155.
   Google Scholar
• R Core Development Team. 2017. R: A Lanaguage and Environment for Statistical Computing. Vienna, Austria.
   Google Scholar
• Rajani, Y., and B. Kleiner. 2001. “Comprehensive Review of Structural Deterioration of Water Mains: Statistical Models.” Urban Water Journal 3 (3): 131–150. doi:10.1016/S1462-0758(01)00033-4.
   Google Scholar
• Rao, V. M., and R. A. Francis. 2014. "Investigating the Role of Statistical Models in Water Distribution Asset Management: A Semi-structured Interview Approach." Probabilistic Safety Assessment and Management PSAM 12, Honolulu, Hawaii, June 2014.
   Google Scholar
• Renzetti, S., and D. Dupont. 2013. Buried Treasure: The Economics of Leak Detection and Water Loss Prevention in Ontario. Rep. No. E.
   Google Scholar
• Savic, D., O. Giustolisi, and D. Laucelli. 2009. “Asset Deterioration Analysis Using Multi-Utility Data and Multi-Objective Data Mining.” Journal of Hydroinformatics 11 (3–4): 211–224. doi:10.2166/hydro.2009.019.
   Web of Science ®Google Scholar
• Scheidegger, A., J. P. Leitão, and L. Scholten. 2015. “Statistical Failure Models for Water Distribution Pipes - A Review from A Unified Perspective.” Water Research 83: 237–247. doi:10.1016/j.watres.2015.06.027.
   PubMed Web of Science ®Google Scholar
• Snider, B., and E. A. McBean. 2018. “Improving Time to Failure Predictions for Water Distribution Systems Using Gradient Boosting Algorithm.” WDSA/CCWI Joint Conference Proceedings, Kingston, Canada.
   Google Scholar
• St. Clair, A. M., and S. Sinha. 2012. “State-of-the-Technology Review on Water Pipe Condition, Deterioration and Failure Rate Prediction Models!” Urban Water Journal 9 (2): 85–112. doi:10.1080/1573062X.2011.644566.
   Web of Science ®Google Scholar
• Tabesh, M., J. Soltani, R. Farmani, and D. Savic. 2009. “Assessing Pipe Failure Rate and Mechanical Reliability of Water Distribution Networks Using Data-Driven Modeling.” Journal of Hydroinformatics 11 (1): 1–17. doi:10.2166/hydro.2009.008.
   Web of Science ®Google Scholar
• Therneau, T. 2015. “A Package for Survival Analysis in S. Version 2.38.”
   Google Scholar
• Underhill, M. D., and I. Elliott. 2012. “Water and Wastewater Infrastructure.” The Handbook of Infrastructure Investing, no. March: 63–79. doi:10.1002/9781118268117.ch5.
   Google Scholar
• Van Buuren, S., H. C. Boshuizen, and D. L. Knook. 1999. “Multiple Imputation of Missing Blood Pressure Covariates in Survival Analysis.” Statistics in Medicine 18 (6): 681–694. doi:10.1002/(SICI)1097-0258(19990330)18:6<681::AID-SIM71>3.0.CO;2-R.
   PubMed Web of Science ®Google Scholar
• Vanrenterghem-Raven, A., P. Eisenbeis, I. Juran, and S. Christodoulou. 2004. “Statistical Modeling of the Structural Degreadation of an Urban Water Distribution System: Case Study of New York City.” World Water & Environmental Resources Congress 2003, Pennsylvania, USA.
   Google Scholar
• Wang, Y., T. Zayed, and O. Moselhi. 2009. “Prediction Models for Annual Break Rates of Water Mains.” Journal of Performance of Constructed Facilities 23 (1): 47–54. doi:10.1061/(ASCE)0887-3828(2009)23:1(47).
   Web of Science ®Google Scholar
• Wiesner, R. H., P. M. Grambsch, E. R. Dickson, J. Ludwig, R. L. Maccarty, E. B. Hunter, T. Fleming, L. Fisher, S. Beaver, and N. Larusso. 1989. “Primary Sclerosing Cholangitis: Natural History, Prognostic Factors and Survival Analysis.” Hepatology 10 (4): 430–436. doi:10.1002/hep.1840100406.
   PubMed Web of Science ®Google Scholar
• Wilson, D., Y. Filion, and I. Moore. 2015. “State-of-the-Art Review of Water Pipe Failure Prediction Models and Applicability to Large-Diameter Mains.” Urban Water Journal 14 (2): 173–184. doi:10.1080/1573062X.2015.1080848.
   Web of Science ®Google Scholar
• Winkler, D., M. Haltmeier, M. Kleidorfer, W. Rauch, and F. Tscheikner-Gratl. 2018. “Pipe Failure Modelling for Water Distribution Networks Using Boosted Decision Trees.” Structure and Infrastructure Engineering 14 (10): 1402–1411. doi:10.1080/15732479.2018.1443145.
   Web of Science ®Google Scholar
• Xu, Q., Q. Chen, and W. Li. 2011. “Application of Genetic Programming to Modeling Pipe Failures in Water Distribution Systems.” Journal of Hydroinformatics 13 (3): 419–428. doi:10.2166/hydro.2010.189.
   Web of Science ®Google Scholar
• Xu, Q., Q. Chen, W. Li, and J. Ma. 2011. “Pipe Break Prediction Based on Evolutionary Data-Driven Methods with Brief Recorded Data.” Reliability Engineering and System Safety 96 (8): 942–948. doi:10.1016/j.ress.2011.03.010.
   Web of Science ®Google Scholar
• Yamijala, S., S. D. Guikema, and K. Brumbelow. 2009. “Statistical Models for the Analysis of Water Distribution System Pipe Break Data.” Reliability Engineering and System Safety 94 (2): 282–293. doi:10.1016/j.ress.2008.03.011.
   Web of Science ®Google Scholar