Computer vision-based model for detecting turning lane features on Florida’s public roadways from aerial images

References

• Aghdam, H. H., E. J. Heravi, and D. Puig. 2016. “A Practical Approach for Detection and Classification of Traffic Signs Using Convolutional Neural Networks.” Robotics and Autonomous Systems 84:97–112. https://doi.org/10.1016/j.robot.2016.07.003.
   Web of Science ®Google Scholar
• Alzraiee, H., A. Leal Ruiz, and R. Sprotte. 2021. “Detecting of Pavement Marking Defects Using Faster R-CNN.” Journal of Performance of Constructed Facilities 35 (4): 04021035. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001606.
   Web of Science ®Google Scholar
• Antwi, R. B., M. Kimollo, S. Y. Takyi, E. E. Ozguven, T. Sando, R. Moses, and M. A. Dulebenets. 2024a. “Turning Features Detection from Aerial Images: Model Development and Application on Florida’s Public Roadways.” Smart Cities 7 (3): 1414–1440. https://doi.org/10.3390/smartcities7030059.
   Google Scholar
• Antwi, R. B., S. Takyi, A. Karaer, E. E. Ozguven, M. Kimollo, R. Moses, and T. Sando. 2024b. “Automated GIS-Based Framework for Detecting Crosswalk Changes from Bi-Temporal High-Resolution Aerial Images.” arXiv preprint arXiv:2406.09731.
   Google Scholar
• Antwi, R. B., S. Takyi, A. Karaer, E. E. Ozguven, R. Moses, M. A. Dulebenets, and T. Sando. 2023. “Detecting School Zones on Florida’s Public Roadways Using Aerial Images and Artificial Intelligence (AI2).” Transportation Research Record 2678 (4): 622–636. https://doi.org/10.1177/03611981231185771.
   Web of Science ®Google Scholar
• Azimi, S. M., P. Fischer, M. Körner, and P. Reinartz. 2018. “Aerial LaneNet: Lane-Marking Semantic Segmentation in Aerial Imagery Using Wavelet-Enhanced Cost-Sensitive Symmetric Fully Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 57 (5): 2920–2938. https://doi.org/10.1109/TGRS.2018.2878510.
   Web of Science ®Google Scholar
• Balali, V., A. Ashouri Rad, and M. Golparvar-Fard. 2015. “Detection, Classification, and Mapping of US Traffic Signs Using Google Street View Images for Roadway Inventory Management.” Visualization in Engineering 3 (1): 1–18. https://doi.org/10.1186/s40327-015-0027-1.
   Google Scholar
• Bochkovskiy, A., C. Y. Wang, and H. Y. M. Liao. 2020. “Yolov4: Optimal Speed and Accuracy of Object Detection.” arXiv preprint arXiv:2004.10934.
   Google Scholar
• Caddell, R., P. Hammond, and S. Reinmuth. 2009. Roadside Features Inventory Program. Washington State Department of Transportation.
   Google Scholar
• Campbell, A., A. Both, and Q. C. Sun. 2019. “Detecting and Mapping Traffic Signs from Google Street View Images Using Deep Learning and GIS.” Computers, Environment and Urban Systems 77:101350. https://doi.org/10.1016/j.compenvurbsys.2019.101350.
   Web of Science ®Google Scholar
• Carlson, P. J., E. S. Park, and C. K. Andersen. 2009. “Benefits of Pavement Markings: A Renewed Perspective Based on Recent and Ongoing Research.” Transportation Research Record 2107 (1): 59–68. https://doi.org/10.3141/2107-06.
   Google Scholar
• Cheng, W., H. Luo, W. Yang, L. Yu, and W. Li. 2020. “Structure-Aware Network for Lane Marker Extraction with Dynamic Vision Sensor.” arXiv preprint arXiv:2008.06204.
   Google Scholar
• Cho, Y., K. Kabassi, J. H. Pyeon, K. Choi, C. Wang, and T. Norton. 2013. “Effectiveness Study of Methods for Removing Temporary Pavement Markings in Roadway Construction Zones.” Journal of Construction Engineering and Management 139 (3): 257–266. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000608.
   Web of Science ®Google Scholar
• Dai, J., Y. Wang, W. Li, and Y. Zuo. 2020. “Automatic Method for Extraction of Complex Road Intersection Points from High-Resolution Remote Sensing Images Based on Fuzzy Inference.” IEEE Access 8:39212–39224. https://doi.org/10.1109/ACCESS.2020.2974974.
   Web of Science ®Google Scholar
• Foucher, P., Y. Sebsadji, J. P. Tarel, P. Charbonnier, and P. Nicolle. 2011. “Detection and Recognition of Urban Road Markings Using Images.” In 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), October, 1747–1752. Washington, DC: IEEE.
   Google Scholar
• Girshick, R. 2015. “Fast r-cnn.” In Proceedings of the IEEE International Conference on Computer Vision, 1440–1448. Piscataway, NJ: IEEE.
   Google Scholar
• Gong, J., H. Zhou, C. Gordon, and M. Jalayer. 2012. “Mobile Terrestrial Laser Scanning for Highway Inventory Data Collection.” Proc., 2012 ASCE International Conference on Computing in Civil Engineering Computing in Civil Engineering, Clearwater Beach, FL, 2012, pp. 545–552. https://doi.org/10.1061/9780784412343.0069.
   Google Scholar
• Graham, L. 2010. “Mobile Mapping Systems Overview.” Photogrammetric Engineering and Remote Sensing 76 (3): 222–228.
   Web of Science ®Google Scholar
• Gunaratne, M., A. Mraz, and I. Sokolic. 2003. Study of the Feasibility of Video Logging with Pavement Condition Evaluation (No. Report No. BC-965).
   Google Scholar
• He, B., R. Ai, Y. Yan, and X. Lang. 2016. “Accurate and Robust Lane Detection Based on Dual-View Convolutional Neutral Network.” In 2016 IEEE Intelligent Vehicles Symposium (IV), 1041–1046. Gothenburg, Sweden: IEEE.
   Google Scholar
• Huval, B., T. Wang, S. Tandon, J. Kiske, W. Song, J. Pazhayampallil, and A. Y. Ng. 2015. “An Empirical Evaluation of Deep Learning on Highway Driving.” arXiv preprint arXiv:1504.01716.
   Google Scholar
• Jalayer, M., S. Hu, H. Zhou, and R. E. Turochy. 2015. “Evaluation of Geo-Tagged Photo and Video Logging Methods to Collect Geospatial Highway Inventory Data.” Papers in Applied Geography 1 (1): 50–58. https://doi.org/10.1080/23754931.2015.1009301.
   Google Scholar
• Jalayer, M., H. Zhou, J. Gong, S. Hu, and M. Grinter. 2014. “A Comprehensive Assessment of Highway Inventory Data Collection Methods.” Journal of the Transportation Research Forum 53 (2): 73–92.
   Google Scholar
• Jocher, G. 2020. “YOLOv5 by Ultralytics.” 5–29. https://github.com/ultralytics/yolov5.
   Google Scholar
• Karaer, A., W. Kaczmarek, E. Mank, M. Ghorbanzadeh, M. Koloushani, M. A. Dulebenets, and E. E. Ozguven. 2023. “Traffic Data on-the-Fly: Developing a Statewide Crosswalk Inventory Using Artificial Intelligence and Aerial Images (AI2) for Pedestrian Safety Policy Improvements in Florida.” Data Science for Transportation 5 (2): 7. https://doi.org/10.1007/s42421-023-00070-1.
   Google Scholar
• Kathuria, A. 2019. “What’s New in YOLO v3?” https://towardsdatascience.com/yolo-v3-object-detection-53fb7d3bfe6b.
   Google Scholar
• Kim, E. J., H. C. Park, S. W. Ham, S. Y. Kho, and D. K. Kim. 2019. “Extracting Vehicle Trajectories Using Unmanned Aerial Vehicles in Congested Traffic Conditions.” Journal of Advanced Transportation 2019 (1): 9060797.
   Google Scholar
• Krzywinski, M., J. Schein, I. Birol, J. Connors, R. Gascoyne, D. Horsman, and M. A. Marra. 2009. “Circos: An Information Aesthetic for Comparative Genomics.” Genome Research 19 (9): 1639–1645. https://doi.org/10.1101/gr.092759.109.
   PubMed Web of Science ®Google Scholar
• Lee, S., J. Kim, J. Shin Yoon, S. Shin, O. Bailo, N. Kim, and I. So Kweon. 2017. “VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition.” In Proceedings of the IEEE International Conference on Computer Vision, 1947–1955. Venice.
   Google Scholar
• Li, J., X. Mei, D. Prokhorov, and D. Tao. 2016. “Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene.” IEEE Transactions on Neural Networks and Learning Systems 28 (3): 690–703. https://doi.org/10.1109/TNNLS.2016.2522428.
   PubMed Web of Science ®Google Scholar
• Panboonyuen, T., K. Jitkajornwanich, S. Lawawirojwong, P. Srestasathiern, and P. Vateekul. 2017. “Road Segmentation of Remotely-Sensed Images Using Deep Convolutional Neural Networks with Landscape Metrics and Conditional Random Fields.” Remote Sensing 9 (7): 680. https://doi.org/10.3390/rs9070680.
   Web of Science ®Google Scholar
• Redmon, J., S. Divvala, R. Girshick, and A. Farhadi. 2016. “You Only Look Once: Unified, Real-Time Object Detection.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 779–788. Las Vegas, NV: IEEE.
   Google Scholar
• Redmon, J., and A. Farhadi. 2017. “YOLO9000: Better, Faster, Stronger.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 7263–7271. Honolulu, HI: IEEE.
   Google Scholar
• Redmon, J., and A. Farhadi. 2018. “Yolov3: An Incremental Improvement.” arXiv preprint arXiv:1804.02767.
   Google Scholar
• Ren, S., K. He, R. Girshick, and J. Sun. 2015. “Faster r-cnn: Towards Real-Time Object Detection with Region Proposal Networks.” Advances in Neural Information Processing Systems 28: 1137–1149.
   Google Scholar
• Shamayleh, H., and A. Khattak. 2003. “Utilization of LiDAR Technology for Highway Inventory.” In Proceedings of the 2003 Mid-Continent Transportation Research Symposium, Ames, Iowa.
   Google Scholar
• Sun, K., J. Zhang, and Y. Zhang. 2019. “Roads and Intersections Extraction from High-Resolution Remote Sensing Imagery Based on Tensor Voting Under Big Data Environment.” Wireless Communications and Mobile Computing 2019 (1): 6513418.
   Google Scholar
• Tang, T., S. Zhou, Z. Deng, H. Zou, and L. Lei. 2017. “Vehicle Detection in Aerial Images Based on Region Convolutional Neural Networks and Hard Negative Example Mining.” Sensors 17 (2): 336. https://doi.org/10.3390/s17020336.
   PubMed Web of Science ®Google Scholar
• Tong, Z., J. Gao, and H. Zhang. 2017. “Recognition, Location, Measurement, and 3D Reconstruction of Concealed Cracks Using Convolutional Neural Networks.” Construction and Building Materials 146:775–787. https://doi.org/10.1016/j.conbuildmat.2017.04.097.
   Web of Science ®Google Scholar
• Tsang, S. H. 2019. “Review: Yolov3—You Only Look Once (Object Detection).” Towards Data Science.
   Google Scholar
• Uçar, A., Y. Demir, and C. Güzeliş. 2017. “Object Recognition and Detection with Deep Learning for Autonomous Driving Applications.” Simulation 93 (9): 759–769. https://doi.org/10.1177/0037549717709932.
   Google Scholar
• United States Census Bureau (US Census). 2020a. Population Estimates. Accessed June 16, 2023. https://www.census.gov/quickfacts/duvalcountyflorida.
   Google Scholar
• United States Census Bureau (US Census). 2020b. Population Estimates. Accessed June 20, 2023. https://www.census.gov/quickfacts/leoncountyflorida.
   Google Scholar
• Uslu, B., M. Golparvar-Fard, and J. M. de la Garza. 2011. “Image-Based 3D Reconstruction and Recognition for Enhanced Highway Condition Assessment.” In Computing in Civil Engineering (2011), 67–76. Miami, Florida, United States: American Society of Civil Engineers (ASCE).
   Google Scholar
• Vattapparamban, E., I. Güvenç, A. I. Yurekli, K. Akkaya, and S. Uluağaç. 2016. “Drones for Smart Cities: Issues in Cybersecurity, Privacy, and Public Safety.” In 2016 International Wireless Communications and Mobile Computing Conference (IWCMC), 216–221. Paphos: IEEE.
   Google Scholar
• Wang, K. C., Z. Hou, and W. Gong. 2010. “Automated Road Sign Inventory System Based on Stereo Vision and Tracking.” Computer-Aided Civil and Infrastructure Engineering 25 (6): 468–477. https://doi.org/10.1111/j.1467-8667.2010.00657.x.
   Web of Science ®Google Scholar
• Wiedemann, C., and H. Ebner. 2000. “Automatic Completion and Evaluation of Road Networks.” International Archives of Photogrammetry and Remote Sensing 33 (B3/2; PART 3): 979–986.
   Google Scholar
• Wiedemann, C., C. Heipke, H. Mayer, and O. Jamet. 1998. “Empirical Evaluation of Automatically Extracted Road Axes.” Empirical Evaluation Techniques in Computer Vision 12:172–187.
   Google Scholar
• Xie, X., W. Yang, G. Cao, J. Yang, Z. Zhao, S. Chen, and G. Shi. 2018. “Real-Time Vehicle Detection from UAV Imagery.” In 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM), September, 1–5. Xian: IEEE.
   Google Scholar
• Xu, S., J. Wang, P. Wu, W. Shou, X. Wang, and M. Chen. 2021. “Vision-Based Pavement Marking Detection and Condition Assessment – a Case Study.” Applied Sciences 11 (7): 3152. https://doi.org/10.3390/app11073152.
   Google Scholar
• Xu, Y., G. Yu, Y. Wang, X. Wu, and Y. Ma. 2017. “Car Detection from Low-Altitude UAV Imagery with the Faster R-CNN.” Journal of Advanced Transportation 2017 (1): 2823617.
   Google Scholar
• Yan, L., H. Liu, J. Tan, Z. Li, H. Xie, and C. Chen. 2016. “Scan Line Based Road Marking Extraction from Mobile LiDAR Point Clouds.” Sensors 16 (6): 903. https://doi.org/10.3390/s16060903.
   PubMed Web of Science ®Google Scholar
• Zhang, D., X. Xu, H. Lin, R. Gui, M. Cao, and L. He. 2019. “Automatic Road-Marking Detection and Measurement from Laser-Scanning 3D Profile Data.” Automation in Construction 108:102957. https://doi.org/10.1016/j.autcon.2019.102957.
   Web of Science ®Google Scholar
• Zhang, X., Y. Yuan, and Q. Wang. 2018. “ROI-Wise Reverse Reweighting Network for Road Marking Detection.” In BMVC, 219.
   Google Scholar
• Zhou, H., M. Jalayer, J. Gong, S. Hu, and M. Grinter. 2013. “Investigation of Methods and Approaches for Collecting and Recording Highway Inventory Data.” FHWA-ICT-13-022.
   Google Scholar