1. School of Computer Science and Engineering, Hebei University of Technology, Tianjin 300401, China;
2. Hebei Provincial Key Laboratory of Big Data Calculation, Tianjin 300401, China
Multiple Feature Fusion and Visualization of Pavement Distress Images Based on Manifold Learning
SHI Lu-kui1,2, ZHOU Hao1, LIU Wen-hao1
1. School of Computer Science and Engineering, Hebei University of Technology, Tianjin 300401, China;
2. Hebei Provincial Key Laboratory of Big Data Calculation, Tianjin 300401, China
摘要For multi-feature fusion in automatic recognition of pavement distress images, we proposed a multi-feature fusion method based on manifold learning. In this method, the intrinsic features of pavement distress images are extracted through mapping the high dimensional data combing projection, mixture density factor and second order moment invariant into the low dimensional space. The multiple features are fused and the visualization of pavement distress images is implemented. In the experiments, we applied the multi-feature fusion method in the detection of pavement distress images. Two-dimensional features are firstly extracted from the 8 combining features, then the recognition effects on the 2D features of 4 methods including ELM, KNN, SVM and BP network are compared. The experiment result shows that the proposed method effectively improved the detection accuracy of pavement distress images. Simultaneously, the physical meaning of the 2D features is obtained through visualizing, one feature preliminary denotes the complexity and damaged extent of the cracks in images, the other describes the direction of the cracks.
Abstract:For multi-feature fusion in automatic recognition of pavement distress images, we proposed a multi-feature fusion method based on manifold learning. In this method, the intrinsic features of pavement distress images are extracted through mapping the high dimensional data combing projection, mixture density factor and second order moment invariant into the low dimensional space. The multiple features are fused and the visualization of pavement distress images is implemented. In the experiments, we applied the multi-feature fusion method in the detection of pavement distress images. Two-dimensional features are firstly extracted from the 8 combining features, then the recognition effects on the 2D features of 4 methods including ELM, KNN, SVM and BP network are compared. The experiment result shows that the proposed method effectively improved the detection accuracy of pavement distress images. Simultaneously, the physical meaning of the 2D features is obtained through visualizing, one feature preliminary denotes the complexity and damaged extent of the cracks in images, the other describes the direction of the cracks.
基金资助:Supported by the Tianjin Research Project of Application Foundation and Advanced Technology of China (No. 14JCZDJC31600);the Natural Science Foundation of Hebei Province of China (No. F2016202144).
通讯作者:
SHI Lu-kui,E-mail address:shilukui@scse.hebut.edu.cn
E-mail: shilukui@scse.hebut.edu.cn
引用本文:
石陆魁, 周浩, 刘文浩. 基于流行学习的路面破损图像多特征融合与可视化[J]. Journal of Highway and Transportation Research and Development, 2017, 11(1): 14-22.
SHI Lu-kui, ZHOU Hao, LIU Wen-hao. Multiple Feature Fusion and Visualization of Pavement Distress Images Based on Manifold Learning. Journal of Highway and Transportation Research and Development, 2017, 11(1): 14-22.
[1] CHU Xiu-min, WANG Rong-ben, CHU Jiang-wei, et al. Asphalt Pavement Surface Distress Image Recognition Based on Moment Invariant Feature[J]. Journal of Jilin University:Engineering and Technology Edition, 2003,33(1):1-7. (in Chinese)
[2] XIAO Wang-xin, YAN Xin-ping, ZHANG Xue. Research on the Automatic Pavement Distress Recognition Based on Synthetical Distress Density Factor[J]. Journal of Transportation Engineering and Information, 2005, 3(2):19-26. (in Chinese)
[3] YING L, SALARI E. Beamlet Transform-Based Technique for Pavement Crack Detection and Classification[J]. Computer-Aided Civil and Infrastructure Engineering, 2010, 25(8):572-580.
[4] FUJITA Y, HAMAMOTO Y. A Robust Automatic Crack Detection Method from Noisy Concrete Surfaces[J]. Machine Vision and Applications, 2011, 22(2):245-254.
[5] NEJAD F M, ZAKERI H. An Expert System Based on Wavelet Transform and Radon Neural Network for Pavement Distress Classification[J]. Expert Systems with Applications, 2011, 38(6):7088-7101.
[6] YU Yong-bo, LI Wan-heng, ZHANG Jin-quan, et al. Bridge Cracks Extraction Method Based on Image Connection Domain[J]. Journal of Highway and Transportation Research and Development, 2011, 28(7):90-93. (in Chinese)
[7] MA Rong-gui, XU Kun, LIU Fei-fei. Highway Surface Crack Images Identifying Algorithm[J]. Journal of Transport Information and Safety, 2014, 32(2):90-94. (in Chinese)
[8] RONG Jing, PAN Yu-li. Digital Image Based Crack Detection of Grooved Cement Concrete Pavement[J]. Journal of Highway and Transportation Research and Development, 2012,29(3):45-50. (in Chinese)
[9] OLIVEIRA H, CORREIA P L. Automatic Road Crack Detection and Characterization[J]. IEEE Transactions on Intelligent Transportation Systems, 2013, 14(1):155-168.
[10] SHEN Zhao-qing, PENG Yu-hua, SHU Ning. A Road Damage Identification Method Based on Scale-span Image and SVM[J]. Geomatics and Information Science of Wuhan University, 2013, 38(8):993-997. (in Chinese)
[11] SUN Chao-yun, ZHAO Hai-wei, LI Wei, et al. 3D Pavement Crack Identification Method Based on Dual-phase Scanning Detection[J]. China Journal of Highway and Transport, 2015, 28(2):26-32. (in Chinese)
[12] HUANG G B, ZHOU H, DING X, et al. Extreme Learning Machine for Regression and Multiclass Classification[J]. IEEE Transactions on Systems, Man & Cybernetics Part B:Cybernetics, 2012, 42(2):513-529.
[13] ZUO Y X, WANG G Q, ZUO C C. The Segmentation Algorithm for Pavement Cracking Images Based on the Improved Fuzzy Clustering[J]. Applied Mechanics and Materials, 2013, 319:362-366.
[14] RADUCANU B, DORNAIKA F. A Supervised Non-linear Dimensionality Reduction Approach for Manifold Learning[J]. Pattern Recognition, 2012, 45(6):2432-2444.
[15] SUN B Y, ZHANG X M, LI J, et al. Feature Fusion Using Locally Linear Embedding for Classification[J]. IEEE Transactions on Neural Networks, 2010, 21(1):163-168.
[16] HU Jian-zhong, WU Yao, XIE Xiao-xin. A Method for Fault Recognition Based on LLE Feature Fusion[J]. China Mechanical Engineering, 2013, 24(24):3345-3348. (in Chinese)
[17] CRIMINISI A, SHOTTON J, KONUKOGLU E. Decision Forests:A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning[J]. Foundations and Trends in Computer Graphics and Vision, 2012, 7(2/3):81-227.
[18] TENENBAUM J B, DE SILVA V, LANGFORD J C. A Global Geometric Framework for Nonlinear Dimensionality Reduction[J]. Science, 2000, 290(5500):2319-2323.
[19] ROWEIS S T, SAUL L K. Nonlinear Dimensionality Reduction by Locally Linear Embedding[J]. Science, 2000, 290(5500):2323-2326.
[20] BELKIN M, NIYOGI P. Laplacian Eigenmaps for Dimensionality Reduction and Data Representation[J]. Neural Computation, 2003, 15(6):1373-1396.
[21] ZHANG Z Y, ZHA H Y. Principal Manifolds and Nonlinear Dimensionality Reduction via Local Tangent Space Alignment[J]. Journal of Shanghai University, 2004, 26(4):406-424.
[22] XIAO Wang-xin, ZHANG Xue, HUANG Wei, et al. One New Algorithm of Automatic Classification for Pavement Distress[J]. Journal of Highway and Transportation Research and Development, 2005, 22(11):75-78. (in Chinese)
[23] LIU Guo-hai, JIANG Zhi-jia. Recognition of Porcelain Bottle Crack Based on Modified ART-2 Network and Invariant Moment[J]. Chinese Journal of Scientific Instrument, 2009, 30(7):1420-1425.(in Chinese)
[1]
李宁, 马骉, 李瑞, 司伟. 基于PUMA的单级和多级加载模式下级配碎石性能研究[J]. Journal of Highway and Transportation Research and Development, 2019, 13(2): 1-12.
[2]
许海亮, 任合欢, 何兆才, 何炼. 车路耦合条件下沥青混凝土路面变形特性时域分析[J]. Journal of Highway and Transportation Research and Development, 2019, 13(2): 13-19.
[3]
杜健欢, 艾长发, 黄超, 郭玉金, 蒋运兵. 界面水对沥青复合小梁疲劳性能的影响试验[J]. Journal of Highway and Transportation Research and Development, 2019, 13(1): 1-7.
[4]
姚国强, 言志信, 龙哲, 翟聚云. 基于岩质边坡相似材料的锚固界面剪应力分布规律研究[J]. Journal of Highway and Transportation Research and Development, 2019, 13(1): 8-15.
[5]
刘泽, 何矾, 黄天棋, 蒋梅东. 车辆荷载在挡土墙上引起的附加土压力研究[J]. Journal of Highway and Transportation Research and Development, 2019, 13(1): 16-23.
[6]
邱欣, 徐静娴, 陶钰强, 杨青. 路面结冰条件判别标准及SVM预测分析研究[J]. Journal of Highway and Transportation Research and Development, 2018, 12(4): 1-9.
[7]
高伟, 崔巍, 李秀凤. 半刚性基层表面抗冲刷性能试验与分析[J]. Journal of Highway and Transportation Research and Development, 2018, 12(4): 10-17.
[8]
张向东, 任昆. 煤渣改良土路基的动弹性模量及临界动应力试验研究[J]. Journal of Highway and Transportation Research and Development, 2018, 12(4): 25-32.
[9]
刘栋, 尚小亮, 杨西海. 垃圾焚烧炉渣中可溶盐对水泥稳定材料性能的影响[J]. Journal of Highway and Transportation Research and Development, 2018, 12(4): 18-24.
[10]
李龙海, 杨茹. 多次加铺的复合道面疲劳寿命分析[J]. Journal of Highway and Transportation Research and Development, 2018, 12(3): 7-15.
[11]
蔡旭, 李翔, 吴旷怀, 黄文柯. 基于旋转压实的水泥稳定再生集料设计方法研究[J]. Journal of Highway and Transportation Research and Development, 2018, 12(3): 1-6.
[12]
李金路, 冯子强, 吴佳杰, 魏姗姗, 葛智. 环境及疲劳荷载作用下碳纳米管水泥基复合材料压敏性能研究[J]. Journal of Highway and Transportation Research and Development, 2018, 12(3): 16-21.
[13]
田小革, 韩海峰, 李新伟, 吴栋, 魏东. 半刚性路面中双层半刚性基层的倒装效应[J]. Journal of Highway and Transportation Research and Development, 2018, 12(3): 22-27.
[14]
邢磊, 雷柏龄, 陈忠达, 戴学臻. 彩色沥青路面胶凝材料的制备技术[J]. Journal of Highway and Transportation Research and Development, 2018, 12(2): 1-6.
[15]
方薇, 陈向阳, 杨果林. 带齿格栅加筋挡墙工作机理的数值模拟研究[J]. Journal of Highway and Transportation Research and Development, 2018, 12(2): 7-13.