Table of Contents Author Guidelines Submit a Manuscript
International Journal of Aerospace Engineering
Volume 2019, Article ID 5137139, 14 pages
https://doi.org/10.1155/2019/5137139
Research Article

Visual Inspection of the Aircraft Surface Using a Teleoperated Reconfigurable Climbing Robot and Enhanced Deep Learning Technique

1Singapore University of Technology and Design, Singapore 487372
2Department of Engineering and Technology, Universidad de Occidente, Campus Los Mochis, 81223, Mexico
3Department of Computer Science, Birla Institute of Technology and Science (BITS) Pilani, Pilani Campus, 333031, Vidyavihar, Rajasthan, India
4Department of Electrical Engineering, UET Lahore, NWL Campus 54890, Pakistan
5ST Engineering Aerospace, ST Engineering, Singapore 539938

Correspondence should be addressed to Mohan Rajesh Elara; gs.ude.dtus@aralehsejar

Received 30 January 2019; Revised 30 May 2019; Accepted 23 July 2019; Published 12 September 2019

Academic Editor: Antonio Concilio

Copyright © 2019 Balakrishnan Ramalingam et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. Civil Aviation Safety Authority Australia, Airworthiness Bulletin, 2019, January 2019, https://www.casa.gov.au/files/awb-indexpdf.
  2. J. Komorowski, D. Forsyth, D. Simpson, and R. Gould, “Probability of detection of corrosion in aircraft structures,” in RTO AVT workshop–airframe inspection reliability under field/depot conditions, vol. 10, Brussels, Belgium, May 1998.
  3. P. Gunatilake, M. Siegel, A. G. Jordan, and G. W. Podnar, “Image enhancement and understanding for remote visual inspection of aircraft surface,” in Proc. SPIE 2945, Nondestructive Evaluation of Aging Aircraft, Airports, and Aerospace Hardware, Scottsdale, AZ, USA, November 1996. View at Publisher · View at Google Scholar
  4. M. Siegel and P. Gunatilake, “Remote enhanced visual inspection of aircraft by a mobile robot,” in Proc. of the 1998 IEEE Workshop on Emerging Technologies, Intelligent Measurement and Virtual Systems for Instrumentation and Measurement (ETIMVIS98), pp. 49–58, St. Paul, MN, USA, 1998.
  5. I. Jovaňcevíc, S. Larnier, J.-J. Orteu, and T. Sentenac, “Automated exterior inspection of an aircraft with a pan-tilt-zoom camera mounted on a mobile robot,” Journal of Electronic Imaging, vol. 24, no. 6, article 061110, 2015. View at Publisher · View at Google Scholar · View at Scopus
  6. P. Gunatilake, M. Siegel, A. G. Jordan, and G. W. Podnar, “Image understanding algorithms for remote visual inspection of aircraft surfaces,” in Proc. SPIE 3029, Machine Vision Applications in Industrial Inspection V, pp. 2–14, San Jose, CA, USA, April 1997. View at Publisher · View at Google Scholar
  7. M. Siegel, P. Gunatilake, and G. Podnar, “Robotic assistants for aircraft inspectors,” IEEE Instrumentation & Measurement Magazine, vol. 1, no. 1, pp. 16–30, 1998. View at Publisher · View at Google Scholar · View at Scopus
  8. B. Chu, K. Jung, C.-S. Han, and D. Hong, “A survey of climbing robots: locomotion and adhesion,” International Journal of Precision Engineering and Manufacturing, vol. 11, no. 4, pp. 633–647, 2010. View at Publisher · View at Google Scholar · View at Scopus
  9. A. F. R. Laboratory, Robotic arm tool poised to save costly inspection time, International Journal of Precision Engineering and Manufacturing, December 2018, https://www.afspc.af.mil/News/Article-Display/Article/1088209/robotic-arm-tool-poised-to-save-costly-inspection-time/.
  10. X. Zhiwei, C. Muhua, and G. Qingji, “The structure and defects recognition algorithm of an aircraft surface defects inspection robot,” in 2009 International Conference on Information and Automation, pp. 740–745, Zhuhai, Macau, China, June 2009. View at Publisher · View at Google Scholar · View at Scopus
  11. C. Menon, M. Murphy, and M. Sitti, “Gecko inspired surface climbing robots,” in 2004 IEEE International Conference on Robotics and Biomimetics, pp. 431–436, Shenyang, China, August 2004. View at Publisher · View at Google Scholar
  12. R. Lal Tummala, R. Mukherjee, Ning Xi et al., “Climbing the walls [robots],” IEEE Robotics and Automation Magazine, vol. 9, no. 4, pp. 10–19, 2002. View at Publisher · View at Google Scholar · View at Scopus
  13. S. Nansai and R. E. Mohan, “A survey of wall climbing robots: recent advances and challenges,” Robotics, vol. 5, no. 3, p. 14, 2016. View at Publisher · View at Google Scholar · View at Scopus
  14. J. Yuan, X. Wu, Y. Kang, and A. Ben, “Research on reconfigurable robot technology for cable maintenance of cable-stayed bridges in-service,” in 2010 International Conference on Mechanic Automation and Control Engineering, pp. 1019–1022, Wuhan, China, June 2010. View at Publisher · View at Google Scholar · View at Scopus
  15. A. C. C. de Sousa, D. M. Viana, and C. M. C. e Cavalcante Koike, “Sensors in reconfigurable modular robot for pipeline inspection: design and tests of a prototype,” in 2014 Joint Conference on Robotics: SBR-LARS Robotics Symposium and Robocontrol, pp. 7–12, Sao Carlos, Brazil, October 2014. View at Publisher · View at Google Scholar · View at Scopus
  16. M. R. Jahanshahi, W.-M. Shen, T. G. Mondal, M. Abdelbarr, S. F. Masri, and U. A. Qidwai, “Reconfigurable swarm robots for structural health monitoring: a brief review,” International Journal of Intelligent Robotics and Applications, vol. 1, no. 3, pp. 287–305, 2017. View at Publisher · View at Google Scholar
  17. V. Prabakaran, M. R. Elara, T. Pathmakumar, and S. Nansai, “htetro: A tetris inspired shape shifting floor cleaning robot,” in 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 6105–6112, Singapore, Singapore, May-June 2017. View at Publisher · View at Google Scholar · View at Scopus
  18. M. Ilyas, S. Yuyao, R. E. Mohan, M. Devarassu, and M. Kalimuthu, “Design of sTetro: a modular, reconfigurable, and autonomous staircase cleaning robot,” Journal of Sensors, vol. 2018, Article ID 8190802, 16 pages, 2018. View at Publisher · View at Google Scholar · View at Scopus
  19. M. Yim, K. Roufas, D. Duff, Y. Zhang, C. Eldershaw, and S. Homans, “Modular reconfigurable robots in space applications,” Autonomous Robots, vol. 14, no. 2/3, pp. 225–237, 2003. View at Publisher · View at Google Scholar · View at Scopus
  20. Y.-S. Kwon, E.-J. Jung, H. Lim, and B.-J. Yi, “Design of a reconfigurable indoor pipeline inspection robot,” in 2007 International Conference on Control, Automation and Systems, pp. 712–716, Seoul, South Korea, October 2007. View at Publisher · View at Google Scholar · View at Scopus
  21. A. Le, V. Prabakaran, V. Sivanantham, and R. Mohan, “Modified a-star algorithm for efficient coverage path planning in tetris inspired self-reconfigurable robot with integrated laser sensor,” Sensors, vol. 18, no. 8, p. 2585, 2018. View at Publisher · View at Google Scholar · View at Scopus
  22. A. Le, M. Arunmozhi, P. Veerajagadheswar et al., “Complete path planning for a tetris-inspired self-reconfigurable robot by the genetic algorithm of the traveling salesman problem,” Electronics, vol. 7, no. 12, p. 344, 2018. View at Publisher · View at Google Scholar · View at Scopus
  23. R. Mumtaz, M. Mumtaz, A. B. Mansoor, and H. Masood, “Computer aided visual inspection of aircraft surfaces,” International Journal of Image Processing, vol. 6, no. 1, pp. 38–53, 2012. View at Google Scholar
  24. M. Rice, L. Li, G. Ying et al., Automating the visual inspection of aircraft, https://oar.a-star.edu.sg/jspui/handle/123456789/2336.
  25. A. Ortiz, F. Bonnin-Pascual, E. Garcia-Fidalgo, and J. Company-Corcoles, “Vision-based corrosion detection assisted by a micro-aerial vehicle in a vessel inspection application,” Sensors, vol. 16, no. 12, article 2118, 2016. View at Publisher · View at Google Scholar · View at Scopus
  26. Y. Li, H. Huang, Q. Xie, L. Yao, and Q. Chen, “Research on a surface defect detection algorithm based on MobileNet-SSD,” Applied Sciences, vol. 8, no. 9, article 1678, 2018. View at Publisher · View at Google Scholar · View at Scopus
  27. T. Malekzadeh, M. Abdollahzadeh, H. Nejati, and N.-M. Cheung, “Aircraft fuselage defect detection using deep neural networks,” http://arxiv.org/abs/1712.09213.
  28. X. Tao, D. Zhang, W. Ma, X. Liu, and D. Xu, “Automatic metallic surface defect detection and recognition with convolutional neural networks,” Applied Sciences, vol. 8, no. 9, article 1575, 2018. View at Publisher · View at Google Scholar · View at Scopus
  29. Y.-J. Cha, W. Choi, G. Suh, S. Mahmoudkhani, and O. Büyüköztürk, “Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types,” Computer-Aided Civil and Infrastructure Engineering, vol. 33, no. 9, pp. 731–747, 2018. View at Publisher · View at Google Scholar · View at Scopus
  30. B. Kim and S. Cho, “Automated vision-based detection of cracks on concrete surfaces using a deep learning technique,” Sensors, vol. 18, no. 10, article 3452, 2018. View at Publisher · View at Google Scholar · View at Scopus
  31. R. Zhang, Z. Wang, and Y. Zhang, “Astronaut visual tracking of flying assistant robot in space station based on deep learning and probabilistic model,” International Journal of Aerospace Engineering, vol. 2018, Article ID 6357185, 17 pages, 2018. View at Publisher · View at Google Scholar · View at Scopus
  32. Y.-J. Cha and W. Choi, “Vision-based concrete crack detection using a convolutional neural network,” in Dynamics of Civil Structures, Volume 2, J. Caicedo and S. Pakzad, Eds., Conference Proceedings of the Society for Experimental Mechanics Series, pp. 71–73, Springer International Publishing, Cham, 2017. View at Publisher · View at Google Scholar · View at Scopus
  33. S. Deitsch, V. Christlein, S. Berger et al., “Automatic classification of defective photovoltaic module cells in electroluminescence images,” CoRR abs/1807.02894. http://arxiv.org/abs/1807.02894.
  34. B. Ramalingam, A. Lakshmanan, M. Ilyas, A. le, and M. Elara, “Cascaded machine-learning technique for debris classification in floor-cleaning robot application,” Applied Sciences, vol. 8, no. 12, article 2649. View at Publisher · View at Google Scholar · View at Scopus
  35. D. Kang and Y.-J. Cha, “Damage detection with an autonomous uav using deep learning,” in Proc. SPIE 10598, Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2018, Denver, Colorado, USA, March 2018. View at Publisher · View at Google Scholar · View at Scopus
  36. D. Kang and Y.-J. Cha, “Autonomous UAVs for structural health monitoring using deep learning and an ultrasonic beacon system with geo-tagging,” Computer-Aided Civil and Infrastructure Engineering, vol. 33, no. 10, pp. 885–902, 2018. View at Publisher · View at Google Scholar · View at Scopus
  37. R. Qian, Q. Liu, Y. Yue, F. Coenen, and B. Zhang, “Road surface traffic sign detection with hybrid region proposal and fast r-cnn,” in 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), pp. 555–559, Changsha, China, August 2016. View at Publisher · View at Google Scholar · View at Scopus
  38. W. Brendel and M. Bethge, “Approximating CNNs with bag-of-local-features models works surprisingly well on ImageNet,” International conference on learning representations, 2019, https://openreview.net/forum?id=SkfMWhAqYQ. View at Google Scholar
  39. M. Siegel and P. Gunatilake, Robotic Enhanced Visual Inspection of Aircraft Skin, p. 530, 1999, http://www.academia.edu/download/6154878/10.1.1.172.9886.pdf.
  40. W. M. K. C. J. P. C. J. Alberts, C. W. Carroll, and M. W. Siegel, Automated inspection of aircraft, December 2018, http://www.tc.faa.gov/its/worldpac/techrpt/ar97-69.pdf.
  41. J. Shang, T. Sattar, S. Chen, and B. Bridge, “Design of a climbing robot for inspecting aircraft wings and fuselage,” Industrial Robot: An International Journal, vol. 34, no. 6, pp. 495–502, 2007. View at Publisher · View at Google Scholar · View at Scopus
  42. A. G. Howard, M. Zhu, B. Chen et al., “MobileNets: efficient convolutional neural networks for mobile vision applications,” http://arxiv.org/abs/1704.04861.
  43. W. Liu, D. Anguelov, D. Erhan et al., “SSD: single shot multibox detector,” in Computer Vision – ECCV 2016. ECCV 2016, B. Leibe, J. Matas, N. Sebe, and M. Welling, Eds., vol. 9905 of Lecture Notes in Computer Science, pp. 21–37, Springer, Cham, 2016. View at Publisher · View at Google Scholar · View at Scopus
  44. T. Tieleman and G. Hinton, Lecture 6.5-rmsprop, coursera: neural networks for machine learning, University of Toronto, Technical Report.
  45. M. Siegel and P. Gunatilake, “Enhanced remote visual inspection of aircraft skin,” in Proc. Intelligent NDE Sciences for Aging and Futuristic Aircraft Workshop, pp. 101–112, Citeseer, 1997. View at Google Scholar
  46. H. Shakhatreh, A. H. Sawalmeh, A. al-Fuqaha et al., “Unmanned Aerial Vehicles (UAVs): a survey on civil applications and key research challenges,” IEEE Access, vol. 7, pp. 48572–48634, 2019. View at Publisher · View at Google Scholar