Neurofuzzy c-Means Network-Based SCARA Robot for Head Gimbal Assembly (HGA) Circuit Inspection

Kiatwanidvilai, Somyot; Praserttaweelap, Rawinun

doi:https://doi.org/10.1155/2018/4952389

Computational Intelligence and Neuroscience

On this page

Abstract Introduction Experimental Results Conclusion Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Computational Intelligence and Neuroscience in Neurorobotics

View this Special Issue

Research Article | Open Access

Volume 2018 | Article ID 4952389 | https://doi.org/10.1155/2018/4952389

Neurofuzzy c-Means Network-Based SCARA Robot for Head Gimbal Assembly (HGA) Circuit Inspection

Somyot Kiatwanidvilai¹and Rawinun Praserttaweelap¹

Academic Editor: Sergio Decherchi

Received27 Sept 2018

Accepted29 Oct 2018

Published02 Dec 2018

Abstract

Decision and control of SCARA robot in HGA (head gimbal assembly) inspection line is a very challenge issue in hard disk drive (HDD) manufacturing. The HGA circuit called slider FOS is a part of HDD which is used for reading and writing data inside the disk with a very small dimension, i.e., 45 × 64 µm. Accuracy plays an important role in this inspection, and classification of defects is very crucial to assign the action of the SCARA robot. The robot can move the inspected parts into the corresponding boxes, which are divided into 5 groups and those are “Good,” “Bridging,” “Missing,” “Burn,” and “No connection.” A general image processing technique, blob analysis, in conjunction with neurofuzzy c-means (NFC) clustering with branch and bound (BNB) technique to find the best structure in all possible candidates was proposed to increase the performance of the entire robotics system. The results from two clustering techniques which are K-means, Kohonen network, and neurofuzzy c-means were investigated to show the effectiveness of the proposed algorithm. Training results from the 30x microscope inspection with 300 samples show that the best accuracy for clustering is 99.67% achieved from the NFC clustering with the following features: area, moment of inertia, and perimeter, and the testing results show 92.21% accuracy for the conventional Kohonen network. The results exhibit the improvement on the clustering when the neural network was applied. This application is one of the progresses in neurorobotics in industrial applications. This system has been implemented successfully in the HDD production line at Seagate Technology (Thailand) Co. Ltd.

1. Introduction

Robotics and AI especially in neurorobotics play an important role in a number of manufacturing processes because of their fast processing time, good accuracy, intelligence, and high repeatability. In contrary, in the case of manual operation, users must have enough knowledge and experience for working with the processes. The manual operation typically results in inconsistency and cannot control the variations in accuracy and repeatability. Currently, HDD manufacturing processes are under development to be fully autonomous process by the implementation of Artificial Intelligence (AI) into the automation machine to replace the manual process from human. One of the most difficult processes is the visual inspection that has long been performed by experienced operators. The inspection requires many techniques since the human can naturally deal with the complex problem better than the machine. In addition, the decision of inspection based on the apparent image is still a challenging issue for the intelligent machine. To enhance the performance and accuracy of this process, AI techniques such as neural network, fuzzy system, and unsupervised learning are attempted to apply to the manufacturing, particularly in the visual inspection and control of robotics process. In this study, the HGA circuit inspection which is composed of visual inspection, SCARA robot, and classified boxes is developed. This process starts from the load-in of the incoming part, then the assembly process, and outgoing inspection using robot control. Before the development, the outgoing inspection inspects the FOS using the 30x microscope via the human eyes and then manually controls the robot to move the part into the corresponding box. This research aims to develop a neuro-fuzzy-based decision technique for this system to automatically control the SCARA robot for the HGA circuit inspection. Vision Pro program, which is a popular tool in image processing, is adopted as the platform of image processing in this study.

As stated in [1], blob detection is a simple but robust technique which was applied in many research studies such as field-programmable gate array with blob, fingertip blob recognition, and optimization [2, 3]. In our work, the simple blob is utilized as the tool for seeking the image features to apply in the next processes of classification and robot control. In general, the unsupervised learning on clustering techniques was widely adopted in many applications, and these were, for example, K-means clustering, K-means combined with PSO for document clustering [4], K-means and fuzzy c-means for document clustering [5], K-means applied on image clustering on the graphics processing unit (GPU) platform in [6]. As seen in [6], the developed platform could improve the processing time to be faster than the ordinary techniques. In [7], K-means clustering was applied to the map reduction framework, which is a huge data management to find the best value in the application. In [8], weighted least-squares model-based (WLSMB) with K-means was applied to enhance the ability of classification. Kohonen, which is one of the clustering techniques, has been proved in the application for the 3-dimensional data; in addition, the new model with iteration process could further help to improve the result [9]. The Kohonen map approach has been tested in [10] to solve the estimation problem, and the results showed a better performance than the basic belief assignment. One of the most popular clustering techniques is the fuzzy c-means. In terms of data envelopment analysis (DEA), the Kohonen neural network has been applied in [11]. In [12], fuzzy double c-means performed clustering well with different datasets on the data clustering and image segmentation. In medical area, the fuzzy c-means was applied for the magnetic resonance brain imaging [13], and experimental results exhibited the improved performance. In [14], the neurofuzzy c-means clustering algorithm showed the better robustness system on the experiment based on the synthetic datasets with suitable iteration. In the problem of software quality [15], the neurofuzzy c-means was applied to the fault prediction problem. Unsupervised and supervised data were tested on the training process in the model. Probability of detection is the key parameter for performance checking. However, the multiple clustering for new feature finding is required for future work. In terms of technology, the driver vigilance predictions on smartwatch-based driver or smart mobile device using neurofuzzy c-means were tested [16]. This research combined the measurement data from the sensor and clustering data for prediction. Neurofuzzy c-means clustering [17], which applies the Euclidean distance to the clustering technique, was utilized in many applications such as brain tumor in MRI images [18], remote sensing images [19], data clustering with image segmentation [20], and processing time improvement without performance effect [21]. In [22], branch and bound (BNB) was used for cyclic scheduling of timed Petri nets (TPN) based on the manufacturing systems. The speed of solving the block relocation problem [23] was improved by using the branch and bound algorithm. The concept is to minimize the number of necessary relocations; however, it still requires the future work to support the relaxed constraint. Also, BNB was applied in the model selection [24], the hand-eye calibration [25], the nonlinear integer programming with large-scale problem [26], the multiuser in wireless systems [27], and the maximum of weighted sum-rate for interfering links set [28]. All of the aforementioned techniques and applications were successful in the previous scopes. In this paper, a new improved classification technique for HGA circuit inspection using NFC and branch and bound technique are proposed to enhance the accuracy of inspection and increase the production rate. When the classification or groups of inspecting object has been decided, the action to move the SCARA robot will be the next process to transfer the object to the corresponding box.

2. Head Gimbal Assembly

Read and write processes of HDD are occurred from magnetic field changing on the disc. Inside the HDD, it may contain several discs which have a rotational speed during 7,200–15,000 rpm. The summary of the HDD manufacturing process flow is shown in Figure 1. As seen in this figure, the processes of the 30x microscope and slider placing on suspension are the main processes in HDD manufacturing. In addition, HGA is a part of HDD, which holds an electrical circuit inside the slider. Reader, writer, heater, temperature-activated circuits (TA), and microactuator are connected by the electrical circuits. Testing, sorting, and assembly process are the next steps to assemble the HGA stacks.

3. Image Processing and Feature Selection

In the automatic visual inspection system, there are two general sections needed to be considered and those are hardware selection and developing software for image processing techniques. In this study, a well design of image processing hardware has been considered and expected to provide good results for imaging. The field of view is a criterion to choose a camera, depending on the size of the slider and the depth of field (DOF) required. DOF is the minimum and maximum of the distance between the camera lens and the object that can yield clear image. Magnification is calculated by the ratio of camera working area and field of view as follows:

Based on the careful consideration in selecting the hardware devices, camera, lens, and lighting were selected to achieve enough resolution, high sensitivity, and high contrast ratio with the robustness against the environment change. XC-56 with VGA-class resolution (647 × 493) is a monochrome camera module in this research. It was mounted with a lens with C-mounting.

In this process, the threshold value was applied to the image transformation from grayscale image to binary image, and the value was specified based on considering the histogram at the preprocessing. As seen in Figure 2, the threshold value, 148.05, on the histogram can separate the group of pixel clearly to maximize the contrast of the captured image. The general image processing technique, i.e., noise elimination, “closing,” was also applied to the image preprocessing.

(a)

(b)

The feature extraction techniques were applied to find the candidate features on images. In this work, angle, area, inertia, center of mass, acircularity, perimeter, and elongation were determined. Examples of image feature calculation are shown in Equations (2) and (3), and these are area and acircularity, respectively:

To find the best features to be used in the clustering technique, the popular technique, “Branch and Bound (BNB)” was applied. The BNB process starts from the objective function, branches the big problem, and divides it into small group problems. Then, the process analyzes the bound of problem and removes some results, which cannot provide the best results evaluated from the objective function. The process is repeated until finding the best solution.

4. Clustering and the Proposed Technique

Classification is the method to classify data into particular groups by the model construction. All data are separated into 2 sets: training set and validation set. The training set is used for constructing the clustering structure and parameters, while the validation set is used for verifying the performance of the model. There are a number of techniques applied to clustering such as Euclidean distance. In this research, the performance of the proposed technique neuro-fuzzy c-means was investigated in comparison with those from the K-means and Kohonen clustering techniques. The following section describes the brief concept of each clustering technique applied in this research work.

4.1. K-Means Clustering

The K-means clustering technique defines the K value to represent the group member of the cluster, and the centroid value on each cluster is set for initial value. A point that shows the minimum summation distance between members and the centroid will be set as the center of that group. The process will be repeated and calculated to perform the new centroid on each cluster until the centroid value is not changed (convergence). Figure 3 shows the steps of the K-means clustering technique.

The Euclidean distance as shown in (4) is used to calculate the K values and the centroid cluster as shown in (5):where S is the total data point, is the centroid cluster, and is the data point.

4.2. Kohonen Clustering

The Kohonen clustering starts by assigning the weight randomly and defines the learning rate and the dataset. The minimum distance is the winning node, and then, a new weight will represent each cluster. The new weight is calculated using the following equation:where is the new weight matrix, is the current weight matrix, is the n^th data, and is the learning rate. The updating calculation is repeated until the convergence condition is met. The steps of Kohonen mentioned above are shown in Figure 4.

4.3. Neurofuzzy c-Means Clustering

The neurofuzzy c-means clustering starts with an initial value and updates this value until achieving the stopping condition. The objective function in (7) is used for finding the optimal distance value (smallest value):where is the membership function, is the number of data, is the centroid of the clustering, and is the data. The membership function can be calculated from the following equation:

Clustering centers are given by the normalized and defuzzification technique (8):

The steps of the neurofuzzy c-means clustering are shown in Figure 5. As seen in this figure, the objective function has been minimized to achieve the optimal values of the clustering center.

5. System Preparation and Experimental Results

The lighting installation system is applied to illuminate the slider circuit and make the best contrast image of the HGA circuit, as shown in Figure 6. The selected type of lighting technique is the diffusion illumination.

The element on the HGA circuit was made from Au (gold). Since the slider is considered as the curve surface with medium reflection, the diffusion lighting technique was applied on this experiment with the ring light (LED) that is suitable because of its long lifetime, flexible application, and high brightness. Lens and camera selection were done by considering the field of view and depth of field. The HGA circuit area is 45 × 64 µm (280 × 210), and the depth of field is 80 µm. The selected camera is XC-56, having the total pixel as 659 × 464. Thus, the magnification of the lens can be calculated using (1) as

The lens Infinitube FM-75 PL-18 Series with working distance 15 mm was selected. The 5 groups of HGA circuit classification are “good,” “bridging,” “missing,” “burn,” and “no connection” as shown in Figure 7.

(a)

(b)

(c)

(d)

(e)

Cognex Vision Pro Version 7.2 was applied as the image processing tool, and the master image from the Seagate Company is used for training the neurofuzzy c-means for reference searching (Figure 8).

After the above process, the blob tool is used to separate the region of interest (ROI) and the background with the threshold value. As shown in Figure 2, 40% of the pixels are on the left-hand side, and 60% are on the right-hand side, which can effectively be separated by the threshold value. By using this relative threshold value, the vision process robustness is gained when the lighting changes.

After preprocessing and blob exporting, 8 image feature variables, which are area, moment of inertia, perimeter, acircularity, center of mass X, center of mass Y, elongation, and angle, were exported. Figure 9 shows preprocessing to define the ROI and using blob to find the interesting features. The objective function in the proposed technique to be utilized in BNB is shown in the following equation:

Objective function is defined as the percentage of the accuracy when comparing with the results by human eyes classification using the 30x microscope. The event that obtains the best value (highest objective function value) is the best classification structure for this application. Three clustering techniques were applied to the system which are used to calculate the accuracy sets to find the best classification technique and best features. Through the BNB technique with the 3 classification techniques, 8 image features, 5 classification groups, and 300 samples, the optimal centroid values for 5 predefined classification groups were evaluated. The results show the best accuracy of 99.667% by the neurofuzzy c-means clustering. Figure 10 and Table 1 illustrate the details of the results.

Table 1 shows the top 10 of best accuracy and their details.

The best accuracy can be achieved by the NFC technique, and the 3 image feature variables are area, moment of inertia, and perimeter. Clearly, the design using the neurofuzzy c-means achieves the best performance and can be adopted to command the SCARA robot to classify the quality of the product after slider attachment process.

As shown in Figure 11(a), the red circle is the group of “Good,” the blue circle is “Bridging,” the pink circle is “Missing,” the dark blue circle is “Burn,” and the black circle is “No connection.” Figure 11(b) shows the centroid of each group, and Table 2 shows the optimal centroid of each group.

(a)

(b)

In the validation process, the selected variables, which are area, moment of inertia, and perimeter, with NFC clustering were adopted. 300 new samples were tested on this validation process, and 3 visual inspection machines, machine no. 17, no. 23, and no. 101, were used to perform the test to ensure the performance on different machines using the same technique. 100 samples per each machine were tested, and it was found that the accuracy achieved on machine no. 17, 23, and 101 were 100%, 99.21%, and 99.12%, respectively. Clearly, the above results show the accuracy more than 99% (achieved the Seagate’s criteria) for the 3 vision systems, and the technique can be implemented in the actual production line. The example of image construction and real implementation in production line, clustering by NFC, is shown in Figure 12. Also, the SCARA robot in the machine which is used to transfer the slider based on the evaluation results of the NFC is shown in Figure 12(b).

(a)

(b)

6. Conclusion

As shown in the experiment results, the excellent performance with 99.67% accuracy can be achieved from the neurofuzzy c-means clustering with three best features of area, moment of inertia, and perimeter in the training process. The accuracy was investigated by comparing with the results from the 30x microscope inspection using human operations. In the validation process, the accuracy of more than 99% with the 3 different vision systems can be achieved. This confirms that the proposed method can be applied to the inspection of the Head Gimbal Assembly circuit classification. In addition, the command to move the slider works well with the SCARA robot to move the HGA stack to the classified boxes correctly.

Data Availability

The images from the SCARA robot in this article were analyzed in the proposed algorithm which is shown in numerical data as double type. All numerical data are the output from the vision algorithm and tested in the clustering algorithm in the MATLAB program. This research used the image from the SCARA robot for analysis which is included in the article and as supplied by Seagate Technology (Thailand) Co., Ltd. and so cannot be made freely available. Request for access to these data should be made to Veerasak Phana-ngam via mail ([email protected]).

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by the KMITL Research Funds, RRI, Thailand Research Fund, and Seagate Technology (Thailand) Co., Ltd.

References

A. Bochem, R. Herpers, and K. B. Kent, “Hardware acceleration of BLOB detection for image processing,” in Proceedings of 2010 Third International Conference on Advances in Circuits, Electronics and Micro-Electronics, pp. 28–33, Venice, Italy, July 2010.
View at: Google Scholar
P. Pal, S. Vikas, and P. Raju, “Implementation of multiple fingertip blob recognition on image processing based touch-screen for surface computers,” in Proceedings of 2014 5th International Conference of Confluence The Next Generation Information Technology Summit (Confluence), pp. 663–668, Noida, India, November 2014.
View at: Google Scholar
P. C. Ravoor, B. S. Ranjani, and S. R. Rupanagudi, “Optimized fingertip blob recognition for image processing based touch-screens,” in Proceedings of 2012 International Conference on Recent Advances in Computing and Software Systems (RACSS), pp. 104–108, New York, NY, USA, April 2012.
View at: Google Scholar
P. Jaganathan and S. Jaiganesh, “An improved K-means algorithm combined with particle swarm optimization approach for efficient web document clustering,” in Proceedings of 2013 International Conference on Green Computing, Communication and Conservation of Energy (ICGCE), pp. 772–776, Chennai, India, December 2013.
View at: Google Scholar
V. K. Singh, N. Tiwari, and S. Garg, “Document clustering using K-means, heuristic K-means and fuzzy C-means,” in Proceedings of 2011 International Conference on Computational Intelligence and Communication Systems, pp. 297–301, Gwalior, India, October 2011.
View at: Google Scholar
J. Sirotkovic, H. Dujmic, and V. Papic, “K-means image segmentation on massively parallel GPU architecture,” in Proceedings of 35th International Convention MIPRO, pp. 489–494, Opatija, Croatia, May 2012.
View at: Google Scholar
K. D. Garcia and M. C. Naldi, “Multiple parallel mapReduce k-means clustering with validation and selection,” in Proceedings of 2014 Brazilian Conference on Intelligent Systems, pp. 432–437, Sao Paulo, Brazil, October 2014.
View at: Google Scholar
H. Zifen, Z. Zhaolin, and Z. Yinhui, “WLSMB halftoning based on improved K-means cluster algorithm using direct binary search,” in Proceedings of 2013 Fifth Conference on Measuring Technology and Mechatronics Automation, pp. 1310–1313, Hong Kong, China, January 2013.
View at: Google Scholar
S. P. Lim and H. Haron, “Cube Kohonen Self-Organizing Map (CKSOM) model with new equations in organizing unstructured data,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 9, pp. 1414–1424, 2013.
View at: Publisher Site | Google Scholar
I. Hammami, G. Mercier, A. Hamouda, and D. Jean, “Kohonen’s map approach for the belief mass modeling,” IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 10, pp. 2060–2071, 2016.
View at: Publisher Site | Google Scholar
L. A. Alves and J. C. C. B. S. Mello, “Weights based clustering in data envelopment analysis using kohonen neural network: an application in brazilian electrical sector,” IEEE Latin America Transactions, vol. 13, no. 1, pp. 188–194, 2015.
View at: Publisher Site | Google Scholar
J. Gu, L. Jiao, S. Yang, and F. Liu, “Fuzzy double C-means clustering based on sparse self-representation,” IEEE Transactions on Fuzzy Systems, vol. 26, no. 2, pp. 612–626, 2018.
View at: Publisher Site | Google Scholar
A. Namburu, S. K. Samayamantula, and S. R. Edara, “Generalised rough intuitionistic fuzzy c-means for magnetic resonance brain image segmentation,” IET Image Processing, vol. 11, no. 9, pp. 777–785, 2017.
View at: Publisher Site | Google Scholar
K. Zhang, W. Kong, P. Liu et al., “Partition region-based suppressed fuzzy C-means algorithm,” Journal of Systems Engineering and Electronics, vol. 28, no. 5, pp. 996–1008, 2017.
View at: Google Scholar
A. Arshad, S. Riaz, L. Jiao, and A. Murthy, “Semi-supervised deep fuzzy C-mean clustering for software fault prediction,” IEEE Access, vol. 6, pp. 25675–25685, 2018.
View at: Publisher Site | Google Scholar
B. G. Lee, J. H. Park, C. C. Pu, and W. Y. Chung, “Smartwatch-based driver vigilance indicator with kernel-fuzzy-C-means-wavelet method,” IEEE Sensors Journal, vol. 16, no. 1, pp. 242–253, 2016.
View at: Publisher Site | Google Scholar
B. Mohaned, T. Ahmed, H. Lassad, and C. Abdelkader, “A new extension of fuzzy C-means algorithm using non euclidean distance and Kernel methods,” in Proceedings of 2013 International Conference on Control, Decision and Information Technologies (CoDIT), pp. 242–249, Hammamet, Tunisia, May 2013.
View at: Google Scholar
Parveen and A. singh, “Detection of brain tumor in MRI images, using combination of fuzzy C-means and SVM,” in Proceedings of 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN), pp. 98–102, Noida, India, February 2015.
View at: Google Scholar
P. S. S. Aydav and S. Minz, “Generalized fuzzy C-means with spatial information for clustering of remote sensing images,” in Proceedings of 2014 International Conference on Data Mining and Intelligent Computing (ICDMIC), pp. 1–5, New Delhi, India, September 2014.
View at: Google Scholar
B. K. Tripathy, A. Tripathy, and K. G. Rajulu, “Possibilistic rough fuzzy C-means algorithm in data clustering and image segmentation,” in Proceedings of 2014 IEEE International Conference on Computational Intelligent and Computing Research (ICCIC), pp. 1–6, Coimbatore, India, December 2014.
View at: Google Scholar
W. Wang, Y. Zhang, Y. Li, and X. Zhang, “The global fuzzy C-means clustering algorithm,” in Proceedings of 6th World Congress on Intelligent Control and Automation (WCICA), pp. 3604–3607, Dalian, China, January 2006.
View at: Google Scholar
C. Jung, H. J. Kim, and T. E. Lee, “A branch and bound algorithm for cyclic scheduling of timed Petri Nets,” IEEE Transactions on Automation Science and Engineering, vol. 12, no. 1, pp. 309–323, 2014.
View at: Publisher Site | Google Scholar
S. Tanaka and K. Takii, “A faster branch-and-bound algorithm for the block relocation problem,” IEEE Transactions on Automation Science and Engineering, vol. 13, no. 1, pp. 181–190, 2016.
View at: Publisher Site | Google Scholar
N. Thakoor and J. Gao, “Branch and bound for model selection and its computational complexity,” IEEE Transactions on Knowledge and Data Engineering, vol. 23, no. 5, pp. 655–668, 2011.
View at: Publisher Site | Google Scholar
J. Heller, M. Havlena, and T. Pajdla, “Globally optimal hand-eye calibration using branch-and-bound,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 5, pp. 1027–1033, 2016.
View at: Publisher Site | Google Scholar
H. D. Chiang and T. Wang, “A novel TRUST-TECH guided branch-and-bound method for nonlinear integer programming,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 45, no. 10, pp. 1361–1372, 2015.
View at: Publisher Site | Google Scholar
L. T. N. Landau and R. C. de Lamare, “Branch-and-Bound precoding for multiuser MIMO systems with 1-bit quantization,” IEEE Wireless Communications Letters, vol. 6, no. 6, pp. 770–773, 2017.
View at: Publisher Site | Google Scholar
P. C. Weeraddana, M. Codreanu, M. Latva-aho, and A. Ephremides, “Weighted sum-rate maximization for a set of interfering links via branch and bound,” IEEE Transactions on Signal Processing, vol. 59, no. 8, pp. 3977–3996, 2011.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Somyot Kiatwanidvilai and Rawinun Praserttaweelap. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

813

Downloads

1273

Citations