Automatic Detection of Horner Syndrome by Using Facial Images

Fan, Jingyuan; Qin, Bengang; Gu, Fanbin; Wang, Zhaoyang; Liu, Xiaolin; Zhu, Qingtang; Yang, Jiantao

doi:https://doi.org/10.1155/2022/8670350

Journal of Healthcare Engineering

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusions Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2022 | Article ID 8670350 | https://doi.org/10.1155/2022/8670350

Automatic Detection of Horner Syndrome by Using Facial Images

Jingyuan Fan,¹Bengang Qin,^1,2,3Fanbin Gu,¹Zhaoyang Wang,¹Xiaolin Liu,^1,2,3Qingtang Zhu ,^1,2,3and Jiantao Yang^1,2,3

Academic Editor: Mehdi Gheisari

Received20 Jun 2022

Revised14 Oct 2022

Accepted19 Oct 2022

Published21 Nov 2022

Abstract

Horner syndrome is a clinical constellation that presents with miosis, ptosis, and facial anhidrosis. It is important as a warning sign of the damaged oculosympathetic chain, potentially with serious causes. However, the diagnosis of Horner syndrome is operator dependent and subjective. This study aims to present an objective method that can recognize Horner sign from facial photos and verify its accuracy. A total of 173 images were collected, annotated, and divided into training and testing groups. Two types of classifiers were trained (two-stage classifier and one-stage classifier). The two-stage method utilized the MediaPipe face mesh to estimate the coordinates of landmarks and generate facial geometric features accordingly. Then, ten machine learning classifiers were trained based on this. The one-stage classifier was trained based on one of the latest algorithms, YOLO v5. The performance of the classifier was evaluated by the diagnosis accuracy, sensitivity, and specificity. For the two-stage model, the MediaPipe successfully detected 92.2% of images in the testing group, and the Decision Tree Classifier presented the highest accuracy (0.790). The sensitivity and specificity of this classifier were 0.432 and 0.970, respectively. As for the one-stage classifier, the accuracy, sensitivity, and specificity were 0.65, 0.51, and 0.84, respectively. The results of this study proved the possibility of automatic detection of Horner syndrome from images. This tool could work as a second advisor for neurologists by reducing subjectivity and increasing accuracy in diagnosing Horner syndrome.

1. Introduction

Horner syndrome is a clinical constellation of signs and symptoms, typically consisting of the triad of miosis, ptosis, and facial anhidrosis. This syndrome was first comprehensively described by a Swiss ophthalmologist named Johann Friedrich Horner in 1869 [1]. Horner syndrome occurs when the sympathetic innervation of the eye is interrupted. Because of the long, circuitous anatomical pathway of the oculosympathetic efferent chain, the cause of Horner syndrome could be various. As the literature reported, Horner syndrome often does not have an identifiable cause, but 35%–60% cases of Horner syndrome were associated with neoplasms [2]. Considering the potentially life-threatening event, researchers recommended taking this syndrome as a “red flag” warning and deserving sufficient attention from all clinicians [3]. However, the diagnosis of Horner syndrome is often challenging due to the inconsistency of symptoms [3]. In addition, although the diagnosis could be improved by using clinical history, physical examination, and pharmacologic testing, it is still operator-dependent because of the subjectivity of pupillometry. Therefore, an objective diagnostic tool might be beneficial to clinicians.

Computer version methods have been widely applied to process medical images for providing object predictions in these years. Recent studies have achieved outstanding accuracy in the classification of skin lesions from dermoscopic images [4], malignancy detection on mammography [5], the diagnosis of acute lymphoblastic leukemia [6], the detection of retinopathy in retinal fundus photographs [7], as well as the detection of COVID-19 from CT scans [8, 9] and X-ray images [10]. However, this technique is rarely used to detect clinical signs, such as the Horner sign.

This study presents an objective method for detecting Horner syndrome from face images. Here, we proposed two methods for this task: the two-stage and the one-stage methods. The two-stage method contained two steps: the first step was landmark extraction by MediaPipe face mesh [11], and the second step was the construction of conventional machine learning classifiers. The one-stage method transferred Horner syndrome recognition into an object detection task that can directly recognize Horner syndrome from facial photos. Here, we utilized one of the latest and most powerful algorithms in this field, YOLO v5 [12], which can carry out regional proposal and classification simultaneously for this task. Our method may provide a possibility for the detection of Horner syndrome. These classifiers could act as reliable assistants for neurologists in the near future.

2. Materials and Methods

2.1. Data Sources

Our dataset was acquired from the image dataset of patients with brachial plexus injury in our department. The acquisition was performed following relevant regulations and proved by the ethics committee of our institution. Images that fulfilled the following criteria were as follows: (1) images containing both eyes and at least 2/3 face of the subject; (2) images shot in sufficient light and had an adequate resolution for pupil observation. The exclusion criteria were as follows: (1) the face in the image had apparent tilt or rotation; (2) images contained more than one person. The whole process of this study is illustrated by a flow chart (Figure 1).

2.2. Annotation Procedure

Image annotation greatly influences the quality of the dataset, which could impact the accuracy of the final model. For that, we had two experts with 14 and 26 years of experience, respectively, to label the data together. Images and necessary information, including case history and EMG and MRI scan results, were provided to them to get a precise diagnosis. The label was obtained on the consensus of the two experts. In cases with conflict, they thoroughly re-evaluated and discussed to reach a final diagnosis. The image would be excluded if the agreement cannot be reached after reviewing all available information.

2.3. Dataset Splitting

The images in the dataset were randomly split into two parts: the training set and the testing set. The splitting scheme was 75/25. The training set was used to train and validate the model, while the testing set was used to evaluate the model’s performance.

2.4. Data Augmentation

To overcome the issue of insufficient training data and increase the robustness of the model, we applied data augmentation by using the albumentations library [13]. Images were expanded by ten times after adding Gaussian and multiplicative noise, RGB shifting, contract/brightness/scale changes, flipping, and cropping.

2.5. Model Construction

2.5.1. Two-Stage Detection Classifier

The two-stage detection classifier contained two main steps. The first step was extracting facial landmarks and the second was the construction of machine learning classifiers using the extracted features. In this work, we used the facial landmark detector from the MediaPipe library [11] to generate landmarks on the face images. This model is able to output the 3D position of 468 face landmarks from an image, containing information on various facial areas such as the cheeks, forehead, mouth, and eyes. Considering Horner signs mainly influence the appearance of the eyes and the periocular regions, we selected 32 landmarks to generate geometric features for the classifier. To represent the geometric features efficiently, we converted the coordinates of landmarks to distances between points and angles between edges. A total of 22 (11 for each side) parameters were selected to characterize the geometric features of the interest area (shown in Figure 2). Each parameter was estimated in two manners (the MediaPipe face mesh could estimate the coordinate of landmarks in both 2-dimension and 3-dimension manners). Then, to eliminate individual differences, we generated ratios of these parameters between the left and right sides. All the ratios were calculated by dividing the smaller value into the larger value to prevent the effect caused by the side.

After data standardization, we performed feature decomposition using principal component analysis (PCA). Then, the features were fed to classifiers. In this work, logistic regression, K-neighbors, decision tree, support vector machine (SVM), Bernoulli naïve Bayes, Random Forest, GradinetBoosting, AdaBoost, Light GBM, and XgBoost were used for classification. The grid-search method [14] was used to identify the optimal hyperparameters and structure of the classifier. In addition, the five-fold cross-validation was also employed to assess the combination of hyperparameters to avoid overfitting. In this procedure, the training set was further split into five subsets. Four subsets were used to train the classifier, while the remaining one was used to validate the accuracy. The optimal configurations in this stage were applied in the testing set.

2.5.2. One-Stage Detection Classifier

YOLO (you only look once) family is one of the most powerful and fastest deep learning object detection algorithms. Unlike the other object detection techniques that send multiple patches to the classifier, the YOLOs send the whole image to a single convolutional neural network (CNN). This CNN predicted the bounding box, as well as the class possibilities at the same time. It was first presented by Redmon et al. in 2016 [15]. In this study, we utilized the latest version, YOLO v5 [12], to detect Horner syndrome. The region of interest (ROI) was the portion of the image containing the eyes and periocular areas. Since the data were insufficient in this work, we chose to freeze the convolution layers and retrain the fully connected layer rather than start from scratch. The pretraining weights (yolov5s) were used as the initial weights. The YOLO classifier was trained through 2000 epochs, with a batch size of 32, a learning rate of 0.01, a weight decay of 0.005, and a momentum of 0.937.

2.6. Model Evaluation

The performance of the classifier was evaluated by assessing the diagnosis accuracy, sensitivity, and specificity. The receiver operating characteristic (ROC) curve was used to illustrate the capacity of two-stage classifiers. The precision-recall curve with mean average precision at IoU (Intersection-Over-Union) = 0.5 ([email protected]) was used to show the performance of the one-stage classifier. In addition, confusion matrices were employed to present whether the predictions of classifiers were discordant with the gold standard.

2.7. Statistical Analysis

Experiments were performed on three Intel(R) Xeon(R) CPUs with 8 GB RAM and a NVIDIA RTX 3090 GPU with 24 GB RAM. Python 3.7 was used as the development environment. OpenCV was used for image preprocessing, and albumentations was used for data augmentation. The MediaPipe library was used for facial landmarks extraction. Scikit-learn was used for constructing the machine learning classifiers and compute the evaluation metrics. NumPy, Pandas, OS, and Matplotlib were also used in this procedure.

3. Results

3.1. Clinical Characteristics

In total, 173 images of patients were collected in our dataset. Sixty-nine images of patients were diagnosed with Horner (+), while the remaining ones were Horner (−). The included images were split into training and testing sets, then the data augmentation was performed. The training and testing sets had 1350 (510 positives and 840 negatives) and 380 (140 positives and 240 negatives) images, respectively. The resolution of included images ranged from 455837 to 28484288.

3.2. Descriptive Statistics of Extracted Features

With a minimum detection confidence of 0.7, the MediaPipe face mesh failed to detect human faces in 40 and 27 images in the training and testing sets. Therefore, only 1310 images (478 positives and 832 negatives) were entered into feature extraction, and 353 images (118 positives and 235 negatives) were used for model evaluation. The detection rate was 97.03% and 92.9%, respectively. Then, the ratios of selected geometric features were calculated (shown in Figure 2). The distribution of data in training and testing sets is summarized in Table 1. Principal component analysis identified 11 components that explained 98.22 percent of the variance between the positive and negative cases (Figure 3(a)). The composition of each principal component is presented in Figure 3(b). The optimal hyperparameters of each classifier were identified by the grid-search method and shown in Table 2.

All the features were presented as ratio, and the generation process is shown in the methods’ part. sd: standard deviation.

3.3. Model Performance

3.3.1. Two-Stage Classifier

The performances of the machine learning classifiers are sorted from high to low according to the prediction accuracy (shown in Table 3). The decision tree classifier held the highest accuracy (0.790), followed by KNN, XgBoost, gradient boost classifier, logistic regression, support vector classifier, LGBM, random forest classifier, AdaBoost classifier, and Bernoulli NB. The sensitivity, specificity, positive predictive value, and negative predictive value are also presented in Table 3. Confusion matrices in Figure 3(c) present the number of true positive, false positive, true negative, and false negative. In addition, the visual comparison between the classifier was also generated by using the receiver operating characteristic curve (Figure 3(d)). The gradient boost classifier produced the highest AUC (0.830), while the decision tree classifier produced the lowest (0.628).

3.3.2. One-Stage Classifier

The performance of the one-stage classifier was summarized in Figure 4(a), which shows the change of accuracy and losses during the training process. The accuracy, sensitivity, and specificity of the classifier were 0.65, 0.51, and 0.84, respectively. The classification performance of this classifier was also presented by the confusion matrix (Figure 4(b)) and the precision-recall curve (Figure 4(c)). The average precision of negative, positive, and all classes were 0.702, 0.838, and 0.770, respectively.

(a)

(b)

(c)

4. Discussion

This work presented two approaches for automatic Horner syndrome detection from facial images. The two-stage method integrated an automatic face landmark generator MediaPipe with machine learning classifiers. The one-stage method utilized an object detection algorithm, YOLO v5. Both methods achieved adequate accuracy in this task. To the best of our knowledge, this is the first study trying to detect Horner syndrome automatically, and the results proved that the computer output could act as a second adviser for neurologists and contribute to doctors before making the final decisions.

Horner syndrome arises from a lesion or a disruption along the oculosympathetic efferent chain, which a variety of etiologies can cause. The typical triad of Horner syndrome is ipsilateral ptosis, pupillary miosis, and facial anhidrosis [16]. However, all three symptoms are not consistently present and are always subtle. According to a report of 318 patients, less than 2% of patients presented with anhidrosis, and ptosis was recorded in only 34% of patients [17]. Although the occurrence rate of miosis was relatively high (91%) [17], the observation of it is significantly impacted by light [18]. Usually, miosis is more apparent in the dark, and the so called “dilation lag” is only apparent within the first few seconds [18, 19]. The actual degree of miosis could also be impacted by several factors including the resting size of pupil, alertness of the patients, and sympathetic drive [18]. Therefore, the presence of Horner syndrome can easily be overlooked in clinical practice. Although ptosis and miosis of Horner syndrome are not likely to cause any functional disturbance, the detection of Horner syndrome is still critical, as its cause can be very threatening or sometimes lethal. Previous studies have indicated that Horner syndrome should be considered a “red flag” warning, and thus, the recognition and evaluation are important to all clinicians [3].

Typically, the diagnosis of Horner syndrome was confirmed by several pharmacological agents such as cocaine, apraclonidine, and hydroxyamphetamine. However, the use of these agents has many drawbacks. First, some of the agents are controlled drugs and rarely available. It is impractical to use them in general departments. Second, the construction of pharmacological tests and the pupillometry after drug use require the experience of the operator, and therefore, it is hard to normalize and generalize. Third, the sensitivity of pharmacological tests needs further validation because there are several reports of false negative cases [20, 21]. In addition, the results of these tests could be influenced by the time from the onset of damage [22, 23], as well as the use of other drugs [19]. Therefore, a diagnostic tool other than drugs may benefit clinical practice.

In this study, we present a method to detect Horner syndrome from digital images. Actually, the image is the most commonly used method for the recording of Horner signs previously. Our method may provide a new way to diagnose without additional burdens. The two types of classifiers all showed adequate accuracy. For the two-stage method, we used MediaPipe for the face landmark extraction and trained machine learning models according to the coordinates of landmarks. This cooperation has been utilized in several previous studies. Siam et al. [24] used facial landmarks to generate geometrical features for human emotion classification and demonstrated superior performance. In the report of Gomez et al. [25], they analyzed the evoked facial gestures in patients with ’Parkinson’s Disease from the video of patients and indicated that the detection rate significantly improved (from 75.00% to 88.46%) by using the 17 facial features derived from the landmark detection algorithm. In addition, similar attempts have also been applied in the assessment of cerebral palsy [26], pose evaluation in sports [27, 28], and human activity recognition [29]. The combination of pose estimation methods and machine learning classifiers presented superior performances in these works. In our study, we utilized landmarks around the eyes to generate parameters for this task because Horner syndrome mainly influences the geometrical features around the eyes. However, as mentioned above, ptosis is not consistently present in Horner (+) patients [17], and it is common to observe asymmetry in eyes among healthy individuals. Therefore, it is not hard to understand the relatively high specificity and low sensitivity of these models.

As for the one-stage classifier, the YOLO v5 is the latest version of the most powerful and fastest object detection algorithms. The YOLO family has been utilized in many medical tasks including the detection of lung nodules [30], breast abnormalities [31], and lymphocytes [32] and achieved high accuracy. However, in this paper, the predictive accuracy was slightly lower than the two-stage classifiers. We assumed that it was due to the insufficient data volume, although we have used data augmentation and transfer learning technology. At present, data deficiency in medical imaging is a common problem for all researchers. This is extremely obvious in our task because the incidence of Horner syndrome is not so high, and there was no existing database of this syndrome. Future studies with more images are needed to develop this model.

The lack of powerful computers is an inevitable problem in most clinical settings [33]. Therefore, for medical use, the running speed of the model is just as important as its accuracy. In this study, both deep learning models are characterized by fast running speed and well performance [11, 34]. The MediaPipe face mesh (BlazeFace) [11] showed super-real-time performance (200–1000+ frames per second) on mobile devices and achieved an average precision (AP) of 98.61% in the testing dataset. Similarly, YOLO v5 was presented as an efficient and powerful object detection model [34] and achieved state-of-the-art performance with a speed of 140 frames per second on Tesla P100, which performs twice faster as the previous version [35]. Without the requirement of excessive computational power support, these methods are more suitable for application in real clinical settings. As for the model performance in this study, the specificities of classifiers were much higher than the sensitivities. This characteristic indicates that these proposed models can help rule out patients with oculosympathetic pathway problems. These detectors can curtail the necessity for examination for all patients, thereby saving time and resources. In addition, the automatic detection can also benefit primary hospitals, where there are no available experts to rule out those high-risk patients.

This study also has some limitations. Firstly, due to the rarity of Horner (+) patients, the study only involved a limited number of samples. Future studies with larger sample sizes may help to enhance robustness and improve the accuracy of this method. Secondly, all the diagnoses of Horner syndrome were derived from patients with brachial plexus injury. The diverse prevalence in different diseases might affect the sensitivity and specificity of detectors, which could also impact the potential generalizability of the results. Thirdly, although facial images are the most convenient and commonly used method for recording Horner syndrome, videos can provide dynamic information and have great potential to achieve better results. To solve these problems, we will establish the Horner syndrome database with various patients caused by different primary diseases. In addition, we will also attempt to investigate the possibility and accuracy of video detection.

5. Conclusions

In summary, we proposed two pipelines to detect Horner syndrome from facial images and evaluated their performance. Both the methods presented adequate accuracy compared with human experts. Our results have proved the possibility of automatic Horner detection, which could work as a second advisor to rule out high-threatening patients.

Data Availability

The raw data required to reproduce these findings cannot be shared at this time as the data also form a part of an ongoing study. The processed data are available upon request by contact with the corresponding author.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this article.

Authors’ Contributions

Jingyuan Fan and Bengang Qin contributed equally to this work.

Acknowledgments

The authors want to thank Prof. Bai Leng, Prof. Zhenguo Lao, and Jianwen Zheng for technical help, writing assistance, and general support.

References

J. J. K. M. A. Horner, “Uber eine form von ptosis,” vol. 7, p. 193, 1869.
View at: Google Scholar
W. F. Maloney, B. R. Younge, and N. J. Moyer, “Evaluation of the causes and accuracy of pharmacologic localization in Horner’s syndrome,” American Journal of Ophthalmology, vol. 90, no. 3, pp. 394–402, 1980.
View at: Google Scholar
T. J. Martin, “Horner syndrome: a clinical review,” ACS Chemical Neuroscience, vol. 9, no. 2, pp. 177–186, 2018.
View at: Google Scholar
H. M. Ünver and E. J. D. Ayan, “Skin lesion segmentation in dermoscopic images with combination of YOLO and grabcut algorithm,” vol. 9, no. 3, p. 72, 2019.
View at: Google Scholar
P. Teare, M. Fishman, O. Benzaquen, E. Toledano, and E. Elnekave, “Malignancy detection on mammography using dual deep convolutional neural networks and genetically discovered false color input enhancement,” Journal of Digital Imaging, vol. 30, no. 4, pp. 499–505, 2017.
View at: Google Scholar
M. Ghaderzadeh, M. Aria, A. Hosseini, F. Asadi, D. Bashash, and H. Abolghasemi, “A fast and efficient CNN model for B‐ALL diagnosis and its subtypes classification using peripheral blood smear images,” International Journal of Intelligent Systems, vol. 37, no. 8, pp. 5113–5133, 2022.
View at: Google Scholar
V. Gulshan, L. Peng, M. Coram et al., “Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs,” JAMA, vol. 316, no. 22, pp. 2402–2410, 2016.
View at: Google Scholar
Y. Song, S. Zheng, L. Li et al. et al., “Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 18, no. 6, pp. 2775–2780, 2021.
View at: Google Scholar
M. Ghaderzadeh, F. Asadi, R. Jafari, D. Bashash, H. Abolghasemi, and M. Aria, “Deep convolutional neural network–based computer-aided detection system for covid-19 using multiple lung scans: design and implementation study,” Journal of Medical Internet Research, vol. 23, no. 4, Article ID e27468, 2021.
View at: Google Scholar
M. Ghaderzadeh, M. A. Eshraghi, F. Asadi et al., “Efficient framework for detection of COVID-19 omicron and delta variants based on two intelligent phases of CNN models,” Computational and Mathematical Methods in Medicine, p. 2022, 2022.
View at: Google Scholar
V. Bazarevsky, Y. Kartynnik, A. Vakunov, K. Raveendran, G. Mjapa, and Blazeface, Sub-millisecond Neural Face Detection on mobile Gpus, 2019.
G. Jocher, A. Stoken, J. Borovec et al., ultralytics/yolov5: V3. 1-bug Fixes and Performance Improvements, 2020.
A. Buslaev, V. I. Iglovikov, E. Khvedchenya, A. Parinov, M. Druzhinin, and A. A. Kalinin, Albumentations: Fast and Flexible Image Augmentations, vol. 11, no. 2, p. 125, 2020.
L. Li, K. Jamieson, G. DeSalvo, A. Rostamizadeh, A. J. T. JoM. L. R. Talwalkar, and Hyperband, “A novel bandit-based approach to hyperparameter optimization,” vol. 18, no. 1, pp. 6765–6816, 2017.
View at: Google Scholar
J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: unified, real-time object detection,” in Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779–788, June 2016.
View at: Google Scholar
K. A. Walton and L. M. Buono, “Horner syndrome,” Current Opinion in Ophthalmology, vol. 14, no. 6, pp. 357–363, 2003.
View at: Google Scholar
M. A. Sabbagh, L. B. De Lott, and J. D. Trobe, “Causes of horner syndrome: a study of 318 patients,” Journal of Neuro-Ophthalmology: The Official Journal of the North American Neuro-Ophthalmology Society, vol. 40, no. 3, pp. 362–369, 2020.
View at: Google Scholar
I. Davagnanam, C. L. Fraser, K. Miszkiel, and C. S. Daniel, “Plant GT: adult Horner’s syndrome: a combined clinical, pharmacological, and imaging algorithm,” Eye, vol. 27, no. 3, pp. 291–298, 2013.
View at: Google Scholar
D. L. Reede, E. Garcon, W. R. Smoker, and R. Kardon, “Horner’s syndrome: clinical and radiographic evaluation,” Neuroimaging Clinics of North America, vol. 18, no. 2, pp. 369–385, 2008.
View at: Google Scholar
A. Kawasaki and B. F-XjkmfA, “False negative apraclonidine test in two patients with Horner syndrome,” vol. 225, no. 05, pp. 520–522, 2008.
View at: Google Scholar
M. A. Dewan, A. R. Harrison, and M. S. Lee, “False-negative apraclonidine testing in acute Horner syndrome,” Canadian journal of ophthalmology Journal canadien d’ophtalmologie, vol. 44, no. 1, pp. 109-110, 2009.
View at: Google Scholar
S. P. Donahue, P. J. Lavin, and K. Digre, “False-negative hydroxyamphetamine (Paredrine) test in acute Horner’s syndrome,” American Journal of Ophthalmology, vol. 122, no. 6, pp. 900-901, 1996.
View at: Google Scholar
M. L. Moster, D. Galiani, and W. Garfinkle, “False negative hydroxyamphetamine test in horner syndrome caused by acute internal carotid artery dissection,” Journal of Neuro-Ophthalmology: The Official Journal of the North American Neuro-Ophthalmology Society, vol. 23, no. 1, pp. 22-23, 2003.
View at: Google Scholar
A. I. Siam, N. F. Soliman, A. D. Algarni, A. El-Samie, E. Fathi, and A. J. C. I. Sedik, Neuroscience: Deploying Machine Learning Techniques for Human Emotion Detection, 2022.
L. F. Gomez, A. Morales, J. R. Orozco-Arroyave, R. Daza, and J. Fierrez, “Improving Parkinson detection using dynamic features from evoked expressions in video,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, vol. 2021, pp. 1562–1570, 2021.
View at: Google Scholar
H. Haberfehlner, S. van der Ven, S. van der Burg et al., “Towards automated video-based assessment of dystonia in severe dyskinetic cerebral palsy: a new method using human pose estimation,” Gait & Posture, vol. 97, pp. S78–S79, 2022.
View at: Google Scholar
K. M. Kulkarni and S. Shenoy, “Table tennis stroke recognition using two-dimensional human pose estimation,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, vol. 2021, pp. 4576–4584, 2021.
View at: Google Scholar
Y. Agrawal, Y. Shah, and A. Sharma, “Implementation of machine learning technique for identification of yoga poses,” in IEEE 9th International Conference on Communication Systems and Network Technologies (CSNT): 2020, pp. 40–43, IEEE, 2020.
View at: Google Scholar
H. Ramirez, S. A. Velastin, P. Aguayo, E. Fabregas, and G. Farias, “Human activity recognition by sequences of skeleton features,” Sensors, vol. 22, no. 11, p. 3991, 2022.
View at: Google Scholar
J. George, S. Skaria, and V. Varun, “Using YOLO based deep learning network for real time detection and localization of lung nodules from low dose CT scans,” Medical Imaging 2018: Computer-Aided Diagnosis: 2018, International Society for Optics and Photonics, p. 105751I, 2018.
View at: Google Scholar
M. A. Al-Masni, M. A. Al-Antari, J.-M. Park et al., “Simultaneous detection and classification of breast masses in digital mammograms via a deep learning YOLO-based CAD system,” vol. 157, pp. 85–94, 2018.
View at: Google Scholar
M. van Rijthoven, Z. Swiderska-Chadaj, K. Seeliger, J. van der Laak, and F. Ciompi, You Only Look on Lymphocytes once, 2018.
T. G. Myers, P. N. Ramkumar, B. F. Ricciardi, K. L. Urish, J. Kipper, and C. Ketonis, “Artificial intelligence and orthopaedics: an introduction for clinicians,” The Journal of bone and joint surgery American, vol. 102, no. 9, p. 830, 2020.
View at: Google Scholar
Yolov5, https://github.com/ultralytics/yolov5.
J. Nelson and J. Solawetz, “Yolov5 is here: state-of-the-art object detection at 140 fps,” p. 17, 2020, https://blog roboflow com/yolov5-is-hereAccessed.
View at: Google Scholar

Copyright

Copyright © 2022 Jingyuan Fan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

338

Downloads

267

Citations