Research Article
HGVul: A Code Vulnerability Detection Method Based on Heterogeneous Source-Level Intermediate Representation
Table 10
Performance on six open-source projects.
| Project | Vulnerable funcs | RATS | Flawfinder | VUDDY | VulDeePecker | BGNN4VD | Devign | HGVul | Detected | F1 (%) | Detected | F1 (%) | Detected | F1 (%) | Detected | F1 (%) | Detected | F1 (%) | Detected | F1 (%) | Detected | F1 (%) |
| ffmpeg | 1583 | 364 | 31.8 | 350 | 30.9 | 47 | 5.7 | 827 | 52.3 | 1270 | 62.1 | 928 | 53.3 | 1148 | 60.6 | openssl | 1075 | 526 | 51.7 | 383 | 43.4 | 64 | 10.7 | 609 | 56.2 | 838 | 63.9 | 826 | 65.3 | 1048 | 69.7 | libav | 801 | 155 | 28.2 | 158 | 28.6 | 22 | 5.3 | 424 | 53.2 | 672 | 64.9 | 602 | 71.2 | 597 | 58.2 | httpd | 105 | 38 | 43.2 | 38 | 43.4 | 2 | 3.7 | 50 | 52.4 | 88 | 67.2 | 90 | 67.2 | 104 | 82.2 | nginx | 78 | 0 | 0 | 11 | 22.2 | 0 | 0 | 41 | 53.2 | 66 | 64.4 | 67 | 78.4 | 63 | 86.9 | libtiff | 54 | 4 | 12.9 | 4 | 12.9 | 4 | 12.7 | 21 | 44.7 | 43 | 66.2 | 38 | 66.7 | 44 | 60.7 | Total/Avg | 3696 | 1087 | 28.0 | 944 | 30.2 | 98 | 6.4 | 1972 | 50.0 | 2977 | 64.8 | 2551 | 67.0 | 3004 | 69.7 |
|
|