[Retracted] Software Systems Security Vulnerabilities Management by Exploring the Capabilities of Language Models Using NLP

Algorithm 4

Neural network language model.

	Input: security- and nonsecurity-related text with labeling process:
(1)	Data set split to 50% for training, 10% for validation, and 40% for testing
(2)	Function for preprocessing the corpus
(3)	Basic text preprocessing
(4)	Embedding layer of NNLM is built: model = “https://tfhub.dev/google/tf2-preview/nnlm-en-dim128/1”
(5)	Model architecture is constructed: model =
	tf.keras.models.Sequential ()
(6)	Training and validation is conducted for 100 epochs and 128 batch size with an early stopping method
(7)	Model performance is evaluated on test data
	Output:
	Accuracy: 90.16%
	Precision: 0.81
	Recall: 0.90
	F1-score: 0.86