Training Method and Device of Chemical Industry Chinese Language Model Based on Knowledge Distillation

Figure 2

Network structure diagram of the student model.