Training Method and Device of Chemical Industry Chinese Language Model Based on Knowledge Distillation

Figure 3

The specific algorithm structure.