Abstract
Improved SVM algorithm improves the efficiency of College English teaching effect evaluation and meets the requirements of College English teaching evaluation. Based on the relevant theories, this paper constructs the evaluation index system with teachers and students as the main body and takes the questionnaire survey results as the input samples of the LSSVM algorithm. Compared with the evaluation accuracy of an optimized BP neural network and the category weighted gray target decision-making method, the results show that the evaluation accuracy of optimized LSSVM algorithm is 96.26%. Taking SIT as an example, this paper uses the optimized LSSVM algorithm to evaluate its teaching effect and obtains that teachers’ literature and teaching contents are important factors to improve the effect of English teaching. Therefore, this paper introduces the intelligent voice system to optimize the English teaching design of SIT. The teaching design is optimized from the dimensions of teaching objectives, learning situation, teaching content, teaching media and curriculum materials, and teaching procedures.
1. Introduction
Teaching effect evaluation has become a hot issue in the field of education at home and abroad. Teaching effect is the core of school survival and development. Teaching evaluation is a very important and indispensable part of the teaching process and an important means to test the teaching effect. Traditional teaching evaluation methods only focus on students’ learning effect, which is not conducive to the reform of English teaching methods and contents.
English teaching effect evaluation refers to the evaluation of teachers’ teaching effect from the aspects of teaching content, subject organization, teaching achievement, and learning interest. Through the evaluation, the direction of curriculum optimization can be put forward. Eleni et al. (2012) believe that teaching motivation and teaching satisfaction are the main factors of curriculum teaching effect and put forward effective evaluation methods for teaching motivation, such as the experimental method, questionnaire method, and text analysis method [1]. The traditional questionnaire survey and observation evaluation cannot objectively evaluate the classroom quality for a long time and cannot obtain clear evaluation results. In this case, Li et al. (2019) propose an intelligent school teacher quality evaluation platform. By considering the sensor information, flow information, and power information of mobile devices in the teaching process, the teacher quality evaluation score is given through the neural network training classification model [2]. Nalla (2019) proposes an evidence-based teaching strategy evaluation framework [3]. Leong et al. (2012) discuss the method of analyzing text mining of short message service (SMS) in teaching evaluation, and analyze and classify the information [4]. Ahmad (2018) analyzes how to the improve students’ response rate to teaching curriculum evaluation through the survey results. The survey results show that the effective communication of teachers can effectively improve students’ participation in the evaluation of teaching curriculum quality [5]. Cadez et al. (2017) analyze the relationship between learning style and academic achievement of accounting students through teacher evaluation [6]. Bi (2018) studies the teaching evaluation grade and uses the evaluation based on statistical process control theory and standard deviation diagram to evaluate the school teaching grade [7].
In the selection of evaluation methods, the emotion classification model is widely used. Mullen and Collier (2004) first analyze the syntax between texts and then further analyze the emotion of the text based on the SVM algorithm [8]. Moraes et al. (2013) integrate the machine learning algorithm and deep learning technology into teaching effect evaluation, compare the classification effect of the support vector machine algorithm with that of the artificial neural network algorithm, and prove that the classification effect of ANN is equivalent to that of SVM [9]. Besides, Fuzzy mathematics theory, analytic hierarchy process, and BP neural network are also commonly used in the evaluation of CETE. Kennedy and Eberhart (1997) proposed an evolutionary algorithm to solve discrete problems based on the study of bird foraging behavior. Compared with the genetic algorithm, it has faster convergence speed in solving multiuser detection problems [10].
Sun (2020) et al. have developed an online English teaching assistant system, which uses the decision tree algorithm and a neural network to generate an English teaching evaluation model based on decision tree technology and studies the potential relationship between the evaluation results and various factors [11]. However, optimizing the evaluation model of college teaching quality based on the BP neural network will ignore the factors of teaching quality, resulting in the low accuracy of CETE evaluation. Krohling and de Souza (2012) define the positive and negative target distance from each scheme to the positive and negative ideal scheme, and sort the schemes according to the comprehensive target distance of each scheme [12]. The teaching evaluation method based on category weighted gray target decision making has low evaluation efficiency due to the complex calculation process. In the application of the intelligent system to curriculum teaching, the student model of the intelligent teaching system based on the Bayesian network established by Lan (2020) can not only objectively evaluate students’ cognitive ability but also infer students’ next learning behavior [13]. Myers (2021) uses the intelligent teaching system to automatically detect students’ emotional state and guide students into a positive learning state [14]. Ramadan and Vasilakos (2017) collected shallow brain activity signals, extracted specific brain waves according to specific frequencies, and evaluated students’ attention, emotion, and cognitive load [15].
The existing CETE research mainly focuses on the selection of the evaluation model and the improvement of model accuracy, and there is less research on practical application and optimization means. This paper not only optimizes the evaluation model but also innovatively introduces information technology means such as the intelligent voice system to improve the level of College English teaching. Based on the past research, this paper finds that mathematical algorithms are widely used in the evaluation of CETE, but most of them only use one method, and the optimization of the algorithm needs to be further improved. In this paper, the SVM algorithm is used as the evaluation method of CETE, and the PSO algorithm is used to optimize the SVM algorithm.
This paper constructs the evaluation index system from the perspectives of teachers and students and fully considers students’ interests and teachers’ feelings. By comparative analysis, the algorithm with the highest accuracy is selected as the evaluation method of this paper, and the selected evaluation method is applied to practice to obtain the most important influencing factors. The intelligent voice system is introduced to optimize College English teaching curriculum design, the improvement of teaching evaluation quality is fully considered, and curriculum design optimization is carried out while improving students’ English learning achievements and considering students’ interests and learning needs. In the evaluation process of this paper, the effect of College English teaching is divided into four levels: excellent, good, pass, and fail, and the optimized algorithm is used for empirical research. Firstly, this paper selects the Shanghai Institute of Technology for a case study to evaluate its College English teaching effect. Secondly, according to the evaluation results of each index and the overall evaluation results, the most important index in the process of curriculum optimization design is obtained. Finally, the intelligent speech system is introduced to formulate the optimization scheme and suggestions of College English teaching curriculum design.
2. Evaluation Model of College English Teaching Effect
2.1. Evaluation Index System of College English Teaching Effect
There are many theories for the evaluation system of College English teaching effect. Teachers and students are the two main bodies of the classroom, and they participate in the whole process of teaching. Therefore, starting from these two subjects, CETE can be evaluated more comprehensively. According to the relevant theories, an evaluation index system with teachers and students as the theme is constructed, as shown in Figure 1. The evaluation index system constructed in this paper can evaluate the teaching effect more comprehensively from the main perspective of students and teachers and from the different perspectives of participants in teaching activities. From the perspective of students, the evaluation index mainly comes from their feelings in class. Therefore, the evaluation indicators from the perspective of students mainly include course content, class atmosphere, teaching order, teaching skills, sense of responsibility, and interest. From the perspective of teachers, the evaluation indicators mainly come from the actual teaching effect and the number of courses. Therefore, the evaluation indicators from the perspective of teachers mainly include students’ performance, correcting homework, the number of classes dismissed in advance, the number of classes transferred, and the number of classes suspended. The interpretation and definition of indicators are shown in Table 1.
Teachers’ sense of responsibility and English achievement are important indicators to evaluate the effect of College English teaching. The evaluation index data of College English teaching effect are used as the input sample of the least squares support vector machine to realize the evaluation of College English teaching effect.
2.2. Evaluation Principle of LSSVM
This paper uses the least squares support vector machine (LSSVM) method to evaluate English language teaching. LSSVM is one of the most widely used methods with good accuracy and precision in nonlinear signal processing. Compared with artificial neural networks, it can overcome the disadvantages of long training time, randomness of training results, and overlearning [16]. Compared with SVM, LSSVM transforms inequality constraints into equation constraints and quadratic programming problems into a linear system of equation problems, which greatly facilitates the solution of Lagrange multipliers . The computational efficiency of LSSVM is higher than that of SVM. Furthermore, LSSVM is equally suitable for classification and regression tasks in high-dimensional input spaces and can be extended to unsupervised learning and recurrent neural networks.
The main description of the CETE evaluation model used in this paper is as follows: a nonlinear mapping is chosen to map the sample vector with n-dimensional input data as x and one-dimensional output data as y, from the original space to the high-dimensional feature space. The regression equation of LSSVM is shown in the following equation:
In the above equation, is the weight vector and the constant b is the bias term. The optimization problem of LSSVM is shown in the following equation:
In the above equation, is the regularization parameter and is the error variable. Compared to SVM, the constraints of LSSVM are different, as shown in the following equation:
The inequality constraint of the SVM is replaced by an equation constraint, and the Lagrange function is constructed for the solution, as shown in the following equation:
In the above equation, is the Lagrange multiplier. The optimal value is calculated under the Karush–Kuhn–Tucker (KKT) optimization condition. The equation constraint is shown in the following equation:
By eliminating and in the above equation, the quadratic optimization problem is replaced by solving a linear system of equations, and the result is calculated as in the following equation:
In the above equation, is the identity matrix; is a support vector; ; ; represents the inner product of the kernel matrix, and Based on the kernel function in the original space, the regression of LSSVM is obtained function for the following equation:
To circumvent the dimensional catastrophe, a radial basis kernel function commonly used in LSSVM is introduced instead of the inner product operation in the high-dimensional feature space. The radial basis kernel function is shown in the following equation:
In the above equation, represents the kernel function width. The generalization ability of LSSVM can be enhanced by optimizing two parameters, and . When LSSVM is used for University English teaching evaluation, the particle swarm algorithm can be used for the parameter finding problem, and the specific evaluation process is shown in Figure 2.
2.3. Parameter Optimization Based on PSO
Parameter selection is an important research direction in the field of LSSVM research. Many methods can be used to determine and , but there are deficiencies in memory and time. Particle swarm optimization (PSO) algorithms have the advantages of being less prone to local minima, easy to implement, and with fewer tuning parameters. Thus, PSO is often used to solve nonlinear, nonintegrable, and multimodal problems. In PSO, each potential solution to the optimization problem is called a “particle.” Each particle has its own stance and velocity (which determines its direction of flight and distance) and an adaptation value determined by the function being optimized.
A population of particles is set up in a -dimensional search space, where the optimal position of particle searched in the space is described by , ; the velocity is described by , ; the position of particle is described by , ; the optimal position searched for in the total population is described by , . The method to update the particle position and velocity is given in the following equations:
Among them, is the inertia weight coefficient; and are the acceleration constants; is the optimization algebra; and are the search velocity and position of the particle in the space at algebra ; and are the random numbers. The process of optimizing the parameters and by PSO is as follows:(1)Normalize and preprocess the CETE evaluation data(2)Set the parameter values(3)Initialize processing(4)Set the individual extreme value and the global extreme value , and calculate the adaptation value of each particle according to its current position, , where is the total number of samples(5)In order to generate new populations, update the particle positions and velocities according to equations (9) and (10)(6)Solve for the fitness value for each particle within the new population(7)Compared with the previous optimal speed and optimal position of the population, if it is excellent, the conversion will be implemented, otherwise, no adjustment will be made(8)If the optimal ending condition is not met, we need to make the number of iterations and return to Step 4 to find the optimal solution
2.4. Evaluation Process
Combined with the evaluation index system of College English teaching effect, a College English teaching effect evaluation model based on the particle swarm optimization algorithm and support vector machine is established. The flowchart of the model is shown in Figure 3.
The input sample of LSSVM is the value of CETE evaluation data, which is from the expert rating. And the evaluation results are obtained through the operation of the SVM algorithm. This paper optimizes the evaluation algorithm by comparing the evaluation results before and after adding the PSO algorithm. The PSO algorithm mainly solves the optimal solutions of kernel function parameters and regularization parameters of LSSVM, and then optimizes the process of CETE evaluation. It judges whether the existing parameters are the optimal solution through the IF function. If the result is yes, the test samples are evaluated, and the results are output. If the result is no, the particle swarm optimization algorithm needs to be used to readjust the parameters to the optimal solution. The above process is a machine learning process, and the computer realizes the purpose of automatic tuning through its own learning.
3. Experimental Results and Analysis
This paper selects the English classroom teaching effect of Shangqiu Institute of Technology as the research object and collects sample data according to the evaluation index of CETE. Through the actual situation of College English teaching and the evaluation of College English teaching effect by experts, we can get the quality level of College English classroom teaching and 200 data samples for testing. In the model building process, this paper chooses the Gaussian radial basis function as the kernel function.
The training data of each degree of the six faults are input to the LSSVM regressor for learning, while the PSO algorithm is used for multiobjective optimization of the regularization parameters and kernel function parameters. The population size of PSO is set to 200, the learning factor to 1.49, the maximum number of iterations to 1000, and the inertia weight to 1 initially. The final choice of the best model parameters is (, ) = (2316.57, 224.46), = 9.93. The regression performance of the model is evaluated by the ratio of the number of correct model predictions to the total number of samples, as shown in the following equation:
In order to verify the effectiveness of the PSO-LSSVM method for CETE assessment, we also use the BP neural network [17] and gray target decision method [18] for comparison testing. Three methods are used to test the experimental dataset to obtain their accuracy calculation results, as shown in Table 2 and Figure 4. As can be seen from Table 2, the average evaluation accuracy of the method in this paper is 96.26%, which is 5.36% and 14.29% higher than that of the BP neural network and gray target decision, respectively. Therefore, the PSO-LSSVM method has a very superior degree of accuracy and scientific performance.
Next, we performed 20 experiments on 10 datasets using the three methods, and the time used for the three methods (test time and training time) within the experiment was calculated while the average value was selected. The results of the comparison of the three methods are shown in Figures 5 and 6.
From the comparison results of Figures 3 and4, it can be seen that POS-LSSVM has obvious advantages over the other two methods in terms of time efficiency, the training time and testing time of this method are the lowest, the average training time is as low as 15 ms, and the average testing time is as low as 5 ms. Compared with the BP neural network, its training time saves 8 ms and its test time saves 5 ms; compared with gray target decision, its training time saves 3 ms and its test time saves 4 ms.
4. Teaching Optimization Design
The purpose of this paper is to come up with the most sensitive influencing factors through the constructed CETE evaluation model and then proposing some targeted ways to improve the effectiveness of English teaching. After further questionnaires and armor-piercing interviews, we conclude that , , , and play a more important role for English teaching. The four indicators were moved up and down by 5% and 10%, respectively, and the magnitude of the impact of each move on the evaluation results is shown in Figure 7. To facilitate the analysis of the degree of change in the evaluation results, the rate of change is expressed using the absolute value of the true value. Figure 7 illustrates that and have a higher degree of influence on the evaluation results compared to and , which suggests that the optimization of CETE in this paper focuses on both course content and teacher skills [19].
In language learning, interests will be a great help to students. Therefore, we must find suitable methods to improve teachers’ literacy and enrich teaching contents so as to stimulate the interest of student and improve the teaching effect [20]. Starting from the reality of STL, this paper mainly improves College English teaching through the integration of information technology and curriculum design.
4.1. Observation Dimension of Curriculum Design
Before the beginning of curriculum optimization, this paper observes the English curriculum of SIT colleges and universities, obtains research materials by means of field observation, and mainly observes the curriculum design of English teaching in SIT colleges and universities, the application of technical tools, and the integration of technology and curriculum content. The specific observation dimensions include teaching objectives, learning situation, teaching content, teaching media and curriculum materials, and teaching procedures.
In terms of teaching objectives, SIT teachers focus on cultivating college students’ basic knowledge and skills of English audio visual according to the syllabus and curriculum requirements and pay attention to the cultivation of students’ emotions, attitudes, and values in the teaching curriculum planning. However, it does not focus on cultivating students’ English thinking and lacks the cultural elements in English function. In terms of learning, SIT teachers regard students as the learning center. In the whole process of English teaching, teachers pay enough attention to students’ learning status and performance. However, as a freshman of SIT, the basic knowledge of English is not solid, and the knowledge structure is not systematic and perfect. Teachers’ teaching rhythm is not synchronized with students’ learning status and ability. As a result, teaching is hindered. In terms of teaching content, SIT teachers have the phenomenon of following the book, lack of effective design of teaching content, and no fine processing and expansion of knowledge and skills. The teaching content adheres to the textbook itself, resulting in the lack of interest in the course. In the application of teaching media and curriculum materials, SIT classrooms are equipped with advanced teaching technology tools, but teachers are not well applied to practical teaching, only as the presentation and display of curriculum materials, and curriculum design lacks theoretical guidance.
In addition, in the actual teaching process, teachers only use textbooks, markers, and whiteboards for teaching. Therefore, teaching technology cannot give full play to its maximum function, and it is in a state of separation from the whole teaching process. In terms of teaching procedures, SIT teaching procedures tend to be old, mainly including review, main curriculum, practice, summary, and home work There are some practical problems in this teaching procedure, which should be optimized to add links between teachers’ activities and students’ learning activities.
Thus, the application framework of teaching links, activity forms, and technical tools of the specific observation dimension of SIT English course is obtained, as shown in Figure 8. In the review session, the teacher summarizes and reviews the basic English knowledge and skills learned in the previous course, including cognition, understanding, and skills. In the main curriculum link, the teacher will present the prepared course content in writing and oral form according to the teaching requirements, mainly including theme introduction, vocabulary obstacle removal, key explanation, text explanation, and extracurricular knowledge expansion. In the practice link, teachers test the students’ learning of course knowledge in groups by random roll call and random inspection, and restate and explain the knowledge points with high error rate. In the summary section, teachers apply the consolidation method to review the course and repeat the key and difficult points of the course to understand the students’ understanding of knowledge. In the home work link, the teacher assigns homework after class. The types of homework include dictation and recitation of key words, and flexible collocation and application of phrases and sentence patterns.
4.2. Optimization and Perfection of Teaching Procedure
This paper chooses an optimized program guided by the integration of information technology and curriculum, mainly to address the current situation of outdated teaching design, fragmentation, and disconnection between technological tools and actual teaching. The aim is to enhance the comprehensive ability of teachers, improve learning interest of students, and enhance the coherence of course content and teaching quality in future education and teaching. The main dimensions of teaching optimization design include the whole teaching process, using technology concepts and technology tools to integrate teaching dimensions. Every aspect of teaching is assisted and facilitated by the application of technology; the technology concept fully integrates the whole teaching process, the technology tools are no longer idle, and they are more efficiently integrated with teaching.
The intelligent voice system is integrated into all stages of the whole course teaching process to enrich the teaching content so that students can carry out role playing, audio and video appreciation, and other activities. This pedagogical optimization focuses on the teacher-led-student-subject role in the teacher-student teaching role position dimension. Students learn under the inspiration, guidance, and teaching of the teacher. Then, under the guidance of this theory of teaching-learning relationship, the optimization of teaching and learning under the guidance of IT and curriculum integration is achieved through the use of technological tools, pedagogical aids, and the integration of subject content concepts into the whole teaching process. In general, the study provides a careful design and detailed analysis of the procedures of teaching activities so that the optimized teaching design can be more effective. The specific contents of teaching optimization and the integrated application of information technology are shown in Figure 9.
5. Conclusion
The quantitative nonlinear functions between the CETE and each evaluation index are complicated. The complex mathematical relationships lead to subjectivity in the evaluation scores, which affects the objectivity and fairness of the evaluation. In order to accurately evaluate the effectiveness of College English teaching and improve the overall level of College English teaching, this paper studies the evaluation model of College English teaching effectiveness based on PSO-LSSVM. The average accuracy of the evaluation model in ten datasets is 96.26%, which has high advantages and is nearly 6% higher than that of the BP neural network. The average training time is 15 ms, and the average test time is 5 ms. The experimental results show that this method has the highest evaluation accuracy, short evaluation time, and the best evaluation results. Based on the method of this paper, it can improve the optimization plan for English teaching effect, which is of great practical significance for the improvement of College English teaching level.
During the implementation of this study, the concept of information technology and curriculum integration is applied to guide teaching and learning and to carry out teaching practices. This a priori concept optimizes and improves the whole teaching system, and each component of the teaching system incorporates the concept of technology integration. At the same time, it focuses on the integration of technology, pedagogy, and subject content. As a result, SIT is optimized, and students’ English listening and speaking skills are improved.
Due to the limited time and energy, there are still some deficiencies to be further improved. Firstly, in order to improve the generalization of the research, we need to try to apply better methods to the in-depth study of College English teaching evaluation index system in future research so as to make it complete and more scientific. Secondly, more experimental datatests are carried out for the method in this paper, and the method is continuously optimized in the test. Finally, it is hoped that the in-depth study will apply better methods to College English teaching and make the evaluation accuracy and efficiency better.
Data Availability
The labeled dataset used to support the findings of this study is available from the corresponding author upon request.
Conflicts of Interest
The author declares no conflicts of interest.