Complexity Problems Handled by Advanced Computer Simulation Technology in Smart Cities 2021View this Special Issue
Algorithm of Classroom Teaching Quality Evaluation Based on Markov Chain
The Markov chain model teaching evaluation method is a quantitative analysis method based on probability theory and stochastic process theory, which establishes a stochastic mathematical model to analyse the quantitative relationship in the change and development process of real activities. Applying it to achieve a more comprehensive, reasonable, and effective evaluation of the classroom teaching quality of college teachers is of positive significance for promoting the continuous improvement of the teaching level of teachers and the teaching quality of schools. Therefore, after an in-depth study of Markov chain algorithm theory, this research proposes an improved Markov chain hybrid teaching quality evaluation model and designs comparative experiments and applies it to the hybrid teaching quality evaluation system of universities, designs a corresponding hybrid teaching quality evaluation model, and finally verifies its effectiveness through experiments. The mathematical model of mixed classroom teaching quality evaluation given in this research focuses on the development and change of the teaching process. For the teaching process that is closely related to the causality of teaching quality, the model established in this paper is more objective and reasonable for evaluating the quality of teaching.
Classroom teaching quality evaluation is an important link in the process of teaching management. Continuously improving the objectivity and reliability of classroom teaching quality evaluation data is an important way and means to improve the quality of teaching evaluation. The establishment of teaching quality evaluation is to construct the functional relationship between the teaching quality evaluation index and the teaching effect. Teaching quality evaluation is based on the requirements of teaching goals and teaching principles, formulating scientific evaluation standards, systematically collecting information, measuring the process and results of teaching and learning activities, and giving value judgments . Classroom teaching is the basic form and core link of teaching work, and it plays a decisive role in improving the quality of teaching.
There are many methods for evaluating the quality of classroom teaching. Since the content involved in teaching quality evaluation is more qualitative and less quantitative, only qualitative standards can be given, and the standards are more flexible. In addition, the evaluators have deviations in their grasp of the standards and subjective reasons, which brings a certain degree of difficulty to the evaluation of teaching quality. At present, colleges usually adopt methods such as absolute evaluation method, rating method, relative evaluation method, comment method, and comprehensive scoring method. These algorithms are more scientific and persuasive than qualitative methods, but there are still strong professional problems, and it is difficult for many nonprofessionals to understand and use them objectively and reasonably. At the same time, the stability of these algorithms needs to be improved, and the reliability of the results cannot be analysed [2, 3]. Therefore, how to construct a new teaching quality evaluation model that is less subjectively influenced by people and has high reliability of results and self-adaptive model parameters has become a current research trend and difficulty. We followed the methods of Jian and Zhang . Given current knowledge or information, the past (that is, the historical state before the current period) is irrelevant for predicting the future (that is, the future state after the current period). In theoretical research, we can use the limit distribution of Markov process as a quantitative indicator of teaching effect; this solves the problem which is due to differences in student foundations that cannot be used to effectively evaluate the quality of teaching by students and can predict the overall learning situation in the future .
Therefore, after in-depth study of Markov chain algorithm theory, this research proposed an improved Markov chain teaching quality evaluation model, designed comparative experiments and applied it to the hybrid teaching quality evaluation system of universities, designed a corresponding teaching quality evaluation model, and finally verified its effectiveness through experiments. The mathematical model of mixed classroom teaching quality evaluation given in this research focused on the development and change of the teaching process. For the teaching process that was closely related to the causality of the effect before and after teaching, the model established in this paper was more objective and reasonable for evaluating the quality of teaching.
2. The Relationship between Markov Chain and Classroom Teaching Quality Evaluation
There are many phenomena in the real world that have such characteristics: under the condition that the current situation of a certain system is known, the future situation of the system is only related to the present and not directly related to the past history. This phenomenon is called Markov random phenomenon. The mathematical model used to describe this random phenomenon is called the Markov model .
2.1. Introduction to the Basic Theory of Markov Chain
The Markov chain has “no aftereffect”; that is, to determine the future state of the random process, only the current state is needed, and it has nothing to do with the past state. The stochastic process is called a discrete-time Markov chain. If it only takes a finite or listable value, and for any n ≥ 0, and any state i, (S representative state space), there are
In (1), means that the process is in state i at time n. is the one-step transition probability matrix.
The transition probability matrix has, for all ,
The matrix with as the element is denoted as , which is called the step transition matrix of the Markov chain. It satisfies . When m = l, it is denoted as , the one-step transition matrix is denoted as , and then (1) ; (2) when the Markov chain is nonperiodic and irreducible, there is a unique solution under the condition, for example, .
If a Markov chain is in state i from time to time , the transition probability of being in state j is only related to t, but to the starting time of the transition. Then a Markov chain with this characteristic is called a homogeneous Markov chain. Homogeneous Markov chain has no aftereffect and homogeneity to time can be used as a more reasonable mathematical model of a practical problem in school teaching management .
2.2. The Relationship between Markov Chain and Hybrid Classroom Teaching Quality Evaluation
Blended teaching is a new teaching model based on E-learning. It highlights the coordinated and unified teaching process between the teaching in physical places other than the home that can be supervised and the students’ online self-controlled learning process. Therefore, online, supervisable physical locations, and integration have become the most critical elements of blended teaching. The blended teaching in this algorithm research is mainly to effectively integrate the advantages of classroom teaching and online teaching. The basic process is embodied in three links: online learning before class, intensive learning in class, and summary learning after class, as shown in Figure 1.
For a certain stage of mixed teaching, although the teaching process has a strong continuity, the most direct impact on the teaching situation of this stage is the teaching situation of the previous stage at this stage; for a long-term continuous teaching process, under the condition that the conditions of teachers, students, and teaching are basically stable, the teaching situation of the whole process tends to be stable. This can be inferred from the changes in the two adjacent stages. It can be seen that the abovementioned law of the mixed-teaching situation is relatively close to the Markov random process, so the Markov chain can be used to construct a mathematical model to evaluate the teaching situation. To describe a system with a mathematical model is to quantify the main indicators in the system and express them in mathematical expressions. According to the common situation in the school’s teaching management, this research quantifies the teaching effect index. This is to divide all the teaching objects (experimental class and control class) into m grades for a certain test. For example, it is common to divide the test scores of all students who teach in 5 levels, namely, excellent (90 points or more), good (80–90 points), medium (70–79 points), passing (60–69 points), failing (59 points or less). The purpose of this is to find out the changes in students’ test scores after teachers teach. Take the ratio of the number of students in each grade to the total number of students taught by a teacher as a state variable, and use the state probability distribution vector to represent it , denoted aswhere is time and . If we try to express as a homogeneous Markov chain, we can analyse the changing law of the state vector when t changes. In this way, a mathematical model of teaching quality evaluation can be established by Markov chain’s no aftereffect and the homogeneity of time which is not affected by the original difference of the students. First define the initial state vector, denoted aswhere n is the total number of teachers taught by a certain teacher and is the number of initial test scores. The initial test score refers to the original score of the student of the course that the teacher holds. With the initial state vector , we can define the transition probability matrix that reflects the transition and change of a teacher’s student performance after teaching, denoted as
Here represents the number of students who transfer from the i-th grade to the j-th grade in the next time (after teaching) relative to the initial grade. The element in the i-th row of P reflects the probability that the student’s performance will be transferred to the j-th grade of the next test result in the j-th grade of the initial grade. Obviously,
From the above definitions, we can see that is a homogeneous Markov chain, so we can get
It can be seen from the above that M(t) is an irreducible state and a nonperiodic Markov chain with normal return. Therefore, the limit state distribution of M(t) is the probability distribution of a homogeneous Markov chain in a stationary state. Of course, there are microscopic changes between levels within the steady state system, but the relative number of people at each level no longer changes. According to the ineffectiveness of the Markov chain, the limit state of the system has nothing to do with the initial state of the system; that is, it has nothing to do with M(1), and everything is determined by the transition probability matrix P . Therefore, the transition probability matrix P reflects the teaching quality, teaching conditions, students’ mentality (style of study), and social environment. First of all, according to the existing teaching quality evaluation system research and the grading standards of students’ student performance, the percentage of passing grades is quantified. The limit state of M(t) shows that when these factors are stable, the overall teaching effect can be achieved under these conditions, and this possible degree has nothing to do with the students’ original foundation.
An obvious shortcoming of performance-based evaluation is that it ignores the basic differences of students, and the students’ learning progress from the early stage to the later stage is not reflected. Therefore, grades alone cannot truly reflect the quality of teaching at this stage. The evaluation method established by the Markov chain can make up for this defect [10–12]. The specific method is as follows.
On the basis of the previous algorithm, a “progress” model is established. After the stage of teaching, the original i-level becomes j-level. When , it is progress, and when , it is regress. Let
Among them, is called the degree of transfer progress of , and is called the weight of . The magnitude and sign of the value of indicate the degree of progress or regression. The index “3” is used to adjust the plus and minus and the weight. The matrix with as the element is called the progress matrix of the transition matrix A; is called the efficiency of transition matrix. is used as a numerical feature to evaluate the quality of teaching. The larger , the more the transformations belonging to , and the higher the quality of teaching.
At the same time, the long-term prediction of teaching is of great significance in teaching. Throughout the teaching process, although the frequency of students at all levels in each stage of the examination is constantly changing, the transfer ratio of students at all levels tends to be stable. Each stage can be approximately regarded as having the same one-step transition matrix, the entire teaching process is a Markov chain, and this Markov chain is nonperiodic and irreducible [13–15]. We can use the ergodic theorem of the Markov chain to establish a mathematical model for teaching long-term prediction. The specific method is as follows.
Construct the state vector P and the one-step transition matrix A according to the test scores of the last two stages, solving the system of equations , where is the limit vector of the transition matrix A (i.e., the solution of the system of equations): . According to the principle of maximum probability, is taken as the grade evaluation of the long-term effect of teaching. If the overall situation is evaluated, a comprehensive score can be further calculated for evaluation.
3. The Improvement of Markov Chain in the Evaluation of Mixed Classroom Teaching Quality
The hybrid teaching method is formed by applying new technical tools to traditional teaching practice with the advancement of information technology, and making a deep analysis of its existing problems [16–19]. In the actual application process, the blended teaching mode shows several obvious advantages over traditional teaching methods. The details are shown in Figure 2.
As mentioned earlier, in the practice of mixed classroom teaching, the Markov chain method is used for evaluation. Generally, the relationship between two successive value states (such as two test results) is used to describe the transition probability matrix [20, 21]. And from this, the practice of the evaluation object to reach the current state is evaluated. However, whether the value scales used in the previous two times are the same and whether the scenes evaluated on the evaluation object are the same two times will affect the determined state matrix. Then according to the application of Markov chain transition probability matrix, the traditional teaching and flipped classroom teaching are compared, and whether the effectiveness of flipped classroom teaching quality has changed significantly is studied [22, 23]. When using the obtained probability vector to solve the system of equations, the characteristic root of the vector has been artificially determined to be 1, and then the evaluation standard is established. As for whether each state is stable, the user should verify it by solving. In actual teaching applications, the evaluator does not consider this condition but assumes that it reaches a steady state. In fact, this condition has a certain impact on the construction of a stable probability distribution. Therefore, it is necessary to improve the algorithm of Markov chain in the evaluation of mixed classroom teaching quality.
Combine the student’s two exam results into a sample, and find the average and standard deviation . Studies have shown that students’ academic performance is basically normally distributed or close to a normal distribution. Therefore, according to the law of normal distribution, and s can be used to divide m levels within a certain interval. Then calculate the state vector of the ratio of the number of students in each level to the total number of students in the previous exam by m levels, denoted by A:where n is the total number of students and q is the number of -level students. A represents the set of these vectors, from the first to n. Among them, each level represents the weight of each individual student in total.
In order to examine the teaching effect, it is necessary to analyse the changes in each level of the abovementioned students in the second examination. Similarly, the scores of the second test are also calculated according to the interval standards of m levels, and the frequency of students included in each level is counted, so as to find the transition matrix P in the next step:
Among them, still represents the number of students in the i-th grade at the initial stage, and represents the number of students who belong to the i-th grade after the stage of teaching, and their scores belong to the number of students in the j-th grade and satisfy . This not only solves the problem of inconsistent value states but also gives full play to the characteristics of the one-step transfer matrix of the Markov chain. That is to say, it can eliminate the basic differences but also reflect the advantages of its change efficiency [24, 25].
3.1. Establishing a Mixed Classroom Teaching Model and Analysis
In order to avoid the multistep transition of the Markov chain, and the demanding condition of stable probability distribution that can only be obtained in the limit state, the student’s “progress” is used to consider whether the student is progressing or regressing. The detailed analysis of time benefit analysis is based on two tests. That is, “pretest results and posttest results.” Now suppose that cultivating i-level students to level students is progress, and cultivating i-level students to level students is regression. Grasping this point can eliminate basic differences and at the same time reflect the effectiveness of teaching. In order to accurately extract the change information from the transition matrix, the following algorithm model is established: is called the progress matrix of the transition matrix . is called the efficiency of transition matrix .
4. Algorithm Analysis of Mixed Classroom Teaching Quality Evaluation Based on the Improved Markov Chain
Considering the unique characteristics of blended teaching compared with traditional teaching methods, certain basic principles should be followed in the process of constructing a blended teaching quality evaluation system, as shown in Figure 3.
This part of the content is based on a total of 450 students in three grades of 2017, 2018, and 2019 (150 students for each grade) of a university. Each grade selects students from Guangdong in the five majors of information management, basic physics, medical laboratory, pharmacy, and life sciences. This research material mainly selects the college English test scores of the three grade students in the previous year and the current year as the research objects. By using the Markov chain statistical model to analyse the transition probability and limit distribution of the grades of students in each grade, the teaching effect and quality of each grade are analysed.
4.1. Construction of a Hybrid Teaching Quality Evaluation System Model Based on the Markov Chain Algorithm
Combining the characteristics of the mixed-teaching model and following the basic principles of the construction of the mixed-teaching quality evaluation index system, we have constructed an evaluation model including basic evaluation, process evaluation, and result evaluation (Figure 4). Through careful analysis of the changes of the students’ two tests in different grades, the transfer of student group performance in the two tests is studied, and a transfer matrix is formed to give the expected time for students of each level to reach the predetermined goal.
4.2. Determination of the Set of Evaluation Factors and Establishment of the Set of Evaluation Indicators and Comments
By consulting the literature and combining the characteristics of college English teaching courses, summarize the classroom teaching quality evaluation factors shown in Figure 5. To describe a system with a mathematical model is to quantify the main indicators in the system and express them in mathematical expressions. According to the content mentioned above, the comment set of this article = “excellent,” “good,” “medium,” “qualified,” and “unqualified”. The corresponding comment score set = excellent (90 points or more), good (80–90 points), medium (70–79 points), qualified (60–69 points), and failing (59 points or less).
4.3. Determination of the Index Weight
When calculating the weight of the influence factor applied to the evaluation of teaching quality, the principle of Markov chain algorithm is used to input the relative importance of the evaluation index of teaching attitude, the evaluation index of teaching content, the evaluation index of teaching method, and the evaluation index of teaching, respectively. According to the common situation in school teaching management, this study quantifies the teaching effect index, which is to divide all the teaching objects (experimental class and control class) into m grades for a certain test, that is, as the judgment matrix of the teaching quality evaluation system, the data required for calculation in the teaching quality evaluation factor of the first-level criterion level. Specifically, the process of calculating the weights of the teaching quality evaluation factors at the first-level criterion level and the second-level criterion level is shown in Figure 6.
Thirty representative teachers in the frontline and teaching management positions were invited to fill in the Questionnaire on the Importance of Teaching Quality Evaluation Indexes in Colleges and Universities, and 15 high-quality questionnaires were selected as the survey results. According to the results of the questionnaire, the weight of each evaluation index is calculated. Table 1 shows the weights of evaluation indicators calculated based on the results of a questionnaire. In order to ensure correctness and operation efficiency, this article uses Python programming to achieve classroom teaching quality evaluation, and the efficiency has been very well improved. After the weights of the 15 experts’ evaluation indicators are calculated, and then the arithmetic average value is calculated, the final weight value of each indicator can be obtained.
4.4. Collection and Arrangement of Teaching Quality Data
Choose 5 classes (30 students in each class) with a balanced level of learning ability in the same major and taught by the same experienced teacher with a higher level of teaching. In each class, the first stage of teaching uses traditional teaching methods, and the second stage of teaching uses a mixed classroom teaching model. On the basis of the analysis of the student population, we use SPASS statistical software and MATLAB mathematics software for data processing, which can obtain information on the teaching quality and effectiveness of the two classes. Two assessments are carried out during the teaching process, the spot midterm test and the final exam are combined, and the final scores are all recorded using the average score. The traditional teaching assessment score data is shown in Figure 7.
Through the second stage of the mixed classroom teaching study, the class students’ academic records of each score segment of the two test scores are sorted, and the average conversion rate of each score segment is . represents the average percentage of students’ academic performance in the traditional teaching [0, 10] fractional period; j = 1 represents the average percentage of students’ academic performance in the [0, 10] fractional segment under the mixed-teaching classroom teaching mode, so on and so forth. The purpose of this is to find out the changes in the students’ test scores after the teacher teaches. This level change is a discrete state change, so the consideration is more in line with objective reality. The specific transition probability is
5. Result Analysis of Classroom Teaching Quality
5.1. Markov Chain Algorithm Analysis of the College English Test Scores of the Previous Year and the Current Year
According to the average scores of the 2017, 2018, and 2019 exams in Table 2, the teaching effect is considered. The 2017 grade is the highest, but this kind of teaching effect evaluation method ignores the students’ original foundation. Therefore, it is necessary to analyse the teaching effect of different grades through the Markov chain model. The solution of this set of equations gives the expected time for students of each level to reach the predetermined goal. See Table 2for the status transition of the three grades from the previous year to the current year. The English score transfer matrices of the three grades obtained from Table 2are
According to the linear equations, the distribution vector of 2017 students’ English scores is
The distribution vector of English scores of 2018 students is
The score distribution vector for the 2019 grade is
It can be seen from the above vector distribution that the failing rate of 2017 students is 13.25%, the failing rate of 2018 students is 11.32%, and the failing rate of 2019 students is 0.12%. Judging from the failing rate, the students in the class of 2019 are the best overall. In order to quantify the teaching effect, the four grades were assigned scores: excellent = 90, good = 80, medium = 70, pass = 60, and failing = 50. Using the limit distribution to perform weighted average, the quantified values are as follows:
The above amount is in the three grades, although the students’ English test scores of the previous year and the current year are the highest in the 2017 grade. But the Markov chain model shows that the 2019 students have made the most progress and the teaching effect is the best. And there is no significant difference in the overall progress of the three grades. This also shows that the school’s English teaching level has improved in 2019.
5.2. Evaluation and Analysis of Teachers’ Teaching Work
Taking the mixed teaching of college English teaching in the two classes (Class 1 and Class 2) of the university’s information management major in Grade 2018 as an example, the improved Markov algorithm is used to evaluate the teaching work of two college English teachers. Any kind of mathematical quality index of each person corresponds to a degree of high, medium, and low grade, which is determined by the attribute measurement function of the index. The performance statistics and transfer of the two classes are shown in Table 3.
From Table 3, we can see that the transition probability matrices of the college English test scores of the two classes are
Using Formula (3) to find the stable distribution of the transfer of the college English test scores of the two classes, the equations can be listed:
Putting P1 and P2 into (3) can be solved:
Finally, using Formula (5), the scores of the quantitative index of epidemiology teaching effect in two classes can be obtained: ; . It can be seen that . The above method of solving the expected time is a simple method, but it loses a lot of important and useful information. So we can introduce a matrix and use the method of solving the inverse matrix to get a lot of gains. This shows that, after excluding the influence of the different foundations of the two classes, the teaching effect of college English in Class 2 is better than that in Class 1.
5.3. Algorithm Training of the Network and Algorithm Time Comparison of the Improved Markov Chain Algorithm
This article takes a college English teaching supervision expert evaluation of the first semester of the 2017–2018 academic year as an example. We measure each indicator in the form of usual tests, investigations, and questionnaires, obtain the percentage of each indicator, and divide these scores into three grades: high, medium, and low. The evaluation indicators in this research are used as the input sample of the network, and one evaluation result is used as the output of the network. According to the Markov algorithm formula, train these data and set the network parameters in the MATLAB simulation program: the number of network layers is 2, the transfer function of the hidden layer is logsig (s-type logarithmic function), the transfer function of the output layer is purelin (linear function), and the training target is 0.002. Finally, it is determined that the number of hidden layer nodes with the smallest mean square error is 9. At this time, after 4 iterations, the network training error curve is shown in Figure 8(a).
It can be seen from Figure 8(a)that the algorithm of this study can meet the accuracy requirements through 4 iterations, the training time is short, and the training results meet the desired goals.
The improved Markov chain algorithm reduces the generation of new duplicates during the union, thus improving the operating efficiency. We stipulate that an attribute measurement function is determined by the performance distribution of each index and the membership degree of the research question. The time comparison between the improved algorithm in this paper and the classic algorithm is shown in Figure 8(b). From Figure 8(b), it can be seen that the running time of the improved algorithm is generally half the time of the traditional algorithm. The improved algorithm reduces the access to the database, so the time increase is relatively slow.
The Markov chain model has a wide range of applicability. The evaluation object can be a university, a teacher, a class, or a certain student. It can also be used to evaluate the quality of teaching materials, students’ abilities (character, interest, physical fitness, etc.), test paper quality, etc. For simple systems, single-level evaluation can be used, and for complex systems, multilevel evaluation can be used, but the mathematical methods are the same. The teaching quality evaluation based on Markov chain random process theory is a dynamic evaluation method based on development. In the case of excluding external factors, make full use of the large amount of information contained in the one-step transition probability matrix of the Markov chain to evaluate the changing law of teachers’ teaching quality. Based on the theory of Markov chain, this paper establishes an evaluation index system for teachers’ teaching quality in Gao School through the analysis of a large number of documents and determines the index weights. Then a fuzzy dynamic comprehensive evaluation model of university teachers’ teaching quality based on Markov chain is established. And based on the evaluation data of the students in the teaching class of a certain main course teacher in a certain university, the dynamic evaluation model established in this paper is used to evaluate the teaching quality. The evaluation results show that the model has high scientificity and practicability. The dynamic evaluation model is not only based on the first evaluation behaviour of students but also can continuously evaluate the teaching quality of current and future teachers. It can also find out the problems in the teaching process of teachers in time and solve them in time to achieve the expected training goals and improve the teaching level and the purpose of talent training.
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The author declares no conflicts of interest.
The author acknowledges the Key Projects of the Ministry of Education in 2016 of the 13th Five-Year Plan of National Education Science: Research on the Application of Visual Analysis Technology for the Professional Development of University Teachers (no. DCA160264).
M. Lianguang, “Evaluation of the teaching effect of construction engineering cost software based on the Markov chain,” in Proceedings of the 2012 Second International Conference on Intelligent System Design and Engineering Application, pp. 832–836, Sanya, China, January 2012.View at: Publisher Site | Google Scholar
X. Y. Huang and S. Q. Feng, “Research on the teaching quality evaluation for the physical education in colleges based on the ahptopsis,” Chemical Engineering Transactions, vol. 46, pp. 487–492, 2015.View at: Google Scholar
M. Luo, “Application of AHP-DEA-FCE model in college English teaching quality evaluation,” International Journal of Applied Mathematics and Statistics, vol. 51, no. 21, pp. 101–108, 2013.View at: Google Scholar
X. Zhang and Z. Jun, “Notice of retraction application of homogeneous Markov chain in quantitative analysis of teaching achievement indicators in physical education,” in Proceedings of the 2010 Second International Workshop on Education Technology and Computer Science, pp. 530–532, Wuhan, China, March 2010.View at: Publisher Site | Google Scholar
B. Wang, F. C. Zou, J. Cheng et al., “Fault detection filter design for continuous-time nonlinear Markovian jump systems with mode-dependent delay and time-varying transition probabilities,” Advances in Difference Equations, vol. 2017, no. 1, Article ID 262, pp. 1–23, 2017.View at: Publisher Site | Google Scholar
F. Zhang, W. Fang, C. Zhou, and Z. Liu, “A brief study on teaching evaluation system based on fuzzy rule with scientific teaching materials,” in Advances in Computer Science, Environment, Ecoinformatics, and Education, pp. 99–105, Springer, Berlin, Germany, 2011.View at: Publisher Site | Google Scholar