Abstract
In order to improve the effect of popular music teaching, this paper combines the intelligent music frame feature recognition technology and the semifinished product teaching strategy to construct a multimedia popular music teaching system. Moreover, this paper reexpresses energy detection and zero-crossing detection mathematically from the perspective of aggregation and proposes a new two-level detection method for music frames. In addition, this paper uses the fusion and expansion of the zero-crossing rate detection result to judge whether a piece of speech is a valid musical speech. Finally, this paper uses a four-tier architecture to design the system framework, constructs the system functional modules, builds a multimedia pop music teaching system that incorporates semifinished teaching strategies, and then validates the performance of the system. From the experimental research, it can be seen that the multimedia pop music teaching system integrated with the semifinished product teaching strategy proposed in this paper can play an important role in music teaching and effectively improve the effect of music teaching.
1. Introduction
As a kind of music culture with great characteristics of the times, popular music is more and more widely used in music teaching, and it has won the attention of all walks of life. Diversification is the right direction for the development of art. As a kind of art, the types of music should also be diversified. Moreover, music teaching should focus on not only traditional music, but also modern music [1]. Popular music meets the aesthetic and psychological needs of the public, and the appreciation of popular music requires the audience to have sufficient imagination and aesthetic ability. There are countless popular music works today. Music teachers need to pay attention to popular music that is closer to students’ lives and has a profound impact on students and introduce it into music teaching reasonably, so that students can learn popular music more happily, understand popular music more deeply, feel the beauty of popular music more fully, and then create an efficient music classroom [2].
Once, people classified “pop music” as popular, simple, and clear popular music and also generally referred to “pop songs” with short structure. Once upon a time, it has become synonymous with youth “rebellion.” Moreover, many music scholars have their own opinions and opinions on whether “pop music” can appear in various professional colleges and establish separate disciplines. Since the reform and opening up, with the continuous development of the national economy, national culture, and entertainment living standards, our understanding of popular music has been updated and deepened [3].
We spend more time understanding and studying the development history of popular music and overturning outdated and narrow cognitions in a gradual understanding. Since the birth of Jazz in the 19th century, this nascent art form has incorporated more forms and possibilities and has integrated cultures from different regions in a century of development. The cultures of many countries and different nationalities are constantly developing and progressing, and people are willing to learn and explore for them. In fact, any form of musical expression and musical style contains abundant regional culture and national characteristics. More music scholars will integrate their personal emotions and absorb the best of the culture of various countries, and show them in the form of “auditory”. Several famous music schools in the world have established professional disciplines for popular music, such as the Manhattan School of Music and Berkeley School of Music in the United States and the Royal Academy of Music in the United Kingdom. These schools not only have achieved brilliance in various music systems, but are also at the world's advanced level in the form and diversity of popular music, with mature forms and sound systems. In recent years, major music schools in China have also made active efforts in the subject of popular music and have achieved certain developments. In addition to the establishment of special disciplines, a large number of pop music talents have also been cultivated, and they have emerged and are active on the music stage.
Based on this, this paper integrates the teaching strategies of semifinished products to construct a multimedia pop music teaching system and evaluates the teaching effect of the system, so as to provide a theoretical reference for the follow-up pop music teaching.
2. Related Work
Literature [4] discussed three aspects: the historical evolution of music communication media, the emergence of new audiovisual media, and the dominant trend of online music communication. Literature [5] sorted out and analyzed the content of modern educational technology. In the aspects of informatization teaching design and informatization teaching practice, literature [6] has made a more detailed elaboration. Literature [7] analyzed the importance of teachers’ information and communication technology and collaboration ability requirements in teachers’ professional competence standards by comparing with the old standards. Literature [8] elaborated on the problems existing in music appreciation teaching and singing teaching and pointed out that music teaching should not deviate from the music itself and should use music as the main line to guide students to experience the image and content of music under the stimulation of sound. Literature [9] pointed out that, in music classroom teaching, it is necessary to reflect the basic concept of the curriculum and to not only highlight the characteristics of the subject, but also pay attention to the integration of the subject. Literature [10] explains the current misunderstandings in primary school music teaching from five aspects. It includes the misunderstanding that the implementation of the new curriculum standards is not in place, the misunderstandings of emphasizing the form of the classroom and not the transfer of knowledge, the misunderstandings of focusing on individual training and ignoring overall improvement and development, the misunderstandings of emphasizing textbook teaching and ignoring the development of local music curriculum, and the misunderstanding of emphasizing the improvement of teaching conditions and ignoring the full use of teaching conditions.
Literature [11] pointed out that music teaching should arouse students' desire for knowledge and true feelings and promote students' aesthetic ability. Literature [12] mainly discussed the hot and difficult issues in current music education. Literature [13] comprehensively analyzed the principles, learning modes, and implementation methods in the integration process of information technology and music courses on the basis of existing theoretical analysis. Literature [14] analyzed the pros and cons of multimedia in music education in primary and secondary schools. According to the current application of multimedia technology to music teaching, literature [15] has made some thoughts and studies on the role and prospects of multimedia in the actual process of music education through the breadth and depth of multimedia application and the perspective of teaching achievements. Literature [16] proposed that the correct use of multimedia teaching methods for music teaching is of great significance to the improvement of music teaching theories and standards. Literature [17] studied people's activities in music education from the perspective of psychology, including the psychological activities that students find when experiencing music, expressing music, creating music, and learning music knowledge and skills and music culture and psychological activities during music appreciation, which are used to guide educational activities. This has provided a great help for the research in the music classroom of elementary and middle schools in this paper.
Literature [18] defined multimedia technology, which refers to the technology that uses image, sound, animation, and other visual materials to present in an intuitive form. When used in teaching, it plays a very important role in improving classroom teaching efficiency and enriching students' cognition. The use of multimedia technology in classroom teaching also proves the development of modern education. Based on the in-depth explanation of the main body of the music classroom, literature [19] discussed the application of multimedia technology in the classroom, and it is directly linked to the teaching effect. Moreover, it believes that multimedia technology should be widely popularized in music classrooms, which is of great significance for improving the efficiency of music classroom teaching. Literature [20] believed that, under the requirements of today’s new curriculum reform, the compulsory education stage of music teaching has undergone profound changes in all aspects, especially for the cultivation of students’ music literacy, which is the top priority and purpose of the reforms over the years. Literature [21] discussed the role of audiovisual artistic effects in music teaching from the perspective of multimedia technology applications. On this basis, it analyzed this issue in combination with corresponding teaching cases and believed that the effect of multimedia audiovisual art has a very positive significance for the efficiency of music classroom teaching.
3. Feature Extraction Technology for Music Frame Recognition
3.1. Popular Music Frame Feature Recognition
Each piece of music frame signal contains very rich personality characteristics of the singer, in addition to the short-term average energy, amplitude, and other time-domain characteristics. And there are many frequency domain parameters that can express various characteristics. If the characteristics of a piece of music frame signal are expressed more accurately, it is necessary to process the piece of music frame signal. Then the analysis of the signal to be measured must be completed after finding the starting end of the signal. The features extracted from unprocessed signals must be valuable characteristic coefficients, eliminating redundant information that is meaningless for music frame recognition, thereby weakening the amount of data to be analyzed in the subsequent recognition process.
Predictive coding usually uses a set of filters H(z) to simulate channel characteristics. The specific algorithm of H(z) is as shown in the following formula:
Here, is the order of LPC.
From formula (1), x[n] can be calculated, as in the following formula:
When estimating the current sample size, the previous samples are used for linear estimation. Therefore, this algorithm is called linear predictive coding. The specific algorithm is described in
The error value e[n] of linear predictive coding is shown in
The algorithm calculates the logarithm on both sides of H(z) and expands the Fourier series of to obtain the following formula:
Subsequently, the two sides of the equation are differentiated with respect to , and then we get
The equation is finally reduced to
By modifying the exponents on both sides of the equation, the relationship between and can be obtained:
It can be seen from (6) that the greater the order of the linear cepstrum, the greater the amount of information that can be preserved. In practical applications, since the LPC coefficients are linear signals at all frequencies, they are not consistent with the auditory characteristics of the human ear. This feature will affect the recognition ability of the music frame recognition system. In addition, the LPC coefficients contain a lot of high-frequency noise, which will also lead to a reduction in the discrimination ability of the music frame recognition system.
An amount of experimental data show that when the music frame signal does not exceed 1000 Hz, the perceptual performance of the human ear maintains a stable linear relationship with the frequency of the signal. However, when the frequency exceeds 1000 Hz, the relationship between the perception performance and the frequency becomes linear. The mel cepstrum coefficients are solved under the condition of using the filter bank. The width of this type of filter bank on the mel frequency scale is equal, and the MFCC spectrum is converted to coordinates based on the mel frequency. And its transformation formula is shown in (7a) or (7b):
Here, represents the frequency in the mel spectrum, and represents the frequency based on the ordinary spectrum. The specific process of solving the MFCC process is shown in Figure 1.
3.1.1. The Difference of MFCC
As shown in the figure, the specific steps of MFCC include preemphasis, endpoint detection, framing, windowing, Fast Fourier Transformation (FFT), mel frequency filtering, Discrete Cosine Transform (DCT), and other key operations.
MFCC can only express the static characteristics of the sound signal. However, it is difficult to accurately extract the characteristics of singers using only one feature parameter. Only by combining dynamic and static features, it can achieve reliable performance requirements. In order to improve the recognition performance of the system, the difference of MFCC (Delta MFCC) is introduced, and its parameter d is as follows in the calculation formula:
In (8), t represents the t-th time, C is the cepstral coefficient, Q is the order of the cepstral coefficient, and K represents the time difference.
Delta MFCC essentially weights and differentiates the feature parameters extracted by MFCC to further extract features. The voice features extracted twice by Delta MFCC can better express the continuous dynamic change law of the music frame signal, and it can also extract the difference multiple times to make the feature extraction effect better. In the music frame recognition system, generally the first-order difference is sufficient. The specific extraction process is shown in Figure 2.
From the difference flow chart in Figure 2 and the MFCC flow chart in Figure 1, it can be seen that adding the difference will actually add a step and increase the complexity of the calculation. From the application point of view, this paper studies a music frame recognition system based on mobile terminals. Taking into account the limitations of the mobile terminal itself, the difference of MFCC will increase the computational complexity and space complexity, and the effect may not be ideal in practical applications.
3.1.2. CMVN
The statistical characteristics of speech features are affected by the noise environment. Applying the normalization method to the speech recognition system can compensate for the impact of environmental noise mismatch and then improve the system's recognition rate. Most normalization methods are applied in the cepstrum frequency domain as the postprocessing of speech features. Among them, MFCC is widely used, and a variety of robust speech technologies are developed based on it. Its advantage is that it does not require any prior knowledge of noise environment and adaptive methods, it is easy to operate when implemented, and the effect is relatively ideal. One of the normalization methods is CMVN, that is, Cepstrum Mean Variance Normalization (CMVN). Its main purpose is to reduce the noise parameters in the voice channel, making the music frame signal more pure, and making feature extraction more efficient. The specific algorithm process of CMVN is as follows.
First, we calculate its cepstral sequence X(n). The Nth moment of X(n) is defined as follows:
In (9), X(n) is the sequence of cepstral coefficients, and T is the sequence length.
Under normal circumstances, the cepstrum of the music frame signal is Gaussian distribution, then its odd-order moment value is 0, and the even-order moment is a certain constant. The characteristics of the cepstrum sequence normalized by the Nth moment are
According to (10), CMVN can be defined as
Here, X[L, N] is the corresponding sequence after the L and N moments of X(n) are normalized at the same time.
3.2. Probabilistic Model of Music Frame Recognition
Building a probability model is a key step in music frame recognition. Therefore, the choice of probability model is very important to the effect of music frame recognition. Currently commonly used probability models are the following: based on dynamic time warping (DTW), vector quantization (VQ), HMM (hidden Markov model), and GMM. This section will introduce GMM and HMM.
GMM is a Gaussian mixture model. Although the voice distribution of singers is different, there is no strict curve law. However, almost all distributions can be approximated by using the mixture weight value of the Gaussian distribution, thereby obtaining a Gaussian mixture model.
Here, X is a high-dimensional random speech feature vector; , is the weighting coefficient of b and (X) corresponding components; and M is the number of components in the Gaussian mixture model. For and , they satisfy the following formula:
We set as a parameter to describe a model, and we can get
All parameter values should be classified according to a certain criterion, among which the maximum likelihood estimation algorithm is the most commonly used.
The estimation of GMM parameter values is based on the maximum likelihood criterion (ML), which is realized by the EM iterative algorithm. At this time, the following iterative formulas for model weight, mean, and variance can be obtained:
Here, is the posterior probability of the i-th mixed component.
HMM is different from GMM and is generally used to describe the statistical characteristics of the signal. When it is used to describe the statistical characteristics of a signal, two random processes are used. And these two random processes are interrelated. One of them is the hidden Markov chain, and the other is the random process of observing the vector, which is associated with each of the states of the Markov chain. After studying and observing the signal characteristics, the characteristics of the hidden Markov chain can be revealed. For continuous speech recognition, HMM is currently the best model and algorithm. And with the continuation of the research, its performance in all aspects is also constantly moving forward.
The HMM speech recognition process is shown in Figure 3.
As shown in Figure 3, HMM is divided into three problems: evaluation problem, identification problem, and training problem:(1)We already know that the model and the output (the given observation sequence). When calculating the corresponding probability of generating Y, if there are several models to choose from, after solving this problem, the model that best matches the given observation sequence can be selected.(2)We already know that the model and the output Y (how to estimate the input state X that is most likely to experience when this output is produced, that is, how to select the corresponding optimal observation sequence).(3)If the model parameters are continuously revised by many outputs Y, the model parameters = fA, B) are optimized, so that the final model parameters are consistent with the output with the greatest probability.
The energy-zero-crossing rate two-stage fusion method can be achieved through the following steps.
3.2.1. The First Level of Judgment Is Energy Judgment
First, determine a threshold (in this paper, the empirical threshold) as the judgment standard, and compare the threshold T with the normalized metric T of the average energy of the music frame signal, and then determine whether the music frame signal is the singer's voice. However, in general, the music frame signal can only maintain an approximately stable characteristic in a short period of time. Therefore, the music frame signal under short-term conditions can be treated as a steady signal. In order to obtain the short-term music frame signal, it is necessary to perform translation weighting on the original signal through a window of constant frame length, which is also the framing process of the music frame signal. In this paper, the Hamming window w(n) is used to divide the music frame signal, and its definition is in the following formula:
Here, N is the length of the Hamming window. After framing processing, the short-term average energy of the music frame signal x(n) can be obtained, that is, the average energy E of the speech frame, and its calculation formula is as follows:
In (18), x(m) is the sampled music frame signal. The normalized metric T of the short-term average energy of the music frame signal is defined as
Here, is the maximum value of the average energy of all speech frames, i represents the i-th speech frame, and M represents the total number of speech frames.
If , the speech frame is judged to be the voice of the singer, and the coefficient of the speech frame is assigned as “1.” If , the speech frame is judged to be a nonsinger speech, and its coefficient C = Z is defined. A piece of music frame signal has to go through M consecutive speech frame judgments, and an I×M-order matrix M composed of “0″” and “1″” can be obtained. As the result of the first energy judgment, the definition of matrix M is as follows:
3.2.2. The Second Level of Judgment Is Zero-Crossing Rate Judgment
Since the music frame signal is very unstable and can only remain stable within a short period of time, the zero-crossing rate judgment of the music frame signal is also involved in the short-term zero-crossing rate. The judgment rules are as follows.
The algorithm selects the threshold ZCR (in this paper, the empirical threshold 5 is selected). If the zero-crossing rate of the voice frame is lower than the threshold, it means that there is no singer's voice, and the coefficient of the frame is assigned as “0.” Conversely, if it is higher than the threshold, the coefficient of the frame is assigned a value of “1.” That is, the judgment result of the second zero-crossing rate is obtained as the following formula:
The zero-crossing rate formula is as the following formula:
In formula (23), sgn[] is a symbolic function, expressed as the following formula:
4. Judgment Fusion
Step 1. It first takes the union of the two judgment results and to obtain the preliminary fusion result , as shown in Here, is the speech frame coefficient after fusion.
Step 2. If there is such a speech frame : in the first energy judgment, it is judged to be the speech frame of the nonsinger's speech (that is, ), and in the second zero-crossing rate judgment, it is judged to be the speech frame of the singer's speech voice frame (that is, ). Then the coefficient r after the fusion of the two is cleared to zero. In other words, if and , then we set . In this way, the detection result can be obtained, which is also the final result of the two-stage fusion endpoint detection method based on energy and zero-crossing rate. The specific process of this improved algorithm is shown in Figure 4.
According to the algorithm flow in Figure 4, an example is given to illustrate the two-stage fusion endpoint detection method based on energy and zero-crossing rate. For example, if the energy judgment result of a certain segment of speech isAnd, the result of the zero-crossing rate judgment isThen, its preliminary fusion results areSince and , and , and , are all assigned the values “0.” The final endpoint detection result isThe energy-zero-crossing rate two-stage fusion detection algorithm proposed in this section is applied to the actual music frame signal endpoint detection, and the detection effect is shown in Figure 5.
In the actual detection effect experiment shown in Figure 5, the upper part of the music frame is the input unprocessed voice, and the lower part is the voice after endpoint detection. It can be seen that the endpoint detection accurately cuts out the effective voice segment. Among them, the tested singers were asked to speak 10 two-syllable words within 20 seconds.
5. Evaluation of Multimedia Popular Music Teaching Effect Integrating Semifinished Teaching Strategies
The “semifinished product processing” strategy is an advanced teaching concept and method that has become more popular in recent years. It refers to providing teachers and students with partially completed teaching works, that is, “semifinished products.” It can be understood as a kind of technology “retaining” the complete teaching results (finished products), simulating the real problem solving environment, supplementing these blanks which is “reprocessing” and teaching in the process of forming the “finished products.” Using the “semifinished product processing” teaching method, neither teaching nor practice will destroy the authenticity and integrity of the overall work. Moreover, it simplifies the process of reoperation, solves the problem of the difference in the progress of the students' operation, and ensures the continuity and integrity of the teaching content and the student's operation technology. At the same time, it can enable students to master the essentials of each operation link in a short time, improve the efficiency of teachers' regular teaching explanations, students' understanding of concepts, and practical exercises, and optimize the learning situation and training environment.
This article uses B/S framework, SQL server database for development, and SOA service framework as the overall structure of the system. Taking into account the overall integration of each module and the system, a four-tier architecture is used to design the system framework, namely, the data storage layer, the data access layer, the interface service layer, and the business function layer. Among them, the data storage layer saves the basic data and business data of the entire systems and uses the SQL server database to manage the data. The data access layer provides data interface services for the system through SQL language. The interface service layer is written using the J2EE service framework, provides Weblogic services, and provides interfaces for the various functions of the system to retrieve and download data resources. The business application layer provides all system functions used by users, including system management, online Q&A, online examination, course resource management, and user login. The interaction with the user is realized through the WEB interface, as shown in Figure 6.
The audio processing system includes two parts: a feature extraction module and a feature processing module. The feature extraction module includes a pitch frequency recognizer and a pitch acquirer, as shown in Figure 7. The built-in pitch frequency recognition methods of the pitch frequency recognizer include cepstrum method, harmonic peak method, cyclic direct method, wavelet transform method, and parallel processing method. According to the method of obtaining the pitch selected by the teacher in the teacher guidance system, the pitch frequency data feature is extracted.
The multimedia pop music teaching system integrated with the semifinished product teaching strategy mainly uses the B/S three-tier system structure, as shown in Figure 8.
After constructing a multimedia pop music teaching system that integrates semifinished product teaching strategies, the performance of the system is verified. This article mainly examines from two aspects of music frame feature recognition and music teaching effect and conducts research through simulation experiments. Construct a simulation system model through Matlab and perform system performance evaluation and analysis combined with expert evaluation methods. Compare the method in this article with literature [11]; the results are shown in Tables 1 and 2 and Figures 9 and 10.
From the above research, it can be seen that the multimedia pop music teaching system integrating semifinished product teaching strategies proposed in this paper can play an important role in music teaching and effectively improve the effect of music teaching.
6. Conclusion
From the perspective of development momentum, the education of popular music will become an indispensable part of the education system of various music colleges, and the teaching of sight singing and ear training as the basis of various disciplines is obligatory to incorporate popular music elements into the teaching. Music learning is different from other subjects. Learners need to be effectively guided, and they need to use more flexible teaching methods to let students understand the abstract music teaching content. In today's social and cultural context, popular music continues to be popularized, and there are more and more people who love popular music, and the trend is gradually rising. As the basic course of music learning, sight singing and ear training should incorporate popular music into the teaching and then expand the teaching content and teaching space to enhance students' interest in learning. Based on this, this paper integrates the teaching strategies of semifinished products to construct a multimedia pop music teaching system and evaluates the teaching effect of the system, so as to provide a theoretical reference for the follow-up pop music teaching.
Data Availability
The labeled datasets used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The author declares no conflicts of interest.
Acknowledgments
This study was sponsored by Xinyang College.