- About this Journal ·
- Abstracting and Indexing ·
- Advance Access ·
- Aims and Scope ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Education Research International
Volume 2012 (2012), Article ID 912463, 8 pages
SVONAR: A New Quantitative Method for Studying Learner Satisfaction
1Faculty of Health Sciences, University of Maribor, Žitna ulica 15, 2000 Maribor, Slovenia
2Faculty of Electrical Engineering and Computer Science, University of Maribor, Smetanova ulica 17, 2000 Maribor, Slovenia
Received 8 July 2011; Revised 7 January 2012; Accepted 19 February 2012
Academic Editor: Stephen P. Heyneman
Copyright © 2012 Peter Kokol et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
We investigated students’ feelings and well-being during the lesson. We were working on a problem of how to adjust teaching in the secondary school and achieve that students will feel as good as possible and better follow the instruction. A hypothesis was set that, by measuring the desired length of lesson and factors which influence lesson length, we can measure and influence student satisfaction. Based on this hypothesis we investigated the factors which have influence on lesson length in a particular subject. Data were collected by means of a questionnaire. The subjects were students of II. gimnazija (secondary grammar school). The responses were analysed to obtain correlations between the factors (average grade in a subject, boredness and likableness of the teacher, length and level of boreness of lesson content, fear of the teacher) and lesson length. Results suggest that, by modifying these factors we could change students’ opinions, that is, increase their willingness to attend classes. The set hypothesis was confirmed and it was shown that by using simple diagrammatic models built on the basis of linear regression we can identify and study the influence of these factors on lesson length.
Students in secondary schools are subject to increased demands and the syllabus has become more demanding. All participants in the educational process, both students and teachers, need to invest a lot of effort and time in order to achieve quality education and good results. This also results in a considerable time constraint and psychological pressure. Education has become difficult not only for students but also for teachers as providers of education. Solving problems like these is a considerable challenge. We decided to face the challenge knowing that our success could contribute to the effectiveness of the educational system and improved satisfaction of students and those involved in education.
Evaluation and assessment of educational systems has become a major factor in school governance. For example, Grek et al.  presents how the management of flows of information through quality assurance can be examined as a new form of governance, not just at the national level but within the broad policyscape of the European Union. Cohen et al.  defines the school climate as the quality, spheres, and character of school life which is based on patterns of people’s experiences of school life and reflects norms, goals, values, interpersonal relationships, teaching and learning practices, and organizational structures, thereafter it is more than individual experience it is a group phenomenon. Students, educators, and staff work together to develop, live, and contribute to a shared school vision. Empirical research indicates that positive school climate is associated with academic achievement, school success, effective violence prevention, students’ healthy development, and teacher retention. Courtney  argues that in a learner-centered view of education the learner’s needs must be understood and the learner must be engaged within the learning process. This view is supported by EU governments in the manner that educational organizations should provide evidence that the quality of education is improving. Kyriakides and Creemers  introduces a 5-dimensional quality assessment model which measures frequency, focus, stage, quality, and differentiation and presents its use in the classroom showing how it can explain variation in student achievements, and Johnes  shows how the data envelopment analysis (DEA) can handle multiple inputs and multiple outputs and is a suitable technique for measuring the efficiency of education institutions.
On the other hand it has been shown that student’s satisfaction and retention in educational institutions either at secondary or university level has a substantial impact on students’ educational experience , and, consequently, the impact on the position of the institution in the education market place. Student’s satisfaction with educational experience has been on one side measured with yes or no questions, or with some other simple satisfaction degree assessment  or, on the other side, with complex approaches like multiple-item weight gap score , Herzberg’s two-factor theory , and various survey instruments [8, 9].
Contrary to the above approaches our aim was to develop a very simple but informative instrument which can be easily employed by the teacher or by the educational institution quality assurance teams. In the research we focused mostly on student-teacher interaction. We proposed that the desired length of instruction (lesson) in a certain subject could be used as a metrics of student satisfaction; the student will want a shorter lesson if their needs are not satisfied during instruction and, vice versa, they will want a longer lesson if their needs are satisfied. By means of a survey (questionnaire) we wanted to identify the weight of various factors that influence students’ satisfaction and how this could result in changes of the length of instruction (lesson length) and consequently students’ satisfaction. Based on the literature review, following two important groups of factors influencing students’ satisfaction were selected “Boredom” [10, 11] and “Teacher characteristics” [12, 13] to which two additional factors “Grade” and “Subject loadedness” were added. We studied students’ satisfaction in the following subjects: Slovene language, Mathematics, English language, History, Geography, and Chemistry.
In our research we set the following hypothesis.
By measuring the desired length of instruction (lesson length) and factors that influence this length we can identify and influence student satisfaction.
1.2. Original Contributions
Original contributions of our research are as follows:(i)an innovation in lesson delivery by introducing varied lesson length, (ii)an introduction of the desired length of instruction as an indicator of student’s satisfaction with a lesson, (iii) a simple method and models for simulating the influence of various satisfaction factors on lesson length.
Our innovative theoretical proposition was that students’ satisfaction with their educational experience during a single lesson/instruction is directly proportional to their desired lesson length and that the lesson length is in linear relation to various factors shown in the following equation: where DLL is the desired lesson length, AG is the average grad, BT is the teacher boredness, LT is the teacher likeableness, FT is the fear of teacher, SC is the subject content loadedness.
In the research we used a questionnaire which provided the data on the required lengths of lessons and factors influencing these lengths. The students accessed each factor except the last one using five-point Likert scale ranging from “Totally agree” to “Totally disagree”.
Statistical analysis was made by using SPSS program for Windows 16.0. The simulation models were modelled by using Microsoft© Excel 2003.
Results were analysed by using Spearman bivariate correlation test by which we determined the correlation coefficient between dependent and independent variables, and the significance of this coefficient. We then used the linear regression method by which we identified the “weight” of each independent variable and the connection between independent and variables (boredom, grade, etc.) with lesson length.
2.3. Simulation Models
For the purpose of presenting the simulation models 3D diagrams were made as shown in Figure 1. The diagrams were made in such a way that both independent variables are on - and -axes, and lesson length is drawn on -axis. In each diagram, there is one independent variable that positively influences lesson length (by increasing it increases lesson length) and one that negatively influences lesson length (by increasing it decreases lesson length). These two independent variables were selected by using linear regression method, so that we chose the variable with the strongest positive and strongest negative correlation coefficients from Table 4. For better transparency and representation of the simulation model only two independent variables are shown in the diagram.
79 students (39 boys and 40 girls) aged 14–17 years participated in the survey.
3.2. Descriptive Data
Table 1 shows how students of II. gimnazija Maribor assessed the appropriateness of lesson length. Most students believe that lessons are too long. It is interesting that the average values in different subjects are very similar, as well are the minimum and maximum values. The highest value of lesson length is in Chemistry and the lowest in Geography.
Table 2 shows students responses to other questions in the questionnaire. In the first column we can see how students assessed syllabus loadedness on a 1–5 scale where 1 means most loaded and 5 means least loaded syllabus. It is seen from the table that they find the syllabus most loaded in Geography and least loaded in English. On average, students think that syllabuses of all subjects are overloaded. In all other questions 5 means very much and 1 means very little. The students find the content most boring in Geography and least boring in History. They find the teacher most boring in Geography and least boring in Chemistry. They find Chemistry teacher the most likable and Math teacher the least. Students are most afraid of Chemistry teacher and least afraid of English teacher. The highest average grade (mark) was obtained in History and the lowest in Geography.
3.3. Linear Regression by Subjects
Table 3 presents data on plane coefficients that were obtained by linear regression method and are given by subjects and various teacher/syllabus/learner characteristics. Those used in the models are coloured green. As shown in the table, lesson length was between 35 and 45 minutes in most cases, with a significant exception of Geography (28 minutes) and Chemistry (60 minutes). It is also seen in the table that, in most subjects, content boredness has the biggest influence on lesson length and that this influence is negative in all cases (the bigger the boredness the shorter the lesson). Content boredness has the biggest negative influence while teacher likableness has the biggest positive influence. It is interesting that in some cases, grade negatively (!) correlates with lesson length—students with higher grades want shorter lessons.
All coefficients, however, do not have the same “weight.” In Slovene language, content boredness is eight times more important than syllabus loadedness. In Math, content boredness is ten times more important than teacher likableness. In Geography, it is similar with the only difference that here we find the biggest difference between content boredness and teacher likableness. In Chemistry, grade is twenty-four times more important than teacher likableness.
3.4. Correlation Coefficients of Variables
In Table 4 we can see how strongly lesson length correlates with individual variables and how significant the correlation is. Significant correlations () are coloured blue. In most cases lesson length depends on teacher boredness (except in English)—always negatively. Similarly, the influence of content boredness is always negative. Fear of the teacher has least influence on lesson length—in our case only in History. In four of six subjects, average grade also influences lesson length. In three of these, the obtained grade positively correlates with lesson length. In one case it correlates negatively—the higher the grade the shorter is the lesson that the student wants.
On the basis of obtained correlation coefficients and linear regression coefficients we could build a simulation model for identifying suitability of lesson length (duration of instruction). In all subjects, two variables were always used as independent variables: one of them with the most negative and one with the most positive influence on lesson length. In this way we could determine the factors that we would need to change in order to increase students’ willingness to attend classes when the lesson length is 45 minutes. In Figures 2 to 8, the plane representing 45-minute lesson length is coloured red. The diagram in the figure made by using the above-described model is coloured green. At the intersection between these two planes the conditions suit 45-minute lesson length.
Figure 2 shows lesson length in Slovene language in correlation with content boredness and teacher likableness. It is evident that a 45-minute lesson length cannot be reached even in best possible conditions, that is, when both the teacher and the content are interesting. The shortest lesson length is 25 minutes and the longest lesson length is 43 minutes. Content boredness has a bigger influence on lesson length, which is also seen in Table 3.
Figure 3 shows the changing of lesson length in Math in correlation with syllabus loadedness and lesson boredness. We can see that if the syllabus is not too loaded we do need a likeable teacher to reach 45-minute lesson length. And vice versa, if the teacher is very likeable the syllabus can be overloaded to some extent. As seen from the diagram and Table 3, both independent variables have approximately the same influence on lesson length. Minimum lesson length is 26 minutes and maximum lesson length is 65 minutes.
Figure 4 shows the changing of lesson length in English in correlation with content boredness and teacher likableness. We can see that lesson length of about 45 minutes can be obtained if the content is interesting even if the teacher is unlikeable. In case where we have both an interesting content and a likable teacher the lesson can be 55 minutes long. In an English lesson, content boredness has most influence on lesson length (Table 1). Minimum lesson length is 25 minutes and maximum lesson length is 55 minutes.
Figure 5 shows the changing of lesson length in History in correlation with teacher boredness and teacher likableness. We can clearly see that even in best conditions (when the teacher is both likeable and interesting) we cannot obtain 45-minute lesson length. In History, both variables have approximately the same influence while teacher boredness has a slightly bigger influence. Minimum lesson length is 25 minutes and maximum lesson length is 40 minutes.
Figure 6 shows the changing of lesson length in Geography in correlation with syllabus loadedness and content boredness. We can see that to obtain a 45-minute lesson we must have either a normally loaded syllabus or the content must be interesting to students to at least medium (average) degree. Syllabus loadedness has bigger influence here, as shown in Table 1. Minimum lesson length is 35 minutes and maximum lesson length is 55 minutes.
Figure 7 shows the changing of lesson length in Chemistry in correlation with syllabus loadedness and content boredness. We can see that if the content is very interesting the syllabus can be overloaded and we will nevertheless get a 45-minute long lesson. And vice versa, if the content is very boring we need a less loaded syllabus to get a 45-minute lesson. Both independent variables (syllabus loadedness and content boredness) have approximately the same influence on lesson length. Minimum lesson length is 35 minutes and maximum lesson length is 55 minutes.
Figure 8 shows the changing of lesson length in Chemistry in correlation with content boredness and grade. It is seen from the diagram that students with lover grades wish to have longer lessons. However, if we wish to have a 45-minute lesson also with better students, the content of the lesson must be interesting.
4.1. Descriptive Statistics
Students want the longest lessons in Chemistry, which is probably because the syllabus is not overloaded, the teacher is likable and the students have a high average grade. Students want the shortest lessons in Geography, which probably results from the overloaded syllabus, low average grade, and content and teacher boredness. It is interesting that lesson length was not increased even with relatively high teacher likableness (the second most likable).
4.2. Linear Regression Coefficients
Linear regression analysis has shown that, in some subjects, certain factors have much higher influence than others. The biggest difference is, for example, in Chemistry where the difference between content boredness and teacher likableness is 29x.
4.3. Slovene Language
Here, the biggest difference is between content boredness and teacher likableness where content boredness is more important. This can be most easily explained by the fact that even if the syllabus is much loaded, the student can still learn the content provided that it is interesting. If it is boring, however, he/she will probably not have interest for learning although there might not be much content to learn.
In Math, the biggest difference is between content boredness and teacher (the biggest difference is, in fact, between content boredness and fear of teacher but fear of teacher is such an unimportant factor that it could be included in our analysis) where content boredness is more important. This is probably because Math is a science where the teacher does not have such a big influence on lesson boredness—it all depends on what he/she is supposed to teach.
In Geography, the result it similar as in Math with the only exception that here we have teacher likableness instead of teacher boredness. That likableness is less important than boredness can be explained by the fact that, students show some interest in learning only those things that they find interesting while the rest they find unimportant.
In Chemistry, the biggest difference is again between content boredness and teacher likableness. This can be explained also by the fact that in Chemistry, students have laboratory classes which, besides being practical, make Chemistry interesting. For this reason boredness (in fact, interestingness) becomes more important because like likableness it also does not have a low regression coefficient.
4.7. Correlation Coefficients of Variables
It is interesting that, in all subjects, content boredness significantly correlates with lesson length while fear of teacher has significant influence only in history.
4.7.1. Slovene Language
In Slovene language, lesson length is influenced by all factors except by fear of teacher and syllabus loadedness. The fact that syllabus loadedness does not have a significant influence on lesson length can most probably be explained by the ability of the teacher to divide the syllabus according to his/her wishes and change the order of lesson units. In this way, students do not find the syllabus too or not enough loaded.
In Math, the same factors have influence as in Slovene language, only that in math, syllabus loadedness also has some influence. In math, as different from Slovene language, the content must be taught in an orderly manner because the new content is strongly connected with the previous one.
4.7.3. English Language
In English language it is interesting that only content boredness has significant influence on lesson length. This is probably because students are aware of the importance of this world language and also meet the language in very dynamic and interesting environments (internet chat rooms, TV, etc.). So, they find the traditional way of presenting content boring while other factors are less important and do not have influence.
In History, all factors except syllabus have influence on lesson length. Students probably find the syllabus unimportant since they are aware that, in History, syllabus is more or less unchangeable. Since they find the content mostly interesting they want to influence the lesson length through other factors, they want entertaining classes, interesting teacher, good grades, and so forth.
All factors except fear of teacher and teacher likableness have influence on Geography. This can be probably explained by the fact that students want to achieve good grades and at the same time they want to have lessons more entertaining. Besides, they probably feel that lessons can be more entertaining if the syllabus is adjusted and is not overloaded.
In Chemistry, all factors except fear of teacher have influence on lesson length. Here, it is very interesting that grade negatively correlates with lesson length. This means that better students want shorter lessons. This can be most easily explained by the fact that better students understand the content (subject matter) more quickly while weaker students need more time and instruction. This also explains the wish for an entertaining and likable teacher, since better students probably want more entertaining lessons while weaker students, besides this, prefer a teacher who would provide encouragement and support.
Results vary according to subjects. In some subjects, it is possible to exceed the set lesson length (45 minutes), namely, in Math, English, Geography, and Chemistry. In one case we could see that by changing factors we cannot achieve the set lesson length. In diagrams, the desired lesson length is presented in correlation with two factors which are most influential.
In “Math” diagram we can see how syllabus loadedness and teacher likableness influence lesson length. Syllabus has a positive influence on students. The less content there is in the syllabus the more interest will students be in attending classes. It is similar with teacher likableness. The more likable he/she is the more time students will want to spend in class.
In Math, content requires a lot of abstract thinking. The bigger the content (syllabus) the more difficult it is for the student to follow the instruction. If the student is unable to progress according to the syllabus, he/she will soon lag behind and be subject to time and mental pressure. The student will not feel good in this subject and will not progress.
The teacher explains the content. How effective his/her explanation will be for a particular student much depends on the student’s involvement. Math is a subject in which good explanation is very important. If the student finds the teacher likable he/she will invest more effort to understand the content that is being explained. For this reason the teacher should be willing to help and stimulate the student.
The student will feel better during a math class if the syllabus is shorter and the teacher is likable.
4.8.2. English Language
In “English” diagram, lesson length is presented in correlation with content boredness and teacher likableness. Teacher likableness has a positive influence on lesson length. Lesson boredness has a negative influence on lesson length.
A boring lesson in English has much influence on lesson length. As the analysis showed, by changing only this factor we cannot obtain a 45-minute lesson. It is important for students that English lessons are fun (entertaining).
Teacher likableness does not influence lesson length as much as content boredness does. However, it is only by changing this factor that we can reach or exceed a 45-minute lesson in this subject.
Thus, it is important for students that the content is entertaining. In order to motivate the students we should make English language teaching more varied.
The students will spend most time in an English class if the teacher is more likable and the content is less boring.
The “Geography” diagram has two independent variables: “syllabus” which has a positive influence on lesson length and “content boredness” which has a negative influence on lesson length.
The students connect lesson boredness and syllabus loadedness with the length of a geography lesson. The student will want to spend most time in class if the content is less boring and the syllabus less loaded.
In Geography, it is important for students to be able to follow the instruction and learn interesting facts.
If the syllabus is too loaded the student will be dissatisfied because it will be more difficult for him/her to follow the instruction. By making lessons more varied, however, it is possible even in this case to get lesson length of 45 minutes.
The best result can be achieved when the content is the least boring and the syllabus the least loaded.
In the “History” diagram, lesson length is given in correlation with teacher boredness and teacher likableness. Students’ answers suggest that maximum expected lesson length does not even reach 45 minutes. Students are aware (more than with any other subject) that history is already written and cannot be changed. It is important for the students that the teacher provides pleasant atmosphere during the lesson. The teacher must not be boring and he/she must try to make the lesson interesting.
In history, it is important that the student becomes attracted by the topic which can be achieved by using the appropriate approach.
In this way we can achieve and optimum lesson length when the teacher is most likable and interesting.
In Chemistry, syllabus and content boredness are independent variables while lesson length is a dependant variable.
Students can better follow the instruction if the syllabus is not too loaded. Students think that the atmosphere in a chemistry lesson depends, above all, on content boredness which means that it is the teacher’s main task in Chemistry that the content is presented in an interesting way.
In secondary schools, Chemistry lessons include laboratory work. A subject which includes laboratory work is more interesting which might have influence on students and could explain the relatively high maximum lesson time and relatively low oscillation .
In our research we investigated students’ feelings and well-being during the lesson. We were dealing with a problem of how to adjust teaching in the secondary school and make the students feel good as much as possible and thus better follow the instruction. A hypothesis was set that, by measuring the desired lesson length and factors which influence lesson length, we can measure and influence student satisfaction. Based on this hypothesis we investigated the factors which have influence on lesson length in a particular subject.
It was found that the same factors are in different relationships towards the desired lesson time in different subjects. In some subjects, lesson time is related with almost all factors and in English only with one.
Our research was successful. It has shown that by simple identification of the desired length of instruction (lesson length) and factors which influence this length we can learn a lot about the quality of teaching and show, by setting simple simulation models, how it could be improved. In our research, however, some more questions were raised. (i)What would be the results in other schools, such as vocational or elementary schools?(ii)How to investigate and show the influence of more factors simultaneously? (iii) How are these problems seen by teachers and school administration? (iv) How would the models look like if both students’ and teachers’ opinions are taken in consideration.
- S. Grek, M. Lawn, B. Lingard, and J. Varjo, “North by northwest: quality assurance and evaluation processes in European education,” Journal of Education Policy, vol. 24, no. 2, pp. 121–133, 2009.
- J. Cohen, E. M. Mccabe, N. M. Michelli, and T. Pickeral, “School climate: research, policy, practice, and teacher education,” Teachers College Record, vol. 111, no. 1, pp. 180–213, 2009.
- J. Courtney, “Do monitoring and evaluation tools, designed to measure the improvement in the quality of primary education, constrain or enhance educational development?” International Journal of Educational Development, vol. 28, no. 5, pp. 546–559, 2008.
- L. Kyriakides and B. P. M. Creemers, “Using a multidimensional approach to measure the impact of classroom-level factors upon student achievement: a study testing the validity of the dynamic model,” School Effectiveness and School Improvement, vol. 19, no. 2, pp. 183–205, 2008.
- J. Johnes, “Data envelopment analysis and its application to the measurement of efficiency in higher education,” Economics of Education Review, vol. 25, no. 3, pp. 273–288, 2006.
- O. W. DeShields, A. Kara, and E. Kaynak, “Determinants of business student satisfaction and retention in higher education: applying Herzberg's two-factor theory,” International Journal of Educational Management, vol. 19, no. 2, pp. 128–139, 2005.
- K. M. Elliott and D. Shin, “Student Satisfaction: an alternative approach to assessing this important concept,” Journal of Higher Education Policy and Management, vol. 24, no. 2, pp. 197–209, 2002.
- L. Zhai, “Validation of an instrument to measure community college student satisfaction,” Community College Journal of Research and Practice, vol. 36, no. 1, pp. 47–58, 2012.
- S. L. Appleton-Knapp and K. A. Krentler, “Measuring student expectations and their effects on satisfaction: the importance of managing student expectations,” Journal of Marketing Education, vol. 28, no. 3, pp. 254–264, 2006.
- T. Belton and E. Priyadharshini, “Boredom and schooling: a cross-disciplinary exploration,” Cambridge Journal of Education, vol. 37, no. 4, pp. 579–595, 2007.
- S. Mann and A. Robinson, “Boredom in the lecture theatre: an investigation into the contributors, moderators and outcomes of boredom amongst university students,” British Educational Research Journal, vol. 35, no. 2, pp. 243–258, 2009.
- P. Goldschmidt and G. Phelps, “Does teacher professional development affect content and pedagogical knowledge: how much and for how long?” Economics of Education Review, vol. 29, no. 3, pp. 432–439, 2010.
- S. Kukla-Acevedo, “Do teacher characteristics matter? New results on the effects of teacher preparation on student achievement,” Economics of Education Review, vol. 28, no. 1, pp. 49–57, 2009.