Abstract

The aim of the intervention based on the self-regulation theory by Zimmerman (2000) was to promote a powerful learning environment for supporting self-regulated learning by using learning materials. In the study, primary school teachers were asked to implement specific learning materials into their regular mathematics lessons in grade four. These learning materials focused on particular (meta)cognitive and motivational components of self-regulated learning and were subdivided into six units, with which the students of the experimental group were asked to deal with on a weekly basis. The evaluation was based on a quasiexperimental pre-/postcontrol-group design combined with a time series design. Altogether, 135 fourth graders participated in the study. The intervention was evaluated by a self-regulated learning questionnaire, mathematics test, and process data gathered through structured learning diaries for a period of six weeks. The results revealed that students with the self-regulated learning training maintained their level of self-reported self-regulated learning activities from pre- to posttest, whereas a significant decline was observed for the control students. Regarding students’ mathematical achievement, a slightly greater improvement was found for the students with self-regulated learning training.

1. Introduction

According to Boekaerts et al. [1], the concept of self-regulation is used in a variety of psychological fields (see also [2]). In research on educational settings, self-regulated learning [3] is classified as an important factor for effective (school-based) learning and academic achievement (e.g., [46]).

Regarding theories and models of self-regulation, there are different approaches to describe the construct. Some models regard self-regulation as consisting of different layers (e.g., [7]), while other models emphasize the procedural character of self-regulation and describe different phases (e.g., [810]). In our study, we refer to the self-regulation model developed by Zimmerman [8], who defines self-regulation as a cyclical process that “refers to self-generated thoughts, feelings, and actions that are planned and cyclically adapted to the attainment of personal goals” (page 15). The model distinguishes between three learning phases: the forethought or planning phase, the performance or volitional control phase, and the self-reflection phase. For each of these phases, two components are uniquely characterized which are again represented by specific processes.

As components of the forethought phase, both the analysis of the given task (task analysis) and self-motivation beliefs are relevant variables in the beginning of the learning process. Task analysis includes processes of goal setting and strategic planning. According to Locke and Latham [11], goal setting has been defined as a decision upon specific outcomes of learning or performance. Highly self-regulated students organize their goal systems hierarchically and tend to set process goals in order to achieve more distal outcome goals [8]. Furthermore, strategic planning is a process relevant to the forethought phase—and closely related to goal setting—because after selecting a specific goal, students engage in planning how to reach it [9, 12]. Indeed, these processes are quite useless if students are not motivated or cannot motivate themselves to use corresponding strategies. Therefore, self-motivation beliefs, such as self-efficacy, outcome expectations, intrinsic value, and goal orientation, are relevant motivational variables of the forethought phase and they affect direction, intensity, and persistence of students’ learning behavior [13, 14]. Self-efficacy refers to “personal beliefs about having the means to learn or perform effectively” [15, page 17], whereas outcome expectations refer to the judgments of the consequences that behavior will produce [16]. In line with Deci and Ryan [17], intrinsic value is defined “as the doing of an activity for its inherent satisfaction rather than for some separate consequences” (page 56). Regarding goal orientation, there is a first distinction between a mastery goal construct and performance goal construct (e.g., [18]): whereas mastery goals (also called mastery orientation) are focused on learning and self-improvement, performance goals (also called performance orientation) represent a more general concern with demonstrating ability and trying to do better than (or to not appear worse than) others [19, 20]. There is a distinction between two different types of performance goals: performance-approach goals and performance-avoidance goals [18]. Students can be motivated to try to outperform others in order to demonstrate their competence (performance-approach) or to avoid failure in order to avoid looking incompetent (performance-avoidance). With respect to self-regulated learning theory, a positive influence of mastery goals on the different components of self-regulated learning was found [10]. In addition, these motivational variables are important components of self-regulated learning as they initiate the learning process and affect students’ performance [14].

In the next phase—the performance or volitional control phase—self-regulated learning is determined by processes of self-control and self-observation. In this regard, self-control strategies—or volitional strategies—are necessary when disturbances occur while performing a task [21, 22]. In his model, Zimmerman [8] differentiated between self-instruction, task strategies, imagery, and attention focusing as important strategies of self-control. Corno [23] emphasized that a flexible use of volitional strategies assists self-regulated learning because it enables students to shield their goal-related behavior from distractions. In the framework of our study, we concentrated on attention focusing as an effective self-control strategy in avoiding distractions and speculations of irrelevant matters [24].

Another important component of the performance phase concerns the ability of self-observation, which is described as the systematic observation and documentation of thoughts, feelings, and actions regarding goal attainment [25]. Regarding self-regulated learning, students cannot adequately engage in self-regulatory behavior without self-observation because they are only able to modify their behavior if they are attentive to relevant aspects of it [26]. As for the processes of self-observation, Zimmerman [8] adduced the processes of self-recording and self-experimentation. Self-recording has the advantage of retaining personal information at the point when it occurs and includes the possibility of altering or modifying the behavior. Self-experimentation offers the possibility of systematically varying different aspects of behavior. As a common self-recording technique, Zimmerman [8] argued for diaries to support self-observation processes because of the reactivity effect [27].

Subsequent to the performance phase, the completion of a task is the initial point of the self-reflection phase. This phase is characterized by the components of self-judgment and self-reaction. Zimmerman [8] describes self-judgment as consisting of two processes: self-evaluation and causal attributions, which includes the comparison of one’s behavior with one’s goals [28]. Students evaluate their learning results and draw conclusions concerning further learning behavior. In this context, there are different types of criteria to evaluate one’s performance. In line with Zimmerman [8], we distinguished between normative criteria and self-criteria. In this context, self-criteria are regarded as being more effective for self-regulated learning [29] because they involve the comparison of current performance with earlier levels of performance and allow judgments about the learning progress. Self-evaluative judgments are related to causal attributions. Students attribute their behavior by considering the results. There is evidence that in cases of poor performance, attributions to insufficient effort or a poor task strategy can be beneficial to motivational aspects; in cases of successful performance, attributions to one’s ability are beneficial to motivation [30, 31]. The comparisons of results to goals, as well as causal attributions, are linked to the students’ affect or self-reactions. In this context, Zimmerman [8] described perceptions of satisfaction or dissatisfaction (called self-satisfaction) and distinguished between adaptive or defensive interferences that modify a person’s self-regulatory approach during subsequent efforts to learn or perform. Thereby, the feedback resulting from current performance influences prospective performance. Zimmerman [8] designated this procedural nature of self-regulation as a feedback loop. The theoretical model is depicted in Figure 1.

As self-regulated learning has become a key construct in education in recent years because of its importance in influencing learning and achievement in school and beyond [33], there are many studies on enhancing students’ self-regulatory abilities by training them either during or after their regular classes (e.g., [3436]). Leopold et al. [37] fostered text understanding by the intervention of text highlighting and self-regulation strategies. Souvignier and Mokhlesgerami [38] focused on the enhancement of cognitive, motivational, and metacognitive aspects of self-regulated learning with respect to reading comprehension. Regarding science lessons, Labuhn et al. [39] trained seventh graders in cooperation with teachers. The target groups of these studies were students at the secondary school level (ranging from fifth to eleventh grade). As the development of self-regulation begins in early childhood [40, 41], and in line with the results of a meta-analysis by Dignath and Büttner [42], interventions have been developed to foster self-regulated learning of students in primary school [43, 44] or even kindergarten [45]. Dignath et al. [46] pointed out that improving the self-regulated learning of primary school students has positive effects on learning outcomes, strategy use, and motivation (see also [47]). Otto [43] trained primary school students, as well as their teachers and parents, and was able to compare direct and indirect effects of self-regulation training. Rozendaal et al. [48] followed a similar approach. In the framework of their study, they trained significant reference persons (teachers) on how to improve students’ self-regulated learning abilities [49].

The abovementioned studies represent different approaches to enhance self-regulated learning by training either students themselves or other relevant persons, such as teachers or parents. Thereby, self-regulated learning was combined with different academic subjects such as reading comprehension, text understanding or mathematical modelling, and problem-solving. This approach is in line with the results of a meta-analysis conducted by Hattie et al. [50], which pointed out that the direct and isolated instruction of self-regulated learning strategies had turned out to be less effective regarding its transferability on students’ learning behavior. Instead, the authors argued that direct instruction of strategies ought to be linked to factual content in order to apply these strategies in a natural setting. With regard to mathematical learning, De Corte et al. [51] argued that “self-regulation constitutes a major characteristic of productive mathematics learning” because the main goal of learning and teaching mathematics concerns “the ability to apply meaningfully learned knowledge and skills flexibly and creatively in a variety of contexts and situations” (page 155). There are a few studies (e.g., [47, 49]) that combine the instruction of mathematical problem-solving strategies with multidisciplinary self-regulated learning strategies. The presented study was designed with regard to the approach of De Corte et al. [52], who promoted the conception of the powerful learning environment, which fosters the application of self-regulatory learning strategies. Therefore, the teachers received teaching materials that included instructions to train their students in their natural learning environment at school. Following the processual character of Zimmerman’s model [8], these materials focused on particular strategies of each of the three phases. In detail, the forethought phase was represented by strategies of goal setting, strategic planning, and intrinsic value. With respect to the following phases, the learning materials focused on attention focusing as a strategy of the performance or volitional control phase and on causal attribution as a strategy of the self-reflection phase. In order to enhance their transferability, the learning materials were related to the current mathematics curriculum. As self-regulated learning strategies are transferable to different situations and areas [53], students should be thus enabled to use these strategies in different contexts.

2. Hypotheses

As the intervention was designed in order to improve self-regulated learning strategies of fourth grade students, the purpose of the study dealt with the influence of self-regulated learning interventions on students’ self-regulated learning. In addition, an effect was expected on students’ mathematics achievement because the intervention was conducted with respect to mathematical contents and conducted during regular mathematics lessons. In the framework of the study, a training to improve self-regulated learning was developed and implemented into regular mathematics lessons for a period of six weeks. In this process, the teachers received learning materials and instructions on how to train their students. It was expected that training particular self-regulatory processes could have an effect on students’ self-regulated learning. Longitudinally, there should be an increase in self-regulated learning strategies in the trained group compared to the control group. In detail, the variables goal setting, strategic planning, intrinsic value, attention focusing, and causal attribution, as well as self-regulated learning, should be enhanced in the experimental group. As the training was linked to the contents of the mathematics curriculum, an effect of the intervention on the mathematical achievement of the trained students was expected, too. There should be found a stronger increase in mathematics achievement in the trained group compared to the control group. As the training effects were expected to be stable, there should be no significant changes of variables between posttest and follow-up measurement in the experimental group.

Beyond the pre/posttests, the students of the experimental group were also asked to complete a structured diary task addressing their self-regulated learning. Therefore, process data could be analyzed by means of interrupted time series analyses. With regard to the trained variables goal setting, strategic planning, intrinsic value, attention focusing, and causal attribution, intervention effects were assumed. In addition, it was expected that variables, which were not part of the training but dealt with within the diary, improved over the intervention period. This should be the case for the variables self-efficacy, self-recording, and self-evaluation as well as for self-regulated learning in general.

3. Method

3.1. Participants

The study was conducted in seven German primary schools with altogether 135 fourth graders. The participation was voluntary and the students’ legal guardians were asked for their consent. In the experimental group (EG), 63 students took part, whereas 72 students were assigned to the control group. The mean age of the participants was 9.26 ( ), and 50.40% were female. There were no significant differences between the experimental and control group concerning students’ mathematics marks ( , ), and the mathematics marks on their report card ( , ). The students of the experimental group were involved in training carried out by their teachers. The control group did not receive any training.

3.2. Design

The study was evaluated by a time series design combined with a longitudinal design, including pretesting and posttesting of an experimental group (EG) and a control group (CG). The experimental group was trained in self-regulated learning and each student was asked to fill out a learning diary for the duration of the training. The control group was a group receiving neither training nor diaries.

3.3. Intervention

Based on the study of Perels et al. [49], learning materials to foster self-regulated learning strategies were developed with respect to fourth grade students’ learning abilities. The learning materials were addressed to (meta)cognitive strategies, such as goal setting, and strategic planning, as well as to volitional/motivational strategies, such as intrinsic value, attention focusing, and causal attribution. On the one hand, these strategies were selected with respect to the (meta)cognitive abilities of primary school students because it had to be taken into account that students of this age have a growing (metacognitive) awareness of their own thinking processes and have the opportunity to control them [40]. As Bronson pointed out, primary school students “can learn to consciously set goals, select appropriate strategies to reach the goals, monitor progress and revise their strategies when necessary, and control attention and motivation until a goal is reached” [40, page 213]. On the other hand, the learning materials focused on the abovementioned strategies in order to represent the different phases of Zimmerman’s self-regulation model [8]. Therefore, goal setting, strategic planning, and intrinsic value were selected according to the forethought phase, while the strategy of attention focusing represented the performance and volitional control phase. As a strategy belonging to the self-reflection phase, causal attribution was selected.

The learning materials focused on the abovementioned strategies and were differentiated between six units. Each of these units—excluding the first—referred to one particular self-regulated learning strategy. In order to impart these self-regulatory contents to the students in a playful and child-oriented manner, a fictitious character named Kalli Klug was developed with which the students could identify themselves, and which guided them through the different units. The first unit aimed to introduce the fictitious character to the students; therefore, a one-page profile of Kalli Klug was handed out to the students. The students learned that the character was an endearing bear of the age of nine, which had learned several strategies that helped him to improve his learning behavior and who wanted to relay this information to the students. In this context, a learning diary was introduced as one method to optimize learning behavior. The contents of units 2 and 3 were related to cognitive and metacognitive strategies. In detail, the third unit of the learning materials includes cognitive and metacognitive strategies because the students were asked to apply particular cognitive learning strategies such as organizing as well as metacognitive strategies like comprehension monitoring. The units 4 and 6 dealt with motivational strategies, such as self-motivation and favorable attributional styles. The fifth unit focused on volitional strategies, such as attention focusing. Table 1 gives an overview of the contents of the units.

Every unit was designed for the duration of one lesson (45 minutes). The teachers received the learning materials in the form of units according to the number of students in the classroom and the instruction plans on how to impart the contents. Additionally, they received supporting documents which explained the theoretical background of the units. Every unit followed the same procedure: each began with a short repetition of the preceding unit. Then, the teachers demonstrated a new problem with which the character had been confronted (e.g., how to deal with distractions that restrict one from learning). Following this, the students had to think about this problem and find strategies to solve the problem. Alternatively, they learned the strategies which the character used in order to solve the problem by itself. In addition, the students had to transfer these strategies to their own learning behavior. The units finished with a task that had to be done for homework.

The teachers were asked to work on these learning materials together with their students during their regular mathematics lessons. In order to support the implementation of the contents, the teachers received instructions with recommendations for proceeding. It was the teachers’ task to transfer these interdisciplinary strategies to the mathematical contents of their lessons. For example, the second unit focused on goal setting. The students learned how to set goals and were prompted to set their personal goals for their mathematics learning for the following week. Therefore, it can be said that the teachers were actively and personally involved in the implementation of the training.

The learning materials were made available to the teachers a week before the official start of the training. As the students had to work on one unit per week, there was enough time for the teachers to familiarize themselves with the learning materials. Further support was available in the form of a mentor, available at a teacher’s discretion [58].

3.4. Instruments
3.4.1. Self-Regulated Learning Questionnaire

Within the framework of the study, a questionnaire was used to measure fourth grade students’ self-regulated learning. A first version of this questionnaire was tested and revised in a pilot survey with a parallel student target group ( ). The students filled out the questionnaire a week before and after the intervention, as well as after a period of twelve months (follow-up measurement). The responses were coded on a scale with scores ranging from 1 to 4 (1: I disagree, 2: I somewhat disagree, 3: I somewhat agree, and 4: I agree). Some of the items have been taken from established instruments [43, 5961], and, if necessary, selected scales were newly developed (for details, see Table 2). Reliabilities (Cronbach’s alpha) were assessed for all scales (Table 3).

The questionnaire was applied during regular classes and instructed by qualified experimenters in a standardized way. On the one hand, the questionnaire was designed to represent the several contents of the units; on the other, the instrument was developed with respect to the phases and processes of Zimmerman’s self-regulation model [8], such as goal setting, strategic planning, intrinsic value, attention focusing, self-recording, self-evaluation, and causal attribution. These processes were chosen to represent the scales of the overall scale self-regulated learning. Following the model, the forethought phase was composed of the scales goal setting, strategic planning, and intrinsic value, with 13 items altogether. Regarding the performance or volitional control phase, two scales with nine items in total were composed which covered themes of attention focusing and self-recording. The self-reflection phase referred to the scales self-evaluation and causal attribution, which were measured by nine items. Altogether, the questionnaire consisted of 31 items. In Table 3, the reliabilities of the questionnaire are depicted for the measurements (pretest/posttest/follow-up measurement). The reliabilities of the posttest were regarded as criterion. Since Cronbach’s alpha ranged between 0.61 and 0.85, the reliability of the instrument can be rated as satisfactory ( ). As the study was designed for regular mathematics lessons, the scales were related to mathematics; for example, “Before I start with a mathematics task, I plan how to begin.”

3.4.2. Learning Diary

In order to measure self-regulated learning on the state level, the students of the experimental group were also asked to fill out paper-and-pencil diaries for a period of six weeks. The items of the diary had to be filled out before and after performing homework tasks and were related to items of other instruments, which were already developed in this context (see [43, 54]). As with the questionnaire, they corresponded to the phases of self-regulated learning and were presented in a closed format, coded on a four-point Likert-type scale, with scores ranging from 1 to 4 (1: I disagree, 2: I somewhat disagree, 3: I somewhat agree, and 4: I agree). Altogether, the students had to estimate 19 items which asked for their daily learning behavior at home. Therefore, the items were worded concerning the current learning behavior for that day. Before doing their homework, the students had to answer eight items with regard to the processes of the forethought phase (e.g., goal setting: “I know exactly what I want to learn today” or intrinsic value: “Today, I have a mind to learn”). After having finished their homework, they were asked to answer eleven items related to processes of the volitional control phase and the self-reflection phase (e.g., attention focusing: “Today I’ve learned very concentratedly” or self-recording: “Today while learning, I thought about my learning process”).

A split-half reliability was calculated (odd-even coefficient) by dividing the days for each person into two groups, one with even numbers and one with odd numbers. The mean values of each person were correlated for the variables. Table 4 shows the detailed results for each self-regulatory variable, which was measured by the diary. All variables correlated highly significantly ( ).

3.4.3. Mathematics Test

Additionally, the students had to work on a standardized mathematics test [62] consisting of eight tasks altogether, which dealt with arithmetic, calculations concerning practical problems, and geometry. As the students were asked to work on it before and after the intervention, two versions were administered which were similar regarding item difficulty (approximately ) and item-scale correlation (approximately ). The students were able to reach a maximum number of ten points.

3.4.4. Teacher’s Register

As the training was carried out by teachers, it was interesting to measure teachers’ evaluation of the learning materials including the instructions. The teachers’ assessments of the learning materials were used as an indicator for the implementation of the materials. Therefore, a kind of teacher’s register was handed out to teachers in order to evaluate each unit regarding design, applicability, and comprehensibility. With respect to a teacher’s daily work routine, the evaluation system followed the German system of notation (1: very good, 2: good, 3: satisfactory, 4: adequate, 5: poor, and 6: insufficient). Additionally, the teachers were asked to estimate the motivation of their students while working on the learning materials (1: not motivated, 2: less motivated, 3: motivated, and 4: very motivated). A further function of this register was to give teachers an opportunity for feedback and suggestions for useful variations of the learning materials.

4. Results

Following the succession of the hypotheses, the results of the longitudinal data are reported firstly followed by the tests of time series hypotheses.

4.1. Results of the Longitudinal Analyses
4.1.1. Pre/Postanalysis of the Self-Regulation Questionnaire

The research questions postulated that training on self-regulated learning leads to an improvement of self-regulated learning variables. We expected no changes for the untrained group (control group). The differences between the experimental group and control group were calculated by means of analyses of variance, with time as a repeated measurement factor. As it was not possible to randomly assign the students to the conditions, the pretest differences were controlled first. Regarding self-regulated learning variables, significant pretest differences between the groups were found for the scales strategic planning, , , , and self-recording, , , . As can be seen, the students of the experimental group reported higher pretest values than the students of the control group did (see Table 5). Because of these pretest differences, analyses of covariance with the pretest value as covariate were conducted to control these differences. Table 5 gives an overview of the results of interaction time × training, as well as means and standard deviations for the overall scale and the scales. The results indicate a significant interaction effect for the overall scale self-regulated learning, , , , as well as for the scales goal setting, , , , and intrinsic value, , , . There were no significant interaction effects for the scales attention focusing, self-evaluation, and causal attribution. Regarding strategic planning and self-recording, the results of the analysis of covariance showed significant effects for both scales (strategic planning: , , ; self-recording: , , ).

Regarding the overall scale self-regulated learning, there was a small nonsignificant increase among the students of the experimental group, whereas a significant decline was found for the students of the control group, , , . With respect to the self-regulated learning variables, this significant decline for the students of the control group was also detected for the scales strategic planning, , , , intrinsic value, , , , and self-recording, , , . For the students of the experimental group, there was a significant increase concerning the scale goal setting, , , . Figure 2 presents the results for the students’ self-regulated learning and mathematical achievement separately for experimental and control group.

4.1.2. Pre/Postanalysis of the Mathematics Test

Regarding the mathematical competencies of the students, the experimental group as well as the control group should improve their mathematics achievement because both groups were continuously taught in mathematics. However, the experimental group should benefit from training on self-regulated learning strategies in terms of a greater increase in their mathematics achievement. The results of the -test showed that the mathematical competencies of both groups were improved after the training period (see Figure 2). Regarding the effect size, the experimental group showed a stronger increase, , , , than the control group, , , .

In addition, it was examined if a training effect could be found. As there were significant pretest differences between the groups of the overall measure (sum over all tasks of the test), an analysis of variance was conducted with pretest values as covariate. The results showed no significant training effect.

4.1.3. Follow-Up Measurement

The students of the experimental group received the same questionnaire again in order to measure the stability of the training’s effect after a period of twelve months. The data of the variables should be stable, which means that no significant additional effects were expected and that the values should not decrease significantly. Therefore, the assumption that there were no changes regarding goal setting, strategic planning, intrinsic value, self-recording, self-evaluation, attention focusing, causal attribution, and the overall scale self-regulated learning was tested and the alpha-level was increased to 20% [63]. In general, results show that the variables did not change significantly between the posttest and the follow-up measurement. Table 6 shows the detailed results for the scales as well as for the overall scale self-regulated learning.

4.2. Results of the Training Evaluation Based on Process Data

In order to describe the training evaluation based on process data of the experimental group, interrupted time series were conducted for the trained self-regulated learning variables related to the units of the learning materials and trend analyses were conducted for the untrained variables self-efficacy, self-recording, and self-evaluation. As 70% of the diaries were filled out with more than 22 data points (>73%), data for the variables of the learning diary were aggregated from 44 students and included into analyses. Therefore, the mean of the variable computed across all participants could be generated for each day. In order to examine the training effects for the components related to the units based on the learning diary data, a multiple baseline design was used and interrupted time series analyses were conducted. Step functions were expected to show an immediate impact and to continue over the long term. In order to analyze ARMA processes, the residuals were used [64]. With the residual data, autocorrelations and partial autocorrelations were conducted to identify ARMA processes.

In Table 7, the results for the trained variables of each unit are depicted. The first column represents the subscales of the diary. The score shows the intercepts for the variable as an indicator for the basic level, whereas is the indicator for the change level. Using the -score, the means before (baseline) and after the training can be analyzed to expose changes. The ARMA model describes how the level of the variable, measured at a previous point in time, influences the same variable at a following point in time. The number of terms in autoregressive (AR) terms of the model reports the dependency among successive observations. Thereby, each term has an associated correlation coefficient that describes the magnitude of this dependency. With regard to the moving average (MA) terms, the model represents the persistence of a random shock from one observation to the next. After the model estimation, (partial) autocorrelations were computed in order to test white noise residuals (with Ljung-Box- test).

The results showed that after the first training unit, students reported having been able to improve their goal setting strategies ( , ). The second unit caused no enhancement with respect to the variable strategic planning. After the third unit, the variable intrinsic value improved significantly ( , ). In contrast, with respect to the variables attention focusing and causal attribution, there were no effects of the fourth and fifth units. However, the variable causal attribution showed AR (1) process. For the other variables, there were no dependencies among successive observations (white noise).

Additionally, trend analyses were conducted for the variables that were not explicitly trained but should have been influenced by the intervention. Because of the reactivity effect (see [6567]), positive linear trends were expected for the nontrained variables self-efficacy, self-recording, and self-evaluation, as well as for the overall scale self-regulated learning. Regarding the variables self-efficacy and self-evaluation, there were no significant changes, whereas significant linear trends were found with respect to self-recording ( ; ; ; ) and self-regulated learning ( ; = 3.31; ; ). Thereby, the time trend over a period of 30 days could explain 14% of the variance of self-recording and 16% of the variance of self-regulated learning. Figure 3 shows the results for the linear trend of the overall scale self-regulated learning.

4.3. Teachers’ Evaluation of the Learning Materials

The teachers’ assessment of the learning materials regarding their design, application, and comprehensibility ranged between 1.60 and 1.67 (design: , ; applicability: , ; comprehensibility: , ). The students’ motivation while working on the learning materials was estimated with a mean value of 3.30 ( ). Based on these results, the implementation of the learning materials should be carried out successfully.

5. Discussion

The aim of the intervention was the enhancement of fourth grade students’ self-regulated learning by working on interdisciplinary teaching materials, which were related to particular strategies of Zimmerman’s self-regulation model [8]. By means of analyses of variance with time as repeated measurement factor, significant interaction effects were found for the overall scale self-regulated learning, as well as for the scales goal setting, intrinsic value, strategic planning, and self-recording.

Regarding the results within the groups, it could be pointed out that the overall scale self-regulated learning did not change in the expected direction. Instead of a significant increase for the experimental group, there was a significant decrease for the control group, whereas for the experimental group the overall scale remained stable. Regarding the experimental group, this result for the overall scale was supported by the results of the scales strategic planning, intrinsic value, attention focusing, self-recording, self-evaluation, and causal attribution. Except for the scale goal setting, a significant increase was found as expected. For the control group, the results of the scales strategic planning, intrinsic value, and self-recording showed a significant decline as did the overall scale self-regulated learning. Twelve months after training, the students of the experimental group filled out the same questionnaire again, in order to measure stability of intervention effects. There should be no significant change of the data according to an increase or decline. The results show that all scales were stable after a period of twelve months.

Besides the improvement in students’ self-regulated learning, we also expected an effect with respect to students’ mathematical achievement. As the learning materials were related to mathematical contents and implemented during regular mathematics lessons, we dealt with the question of whether there was a supportive effect of self-regulated learning on students’ mathematics achievement [5]. Regarding the effects between the groups, no significant interaction effect was found. The results showed an enhancement for the experimental group as well as for the control group. As both groups have been taught mathematics, this increase was not unexpected. Regarding the effects within the groups, we expected a greater increase in mathematics achievement for the experimental group than for the control group. With respect to the effect sizes, the students of the experimental group showed better improvement in their mathematics achievement than the control group did. These results were in line with Perels et al. [49]. In their study, they also found an improvement for both groups, but a greater increase for the students belonging to the experimental group.

On the level of process data, interrupted time series analyses indicated an increase in value of some of the trained variables in the expected direction after the training. In detail, this was the case for the variable goal setting after the second unit, as well as for the variable intrinsic value after the fourth unit. Regarding strategic planning, attention focusing, and causal attribution no significant changes were found. Additionally, linear trends were performed for the nontrained variables self-efficacy, self-recording, and self-evaluation, as well as for the overall scale self-regulated learning. Although these variables were not part of the training, the students had to answer items corresponding to them by filling out the diary each day. Therefore, we expected an influence in terms of the reactivity effect [27, 65]. Regarding the scale self-recording and the overall scale self-regulated learning, significant linear trends were found as expected whereas there were no trends for the variables self-efficacy and self-evaluation. The absent linear trends for these variables are in contrast to the results of other studies (see, e.g., [43, 67]). Therefore, the postulated reactivity effect [65] has to be considered critically because evidence for it was limited. In this study, the learning diary primarily seemed to serve as an evaluation instrument and not as a part of the intervention.

In summary, the results lead to the assumption that the learning materials seemed to be beneficial with regard to fourth grade students’ self-regulated learning and mathematics achievement. However, the results of the pretest and posttest measurements for self-regulated learning have to be discussed critically. Regarding the experimental group, there was only a small, nonsignificant increase found for the overall scale and the scales strategic planning, intrinsic value, attention focusing, self-recording, self-evaluation, and causal attribution. Additionally, no interaction effects were found for the variables attention focusing, self-evaluation, and causal attribution. As the variables self-recording and self-evaluation were not involved as part of the training, this result was not unexpected. Obviously, it was not possible to improve these variables by training other specific processes of self-regulated learning. With respect to the other variables, the lack of effects was not expected. It can be discussed as to whether there was enough time to practice and transfer the strategies of these units, which were very complex. The students worked on the teaching materials for the duration of one lesson per week and had to deal with one task per training session. It would probably have been useful if the students had worked on more than one task during each training session to make sure that they transferred the learned strategies to their everyday work. Furthermore, it may be possible that the imparted strategies initially interfere with already existing strategies [68]. As the study was realized at grade four, the students may already have developed their own strategies to regulate their learning behavior. Greater effects might be expected when there is a continuous and fairly long-term instruction of self-regulated learning in regular classes [69].

Moreover, there are limiting factors and unanswered questions regarding this study: for the assessment of self-regulated learning, only self-report methods (questionnaire and learning diary) were used. These self-report methods only measured students’ evaluation of their use of strategies, but not their actual use [70]. In future research, multimethod approaches should be used. In this study, the students were also videotaped during regular mathematics lessons (before and after the intervention phase). For further analysis, the observation data has to be analyzed and referred to the results of the self-report data. Consequently, it will be possible to analyze if students actually used the self-regulated learning strategies supported by the learning materials. In this context, also other on-line methods like thinking-aloud protocols might be of interest (see [71]).

Additionally, there is another question concerning the measurement of self-regulated learning. By using learning diaries, we were able to assess and analyze students’ self-regulated learning on a daily basis. Following Schmitz and Wiese [9], we used this data as process data to conduct time series analysis. This approach has to be regarded critically because learning diaries represent self-report measurements. It has to be questioned to which extent this data could be concerned as process data.

Another limitation concerns the state aspect of Zimmerman’s model [8]. He postulated that self-regulation is an adaptable and cumulative process. According to these assumptions, his self-regulation model tends to focus on state aspects of self-regulation. However, in the study we used self-report data, which rather concerns trait aspects of self-regulation. Thus, there is a discrepancy between the theoretical framework of the study and the chosen assessment methods. However, other authors, such as Schmidt [54] or Hong and O’Neil [72], regard self-regulation at both the state and trait levels. They hypothesize that academic self-regulation consists of transitory (meta)cognitive states and relatively stable (meta)cognitive traits. For example, students with high self-regulatory traits tend to use their metacognitive skills more effectively than students with low trait self-regulation [73]. Hong [74] compared state and trait self-regulation models and came to the conclusion that every self-regulation state refers to a general trait component (see also [75]). Furthermore, she reported high correlations between state and trait constructs (see also [76]). Therefore, analyzing self-regulatory traits by using questionnaire data makes assumptions about self-regulatory states, as postulated in Zimmerman’s self-regulation model [8].

Furthermore, the implementation of the developed learning materials has to be discussed because the contents of the units were imparted by the teachers themselves. From the teachers’ point of view, the learning materials and the instructions were evaluated as very good to good with respect to design, applicability, and comprehensibility. Furthermore, the teachers estimated the motivation of their students while working on the learning materials to be very positive. These estimations indicate that the developed teaching materials could be successfully implemented in the regular classroom situation. In fact, an innovation such as these learning materials can be evaluated as being successfully introduced as soon as the teachers have adopted it [77]. Adoption in this context means that the teachers are able and willing to implement an innovation into their lessons. Moreover, they have to feel confident in their ability to adapt it to the needs and abilities of their students. Following Bitan-Friedlander et al. [78], teachers’ adoption of an innovation in the educational field depends on “agreeing with the theoretical content and with the pedagogical value of the innovation” [78, page 617]. The extent to which an innovation might be adopted by a teacher can be defined in terms of the teacher’s personal concerns. In the present study, the teachers expressed being excited about the learning materials. However, there were no other clues as to what extent the teachers were involved and motivated to work with the learning materials. For further studies, this might be an interesting and helpful approach.

Another limitation refers to the question of how the students were assigned to the experimental and the control group. As the learning materials needed to be implemented by teachers into students’ regular learning environment, it was not possible to realize a randomized assignment of the students to experimental and control group. Therefore, students’ pretest values of self-regulated learning and mathematical achievement were controlled.

Finally, the significant interaction effect for the overall scale self-regulated learning and the scales goal setting, intrinsic value, strategic planning, and self-recording mainly occurred due to the significant decline of the control group. This decline was not expected and cannot be explained in the framework of this study. For further intervention research, it might be worthwhile to assess more information concerning the control group.

In this context, it also might be of interest to design an intervention which involves more or even all of the postulated strategies of Zimmerman’s self-regulation model [8]. In our study, there had to be a focus on the selected strategies for two reasons. Firstly, the (meta)cognitive abilities of the target group had to be considered (see [40]). Secondly, the duration of the intervention was determined because the learning materials were implemented into regular mathematics lessons. This implied that the more time was spent on the learning materials, the less time could be spent on the regular mathematics contents. Therefore, and for developmental psychological reasons, the intervention was reduced to six units. However, the study involved both (meta)cognitive and motivational aspects of self-regulated learning corresponding to the three learning phases of Zimmerman’s model [8]. This represents an advantage of the study in contrast to other trainings which focused either on (meta)cognitive or motivational components (for an overview, see [79]).

In summary, present findings show that it is possible to maintain a rather high level of self-regulated learning by using self-regulated learning materials which were implemented by teachers. To our opinion it is worth emphasizing that the embedding of specific self-regulated learning strategies into regular mathematics lessons was not at the cost of students’ mathematical achievement, but supported it. Thus, it might be assumed that if an improvement of students’ self-regulated learning occurs, this improvement might be related to improvements in mathematical achievement. Further studies should investigate if and under what conditions this assumption holds true. Therefore, the learning materials should be optimized and the evaluation instruments adapted to other subjects.

The present study implies practical consequences of creating powerful learning environments for supporting self-regulated learning. As the results show, it is possible to embed self-regulated learning strategies in regular lessons by using interdisciplinary learning materials. As self-regulated learning represents an important factor for academic and lifelong learning [80], teaching these strategies should be integrated into regular elementary school lessons in order to improve the development of advantageous learning behavior as early as possible.

Acknowledgment

This research was supported by grants from the DFG (German Research Foundation).