Abstract
The aim of the present study was to examine whether fostering positive activating affect during multimedia learning enhances learning outcome. University students were randomly assigned to either a multimedia learning environment designed to induce positive activating affect through the use of “warm” colours and rounded shapes () or an affectively neutral environment that used achromatic colours and sharp edges (). Participants learned about the topic of functional neuroanatomy for 20 minutes and had to answer several questions for comprehension and transfer afterwards. Affective states as well as achievement goal orientations were investigated before and after the learning phase using questionnaires. The results show that participants in the affectively positive environment were superior in comprehension as well as transfer when initial affect was strong. Preexperimental positive affect was therefore a predictor of comprehension and a moderator for transfer. Goal orientations did not influence these effects. The findings support the idea that positive affect, induced through the design of the particular multimedia learning environment, can facilitate performance if initial affective states are taken into account.
1. Introduction
For many years, research in multimedia learning concentrated on cognitive processes that are related to learning outcomes like the cognitive load theory (CLT) by Sweller et al. [1] or Sweller [2] and the cognitive theory of multimedia learning (CTML) proposed by Mayer [3, 4]. Nevertheless, the crucial influence of affect on learning is commonly accepted [5]. However, research on the educational effects of positive activating affect has found contradictory results. Whereas some findings indicate that positive activating affect can be beneficial for learning (e.g., [6]), there are also studies that did not find this relationship (e.g., [7],). Nevertheless, little is known about the causal influence of these affective states in short-time learning situations because most of present studies examine affect and learning in bigger spans of time (e.g., school years or semesters) or refer to correlational designs. Accordingly, research on the causal relation between positive activating affect that occurs directly while learning and learning outcome is still rare. Consequentially, it is necessary to carry out experimental studies in which affect is elicited directly in the learning situation.
In an initial work Um et al. [8] induced positive affect by using warm colours (defined here as bright and highly saturated colours of higher wavelengths) and round anthropomorphic figures as design elements in a multimedia learning environment. The results showed that inducing positive affective states increased learning outcome in terms of comprehension and transfer. Moreover, there was a positive relationship between inducing positive affect and reported levels of achievement motivation. Using the same learning environment, Plass et al. [9] partially replicated and extended these findings. Both studies therefore give initial evidence that positive activating affect can be induced directly via the design of the learning environment and that these affective states can foster learning outcomes. The authors refer to these findings as the so-called emotions as facilitator of learning hypothesis ([8], p. 3). Although these results are promising, subsequent research failed to coherently replicate these initial findings (e.g., [10, 11]). Accordingly, the present study further investigates whether positive affect can be induced in the learning situation throughout the design of the learning material and whether positive affect facilitates learning outcome. Moreover, the present study considers the role of achievement goal orientations in the emotional design paradigm.
2. Affect and Learning
Emotions are often defined as temporary but intense affective states that are caused by internal or external stimuli [12]. Moods are often seen as unfocused, longer-lasting, and less intense states, whereas affect is generally used as an umbrella term for all emotional experiences (e.g., [13, 14]). Other authors criticize a categorical distinction and refer to a dimensional classification of emotional experiences [15]. In their view, affective states are conceptualized by different locations in the same multidimensional space. Positive activating affect includes emotions such as enjoyment or hope, whereas positive deactivating affect refers to states of relaxation or calm. Feelings of being bored or resigned are illustrative of negative deactivating affect, while emotions such as anxiety or anger exemplify negative activating affect. Moreover, it is argued that positive activation does not necessarily imply negative deactivation to the same extent and vice versa [16, 17]. In this view, positive and negative affect are not placed on the same continuum concerning their valence, suggesting more or less separate constructs. In the present study, the term “affect” is used as an umbrella term subsuming “mood” and “emotion.” Affective states are further described by levels of activation and valence.
Pekrun and colleagues [6] consider learning-related affective states as “directly linked to academic learning, classroom instruction, and achievement” (p. 92). Pekrun (e.g., [15, 18]) further emphasizes the importance of achievement emotions in the learning process. According to Pekrun [15] (p. 317), achievement emotions are defined as discrete emotions that occur in achievement situations (“activity emotions”, e.g., pleasure during learning) or when a person is confronted with actual or anticipated achievement outcomes (“outcome emotions”). It is furthermore assumed that affective states (i.e., activity emotions) change dynamically while learning and directly impact learning-related cognitive and motivational processes such as self-regulation, creative problem-solving, the use of learning strategies, or intrinsic motivation [19–23]. In the present study, we investigate activity emotions, and therefore we will not elaborate any further about outcome emotions.
Empirical findings indicate that there is a broad variety of learning-related affective states that appear frequently and change dynamically in the learning situation [19]. There is some empirical evidence that induced affect is detrimental for learning outcome because of enhanced task-irrelevant thinking (e.g., [24]). Nevertheless, the results remain contradictory. For example, Craig et al. [25] found that the affective states that occur while learning account for 27% of the variance in learning gains. Pekrun and Stephens [18] note that both positive and negative affect occur at the same frequency while learning. According to Pekrun [15] positive affect is not always beneficial and negative affect is not always detrimental for learning outcome.
It has been found that negative deactivating affect (e.g., boredom) is correlated with decreased intrinsic motivation (e.g., [6, 26]) and negative activating affect (e.g., anger) is associated with task-irrelevant thinking [27] but may also lead to enhanced learning gains (e.g., [28, 29]) and the use of more narrow, analytical, and in-depth learning strategies [30]. Positive deactivating affect such as relaxation is associated with more superficial learning strategies [31], whereas there is evidence for an increase in learning outcome when general positive activating affect is elicited [32]. Positive activating affect such as flow or enjoyment is related to better learning outcomes, broadened attention, better memory storage, and retrieval and higher levels of task persistence (e.g., [7, 20, 30]) as well as enhanced creative problem-solving and cognitive flexibility in decision making (e.g., [33–35]).
However, these findings often refer to correlational studies in which affect and trait variables like achievement motivation are analysed. Experimental studies still represent only a small proportion of the existing literature. Moreover, multimedia learning is not specifically addressed in most of these studies although multimedia learning is crucially important in educational settings [4]. In the present study, multimedia learning includes the perception and processing of information that is presented in words as well as pictures [36]. In the CTML, Mayer [4] provides a theoretical framework that describes how verbal and visual information is processed. Although several cognitive processes are described in the CTML, other important factors are not addressed. Therefore, the cognitive affective theory of learning with media (CATLM; [37, 38]) expands the CTML by considering motivational and affective influences on the multimedia information processing as well (see also [39]). According to Pintrich and de Groot [40], these factors can impact learning outcome in terms of decreasing or increasing the learner’s cognitive engagement. The CATLM further considers characteristics of the learner like prior knowledge and metacognitive processes that have shown to influence learning significantly (e.g., [41, 42]). Nevertheless, the theory does not provide guidelines for implementing affective interventions in concrete learning materials. Plass and Kaplan’s [43] recently published integrated cognitive affective model of learning with multimedia (ICALM) addresses these issues. According to the model’s main principle, cognitive and affective processes cannot be separated from each other, that is, the cognitive processing of multimedia stimuli is accompanied by affective appraisals and vice versa. Moreover, the model proposes that the instructional design of the learning material can highly influence the affective-cognitive processing. Consequently, emotional design interventions that induce learning enhancing affective states are considered to foster the affective-cognitive processing and to enhance learning outcomes.
3. Inducing Affective States
Most of the most commonly used affect induction procedures present affective stimuli (e.g., pictures, film clips, or self-referential statements) either prior to the experimental task or before every block of trials. Both approaches appear to be suboptimal for educational research studies because of several reasons. First, affective states vary in duration and intensity. Therefore, it is difficult to ensure that preexperimental induction methods are able to induce an affect that lasts for the complete learning session. It is more likely that these affective states decrease or vanish after a short amount of time, that is, within several minutes. Learning, on the other hand, often continues for longer periods. Second, affective states are reciprocally linked and can instantly influence or elicit each other [44]. According to D’Mello and Graesser [19], different affective states occur throughout learning situations. These affective experiences therefore might interfere with the preexperimental affect induction and compromise a successful emotion induction. Third, Gross [45] argues that real emotions arise in situations that are personally relevant for the individual, indicating an internal induction of affective states. Thus, affect that is elicited via the use of film clips or pictures might instead be based on compassion or empathy with the protagonists and is therefore not fully relevant to the person. To test if affect influences the learning process and the learning outcome, self-relevant positive activating affect had to be induced for the full duration of the learning situation. Alternatively, Um and colleagues [8] used highly saturated and bright colours, such as yellow or orange, and round, anthropomorphic shapes as design elements in a multimedia learning environment and were able to induce positive affective states during learning. The use of colour and form for inducing positive activating affect is therefore further discussed.
In the ecological valence theory of human colour preferences [46], it is argued that the colour of an object reveals information about its usefulness for the person and therefore causes approach or avoidance behaviour (e.g., red strawberries are preferred against green ones because the red colour signals the ripeness of the fruit). Hence, people are attracted to objects whose colours are associated with positive outcomes or advantages. These associations also appear to be highly context-specific [47]. Red, for instance, may elicit approach behaviour in the supermarket because of signalling nutritious food. In the learning context otherwise, red is more likely associated with making mistakes or failing due to the use of red ink to mark errors [48]. This is in line with the assumption that the colours wavelengths are positively correlated with increasing arousal indicating that red elicits high levels of arousal [49, 50]. However, because of its association with making mistakes and failing in achievement situations, it is not recommended to use the colour red to induce positive affective states. Furthermore, colours do not only influence cognitive processes because of their hue but also because of their saturation and lightness [51]. Several studies by Palmer and his colleagues [46, 51] show that people generally prefer light and highly saturated over dark or nonsaturated colours. These colours have also been associated with positive affect in children [52] as well as college students [53]. Consequentially, bright and highly saturated colours of higher wavelengths such as orange or yellow should elicit positive activating affect.
Several studies also indicate that the shape of design elements may influence affective perceptions. Kim et al. [54], for example, found that the use of circled shapes in hypermedia environments predicts positive activating feelings such as strength and powerfulness. Other studies indicated that positive affect can be elicited by round and human-like shapes (e.g., [10, 55]).
4. Emotional Design in Multimedia Learning
First evidence found that participants who learned in a multimedia learning environment which was created to elicit positive activating affect showed higher levels of learning performance than participants in an affectively neutral control condition [8, 9]. In line with the CATLM [38], these results provide initial evidence that positive affect can be induced via the design of the learning environment and can facilitate the learning outcome. Um et al.’s study [8] leads to replications and extensions of the study’s results. However, these studies did not develop a coherent view on the role of positive affective states while learning. While Plass and colleagues [9] reproduced the effects of the affect induction procedure at least in one out of two experiments, effects on learning performance and achievement motivation were rather heterogeneous. Contrary to Um et al. [8], they did not find learning gains for transfer in their first experiment. The second experiment showed that warm colours had no effect on the learners’ positive affect, while face-like shapes did significantly foster positive affect. Hence, results on emotional design procedure were not completely coherent to the initial findings from Um and colleagues [8]. Contrarily, Park and colleagues [11] did not find that anthropomorphic design elements increase positive activating affect using the same materials as in Plass’s studies. In fact, Park and colleagues [11] found an increase in positive affect for the control condition that did not receive any affect induction at all. Moreover, this study found that participants performed better when positive affect before learning was high, regardless of the emotional design of the learning environment. According to the authors, these unexpected findings were obtained because of a weak affect induction intervention and restricted variance in the reported affective states. However, these findings indicate that preexperimental affective states should be at least considered as covariates.
In two experiments, Mayer and Estrella [12] tried to replicate earlier findings. Using different materials, the authors found evidence for an emotional design procedure similar to the one introduced by Um et al. [8] enhancing learning performance. Yet, there were no differences in ratings of learning enjoyment between the treatment group and a control condition. Finally, Knörzer et al. [56] found that induced negative deactivating affects like sadness increased learning outcomes in terms of retention, comprehension, and transfer while inducing positive activating affect caused learning impairments. The authors thereby elicited positive activating affect using a combination of music and remembering affectively charged life events. Results concerning the relation between emotional design interventions and achievement motivation also appear disparate. Park and colleagues [11] as well as Knörzer and colleagues [56] did not find positive effects of the treatment on the participants’ levels of achievement motivation. Plass et al. [9] could show that inducing positive affect also enhances intrinsic motivation at least in one of the two studies.
In sum, recent studies’ findings draw a rather heterogeneous picture of the effectiveness of the induction of affect during multimedia learning on the one side and the influence of positive affect on learning outcomes on the other side. As Plass et al. [9] argued, an explanation for this result might be that learning gains in the emotional design condition may occur due to greater salience of figures that are enriched with anthropomorphic elements. Accordingly, some findings show that anthropomorphic elements are strongly connected to capturing attention [57]. Consequently, learning material that contains anthropomorphic elements may simplify the acquisition of the information not only by eliciting positive affective states but also because these figures are more conspicuous to the learner. Moreover, the implementation of human-like shapes is only possible if the shaped elements do not require a specific form by themselves. Hence, anthropomorphic shapes cannot always be implemented easily within a multimedia learning environment, especially when visualizations of the learning content do not involve figural elements (e.g., the visual representation of electrical circuits) or when these visualizations do not allow changes in shape (e.g., the visualization of anatomical structures that have predetermined shapes). In the worst case, varying the shape of such visualizations might impair learning outcomes by distorting the accuracy of the content. Therefore, a study is needed in which the learning material contains no anthropomorphic design elements but positive emotions are elicited.
5. Research Questions and Hypotheses
One’s affective experiences while learning are supposed to be strongly connected to learning-relevant cognitive processes and have been investigated in numerous studies [18]. Positive activating affect has been found to enhance learning outcome in multimedia learning [8]. Accordingly, the present study aims to induce positive activating affect using an emotional design intervention and test its beneficial effects on the learning outcomes. In fact, it is assumed that light and saturated colours like yellow and orange and round shapes are sufficient to elicit positive activating affect. This procedure is further supposed to induce self-relevant affect because it does not refer to or focus on other human beings. Using the learning material for inducing affective states also meets the requirement that the affect will be elicited over the complete time of the learning task. Thus, it is expected that learning in an environment that elicits positive activating affect increases learning outcome compared to an environment that does not elicit such affective states. However, because of the findings from Park and colleagues [11], the present study further aims to control for any effects of preexperimental affective states as covariates. Moreover, because of strong connections between positive affect and achievement goal orientations (see [58] for a meta-analysis) it is further tested whether levels of achievement motivation may influence the effectiveness of the affect induction procedure and vice versa.
6. Method
6.1. Sample and Experimental Design
A total of 118 undergraduate students from a German university took part in the present study. All participants chose freely to participate in the study after being invited via e-mail. The participants selected one out of several time slots to be tested. Participants were tested in groups of up to 20 people; group size varied based on students’ preference for the available time slots. Each group of participants (i.e., each time slot) was randomly assigned to one of two conditions: participants in the positive affect (PA) condition had to learn in a multimedia environment that was designed to induce positive activating affect, whereas participants in the control condition learned in an affective neutral environment. Four of the 118 participants were excluded from all analyses because they self-reported that they were highly familiar with the learning topic. Three students were excluded because they failed to give an appropriate code number to match the questionnaires from pre- to posttest. The average age of the remaining 111 participants was 20.2 years (SD = 1.8; ranging from 18 to 27 years). Eighty-eight (79.3%) of the students were females. Most of the participants (100, 90.1%) were studying media communication; the others were studying human computer interaction. The average study time was 2.0 (SD = 1.0) semesters, meaning that most of the students were at the beginning of their studies. In sum, 61 (55%) participants were in the PA condition, and 50 (45%) were in the control condition. Participants were rewarded with test-taking credits.
6.2. Materials
6.2.1. Design of the Learning Environment
The learning material was used to manipulate affect through the use of different colours and shapes. It consisted of two hypertexts (one for each condition) on the subject of “functional neuroanatomy” written in German using HTML 5. Despite colouration and image shaping, both hypertexts were constructed identically and contained the same amount of learning content as well as the same navigation opportunities. Each hypertext contained seven sections (spinal cord, brain stem, cerebellum, mesencephalon, diencephalon, telencephalon, and prefrontal cortex), which could be navigated via the use of a navigation menu on the left side of the screen, the forward and backward buttons of the browser, or the key words of each section, which were linked with other sections. In sum, the learning material consisted of approximately 600 words. Moreover, nine figures of different parts of the human brain were used.
Figure 1 shows examples of both learning environments. The background and the images in the control condition were monochromatic; that is, we used different shades of grey. Moreover, the images in the control condition were framed with rectangular shapes. In contrast, the PA condition was designed using bright colours with high saturation such as yellow or orange in the background and within the images. In addition, round shapes framed all images. The images were implemented exclusively in order to induce positive activating affect in the PA condition. Therefore, they did not contain information relevant for the performance test. It was assumed that these manipulations would induce a positive activating affect during learning in the PA condition without influencing the amount or the content of the material.
(a)
(b)
6.3. Measures
6.3.1. Self-Assessed Prior Knowledge
Prior knowledge was assessed using the following single self-report item: “To me, the theme of ‘functional neuroanatomy’ is…” (a) “… completely unknown,” (b) “… known, but not actively reproducible,” or (c) “… completely known.” Four participants, who chose answer (b) or (c), were excluded from further analyses.
6.3.2. Activating Affect
For measuring activating affect that occurred during learning, the German version of the Positive and Negative Affect Schedule (PANAS) from Watson et al. [59] translated by Krohne et al. [60] was used. The questionnaire differs between the Positive Affect Scale (PAS) and the Negative Affect Scale (NAS), which are considered to be independent of one another [61]. According to Watson and colleagues [59], the PAS measures subjective states of feeling “enthusiastic, alert and active” (p. 1063), whereas the NAS examines the person’s experience of misery and unpleasant excitement. Each scale consists of 10 items asking for the individual’s experience of different emotionally charged states. In the present study, the original 5-point Likert-scale ranging from 1 = “very slightly or not at all” to 5 = “extremely” was replaced by a visual analogue scale with a range from 0 = “not at all” to 100 = “completely.” These scales have proven to be sensitive even to small changes in affective states [62]. As mentioned by Watson and Clark [63], the PANAS is reliable, valid, and proven in measuring affect retrospectively across various studies. Moreover, the PANAS is supposed to reflect affective states on the trait as well as state level, depending on the instructions used. In the present study, a state version was used because we aimed at measuring changes in actual rather than general learning-related affect. Internal consistencies in the present study turned out quite well in pre- and postmeasures (all values for Cronbach’s were greater than .84).
6.3.3. Achievement Motivation
Achievement goal orientations were measured as indicators of achievement motivation. To be able to assess small changes in goal orientations, an adapted version of the SELLMO self-report questionnaire [64] was used. The original SELLMO consists of 31 items and four scales measuring mastery goal orientation, avoidance performance goal orientation, and work avoidance (8 items each) as well as approach performance goal orientation (7 items) using a 5-point Likert-scale ranging from “not at all” to “perfectly.” The original item stem of the SELLMO was altered from “For me, studying is about …” to “At the moment, I want to …” in the present study in order to enable a more state-like measurement. Moreover, several items were changed (e.g., “… showing that I am good at something” was changed to “… showing that I am good at this task”) or excluded (e.g., “… to do not have any hard exams”). Moreover, the SELLMO’s work avoidance subscale was discarded. In the end, the adapted version of the SELLMO used in this study consisted of 19 items. Analogous to measuring affect, visual analogue scales ranging from 0 = “not at all” to 100 = “perfectly” instead of a Likert-scale were used. Internal consistencies were calculated and showed satisfactorily results with a minimum value for Cronbach’s of .81. This indicated that the adaption of the SELLMO to measure state instead of trait achievement motivation as well as changing the response format did not have negative consequences on the reliability.
6.3.4. Learning Outcomes
The understanding of the core content of the learning material (comprehension) and transferring the content of the learning material into new contexts (“transfer”) were measured. Comprehension was assessed with 12 single choice items (with four answer options each). The items focused on asking for facts about the different parts of the human brain. To answer the questions, participants had to remember and integrate information derived from one or several pages in the learning material. The total number of correctly answered items was averaged and used as an index for comprehension, resulting in a score between zero, indicating that the learner had not answered any of the questions correctly, and one, indicating that the participants had answered all of the 12 questions correctly. Internal consistency was acceptable for research purposes (Cronbach’s = .61) according to Nunnally and Bernstein [65]. To measure transfer participants were asked two open-ended questions. Two trained student assistants rated the answers from 0 to 3 points (0 = “wrong answer,” 1 = “using correct terms but incorrect relationships between them,” 2 = “using correct terms and partly correct linkages between them,” and 3 = “correct answer”). To succeed in answering these questions, it was necessary to integrate facts from different pages within the learning material and transfer these facts to the new problem presented in the question. The mean score across the two questions was used as an index for transfer with a minimum of 0 points, indicating wrong answers in both questions, and a maximum of 3 points, indicating totally correct answers in both questions. Cohen’s kappa was calculated based on the scores of 20 randomly selected participants who were rated independently by two trained student assistants ( = .81). Based on the guidelines from Altmann [66], interrater reliability was substantial for the subsample.
6.4. Procedure
After being welcomed by the experimenter, participants were informed about the experiment’s procedure. To mask the aim of the study, they were further told to act as beta testers for a hypertext environment. Participants then were seated in front of a computer and asked to follow the instructions presented on the screen. Before the learning phase, demographic variables, the participant’s estimation of prior knowledge, and initial affect as well as achievement goal orientations were assessed. Afterwards, the participants were asked to learn for 20 minutes in either the PA or control condition (“please work with the learning material for the next 20 minutes and try to memorize as much of the presented content as possible”). During that time, all participants were free to navigate within in the learning environment. After the learning phase, learning outcome and the postexperimental affect and goal orientations were measured. Finally, the participants were thanked and informed about the real purpose of the study. In total, the experiment lasted approximately 60 minutes. All questionnaires as well as the learning test were administered with the online survey tool “SoSci Survey” [67].
7. Results
For hypotheses testing, differences in learning outcome were analysed between the PA and control condition. We used a regression approach for most of the analyses to include covariates as predictors in the regression and test if they are appropriate, that is, if they have the same impact on the dependent variable for both groups [68, 69]. We graphically inspected the distribution of the studentized residuals for each regression analysis using scatterplots, histograms, and Q-Q plots to ensure that the assumptions for regression analysis were met, and we checked for collinearity by ensuring that no tolerance was higher than .10. All of the analyses were calculated with IBM SPSS Statistics 22 software using a 5% significance level.
7.1. Differences prior to the Learning Phase
To exclude systematic distortions due to preexperimental differences between the two conditions, a multivariate analysis of variance (MANOVA) with the preexperimental positive and negative affect as dependent variables was calculated. Descriptive statistics are shown in Table 1. Box’s test indicated no violation of the equality of covariance matrices. Using Pillai’s Trace, the one-way MANOVA did not show any significant differences between the control and PA condition, = .015, (2, 108) = .82, , and = .02, which indicates that there were no systematic group differences in affect before the treatment occurred. Another MANOVA was calculated with levels of goal orientations before learning as dependent variables in order to test for differences between the two groups (see Table 1). Using Pillai’s Trace, there were no significant differences between the control and PA condition, = .03, (3,107) = 1.14, = .336, and = .03. Hence, participants in the two conditions did not differ in levels of achievement goal orientation before the learning phase. Furthermore, the randomization for the demographic variables was checked. There were no significant differences between the conditions concerning the age of the participants, = −.69 and = .490, and the distribution of gender was the same for both conditions, = .03 and = .865.
7.2. Affect before and after the Learning Phase
To check if the treatment induced positive affect we used a mixed ANOVA with pre- and postexperimental positive affect as the within-person factor and condition as the between-person factor. Descriptive statistics can be found in Table 1. Results of the mixed ANOVA showed no significant interaction effect, (1, 109) = 0.10, , and < .01, but a significant effect of time, indicating the decrease of positive affect during the learning phase for both groups, (1, 109) = 4.41, , and = .04. Using negative affect as the dependent variable there was neither an increase nor a decrease in negative affect during the learning phase, (1, 109) = 0.72, , and = .01, and no significant interaction of time and condition, (1, 109) = 0.30, , and < .01.
7.3. Affect and Learning Outcome
Table 1 shows means and standard deviations for learning outcomes in terms of comprehension and transfer. We dummy-coded the conditions, using the control condition as reference group, and tested the hypothesis in three steps. First, a regression of performance on condition was calculated to test the effectivity of our treatment (hereinafter called the condition-only model). Second, potential covariates (i.e., preexperimental positive and negative affect) were added to the regression model, named the main effects model. Third, the interactions between condition and covariates were added to the model to test if the model was specified correctly, that is, if the covariates have the same effect on posttest performance for both conditions. This model was called the interaction model. Finally, we removed all unexpected nonsignificant predictors from the model to minimize overfitting, and we ended with the final model that best explains the variance in the dependent variable.
7.3.1. Comprehension
The results from the condition-only model show that condition had no significant effect on the comprehension of the learning material, = .01, = 0.61, and = .437. The amount of explained variance increases significantly in the main effects model, compared to the condition-only model, = .11, = 6.51, and = .002, that is, the main effects model explained = .11 of variance in comprehension, = 4.56 and = .005. An inspection of the regression coefficients (see Table 2) shows that the more the positive affect and the less the negative affect before the learning phase are, the more the students comprehend the learning content.
The increase in predictive power over the main effects model was not significant when adding first-order interactions between condition and positive as well as negative affect, = .05, = 3.01, and = .053, but nevertheless, the interaction between condition and negative affect showed a significant effect (see the interaction model in Table 2). To test for a misspecification of the model, it was also checked for the interaction between positive and negative affect and for the second-order interaction of all three main predictors, but none of these interactions became significant. The final model explained significantly more variance than the main effects model, = .04, = 4.92, and = .029, and explained = .15 of the variance in comprehension, = 4.78 and . As observed from Table 2, the condition had no significant main effect, but the main effects of positive and negative affect as well as the interaction between condition and negative affect were significant predictors of comprehension after learning.
To interpret this model, we plotted the regression lines of the interaction between comprehension and negative affect for the control and PA conditions in Figure 2. The simple slopes of comprehension on negative affect are = −0.081, = −3.11, and = .002, for the control condition, and = −0.004, = −0.19, and = .850 for the PA condition. Therefore, the more the negative affect before learning is the less the students in the control condition comprehended. We calculated regions of significance for the differences between the conditions as described by Preacher et al. [70] using their website tool. For students with a centered preexperimental negative affect in the interval , the difference in comprehension between the PA and the control condition is not significant, whereas the difference is significant outside this interval. As no student in our sample had values for preexperimental negative affect below −32.5 this region is not of much interest. However, 11 students (9.9%) have a centered negative affect higher than 13.6 before learning, and thus, for those students the PA condition led to enhanced comprehension compared to the control condition.
7.3.2. Transfer
The condition-only model showed no significant effect on transfer after the learning, = .03, , and (see Table 2). In the main effects model the amount of explained variance did not significantly increase, = .04, , and = .102; that is, neither positive nor negative affect predicted transfer. Similarly, the interaction model on transfer did not significantly improve the amount of explained variance compared to the main effects model, = .02, = 0.96, and = .387, because none of the interactions was significant (see Table 2 for regression coefficients). Finally, we tested for the interaction of negative affect before the learning phase with positive affect before the learning phase and the second-order interaction between condition, positive affect, and negative affect. This model significantly improved the amount of variance explained compared to the interaction model, = .07, , and = .017. The final model explained = .13 of the variance, , and = .009 and will be inspected in more detail in the following.
To interpret the results, we plotted the regression lines for each condition in Figure 3. For all levels of preexperimental negative affect, there are significantly different slopes for the PA condition compared with the control condition. Thus, we will inspect this interaction only for an average level of preexperimental negative affect in more detail (see Figure 3(b)). The simple slope for the control condition was not significant, = −0.012, = −1.01, and = .317, but the simple slope for the PA condition was significant, = 0.021, = 2.16, and = .033; thus, the more positive the preexperimental affect is, the more the students were able to transfer the acquired content to new problems. We calculated the region of significance for an average preexperimental negative affect, and students from the PA condition showed lower values in transfer compared to students from the control condition within the interval of for preexperimental positive affect. As no student in our sample has a preexperimental positive affect within this interval, this result is not interpreted any further. Condition does not make a difference in transfer for students with a preexperimental positive affect within the interval . There are 58 students (52.3%) in the sample who had values within this interval. However, the PA condition was more effective than the control condition for students with a positive affect within the interval . As 53 students (47.7%) in the sample have values for preexperimental positive affect within this interval, a positive effect of the PA condition on transfer can be expected for a considerable amount of the students.
(a) Negative affect before learning 1SD below average
(b) Average negative affect before learning
(c) Negative affect before learning 1SD above average
This pattern of results is the same for students having a preexperimental negative affect below (see Figure 3(a)) or above average (see Figure 3(c)), but the slopes and the regions of significance for both conditions are significantly moderated by preexperimental negative affect (see the interaction of preexperimental positive affect by preexperimental negative affect in Table 3).
7.3.3. Achievement Motivation
To test for treatment effects on achievement motivation a mixed MANOVA on achievement motivation subscores (mastery, performance approach, and performance avoidance goal orientation) as dependent variables with the time of measurement (pre- versus postmeasures) as within-subject factor and type of the learning material (CG versus PA) as between-subject factor was computed. Using Pillai’s Trace, there was a significant multivariate main effect of time, = .12, (3, 107) = 5.05, = .003, and = .12. Separate univariate RM-ANOVAs were significant for all achievement motivation subscores (see Table 3).
As can be seen in Table 1, means had decreased from pre- to postmeasurement in the three types of goal orientation. However, there was no significant multivariate main effect of the type of the learning environment, = .02, = .60, = .615, and = .02. Furthermore, analyses also revealed a nonsignificant interaction between the type of the learning material and the time of measurement, = .02, = .81, = .489, and = .022. The regression coefficients for all the models are reported in Table 4. As the only significant interaction was found for mastery goal orientation as the dependent variable, only this result will be described in more detail. In sum, the final model explained = .66 of variance in the mastery goal orientation after learning, = 50.93 and . Variance was explained by the mastery goal orientation before learning but also by the positive affect before learning and by the interaction of positive affect before learning and the condition. The simple slopes were = .30, = 2.62, and = .010 for the control condition and = −.06, = −.60, and = .551 for the PA condition, indicating that positive affect before learning predicted the mastery orientation after learning for students who learned with the neutral learning environment but not for students who learned with the PA environment (see Figure 4).
Regions of significance were calculated. There were no significant differences between conditions for mastery goal orientation when the positive affect before learning was within the interval , and this was true for 69 students (62.2%) of the sample. As no participant had a positive affect before learning that was lower than −43.0 the region below the interval is of no further interest. However, within the interval for positive affect before learning, participants in the control condition reported significantly higher levels of mastery goal orientation than those in the PA condition. This was true for 42 students (37.8%) of the sample and is contrary to what was expected in the third hypothesis. Summing up the results concerning achievement goal orientations, there was no general main effect of PA condition versus CG on the change of motivation during the learning. Levels of mastery goal orientation nevertheless decreased more for students in the PA condition than in the control condition given high levels of positive activating affect before learning.
8. Discussion
The present study examined the influence of positive affect on learning outcome during multimedia learning. We assumed that participants who learned in an environment that induced positive activating affect by using bright and highly saturated colours and rounded shapes as design features would perform significantly better in comprehension and transfer than participants who learned in an affective neutral environment. Moreover, it was checked if there were any influences of preexperimental positive and negative affect in terms of covariates and if there were any relationships between the treatment and achievement goal orientations. For performance, it was found that participants in the PA condition outperformed those in the control condition depending on initial levels of positive and negative affect. No significant influences were found concerning the role of achievement goal orientations.
8.1. Group Differences between Positive and Neutral Condition
8.1.1. Affect Induction
In contrast to Um et al. [8], the present study revealed no significant increase in positive activating affect. Because there were no differences in age or gender between the two conditions, the observed differences in learning outcomes nevertheless imply an effect of the independent variable at least for a subsample. Hence, it is possible that students who showed higher levels of affect before learning benefit from the treatment rather than students who did not perceive strong affects. There are several possible explanations for an only partly successful treatment. Results on the effectiveness of emotional design paradigms are generally not consistent: Um and colleagues [8] were able to induce positive affect using warm colours and anthropomorphic design elements that enhanced learning outcome; Plass and colleagues [9] only found partly similar results; Park and colleagues [11] as well as and Mayer and Estrella [10] failed in inducing positive affect.
Unlike most of the above-mentioned studies, we did not use anthropomorphic design elements in the learning materials. Besides, it was argued that baby-face-like shapes of the figures in Plass’s studies could also divert attention rather than figures that did not use these shapes. Consequently, using these elements might have caused learning gains because the figures presented information that was tested after learning more saliently than those in the control condition. In contrast, the figures used in the present study provided information related to the topic but were not part of the learning test afterwards. More particularly, the figures were exclusively dedicated to enhance the efficiency of the affect induction. This ensured that performance was not increased due to better recognition or memorization of the figures. However, given the present results, it may have been the case that the treatment was not strong enough to elicit affective states. As a result, it is advised to strengthen the affect induction in future research. It is also possible that the affect induction did not persist for the whole time of learning. Maybe the affect induction had more or less quickly worn out depending on interindividual differences in affect prior to learning. Additional process measurements of affective states are recommended to check for these difficulties in future studies.
8.1.2. Learning Performance
The results on learning outcome do not generally confirm the hypotheses because differences in learning between the PA and control conditions were not significant for comprehension and only marginally significant for transfer when covariates were not considered. This contradicts previous findings [8, 9]. Nevertheless, significant interaction effects were found when covariates were taken into consideration. For comprehension, the findings indicated that high levels of negative activating affect before learning predicted a decrease of learning outcome when no positive affect was induced. This is in line with previous work that showed that negative activating affective states can be detrimental for learning outcomes (e.g., [26, 71]). However, participants’ preexperimental negative affect did not decrease comprehension in the PA condition in which positive activating affect was induced. Therefore, the present results imply that the induction of positive activating affect may protect participants with high initial negative affect from performance deficits. Moreover, participants who experienced high levels of preexperimental positive affect performed significantly better in the transfer tasks in the PA condition compared to the control condition. In other words, participants who felt better before learning were significantly better in transferring knowledge into new contexts when they obtained the positive affect induction. This result supports earlier findings in which positive affect was associated with increased creativity and problem-solving (e.g., [30, 32]). The supremacy of the PA over the control condition in transfer was further found for all levels of preexperimental negative affect. These results contradict findings of Um et al. [9] who did not only induce positive affect while learning via the design of the learning material but also beforehand by using an imaginative and self-referencing induction method. Participants that received a positive affect induction and had to learn in the positive affect condition nevertheless did not outperform other participants. However, using the same materials as Um et al. [8], Park et al. [11] found very similar results to those that were found in our study; that is, inducing positive affect through colour and shape can enhance transfer outcomes at least if positive affect before learning is high. Consequently, the present results contradict findings that have concluded a detrimental effect of positive activating affective states [56]. Hence, in this experimental study, affective states before learning also predicted the success of an emotional design paradigm in order to enhance learning performance.
8.1.3. Achievement Motivation
There were no differences between the positive affect and control condition in the change of the goal orientations. These findings differed from the results of Um et al. [8] and, for example, Linnenbrink [7] who found an increase of intrinsic and extrinsic motivation when inducing positive affect. Aspinwall [31] argued that positive affective states may reduce motivation to learn because the motivation of doing something (e.g., learning) that is likely to disrupt a current state of pleasantness should be rather low. Accordingly, our results revealed a significant interaction; that is, students with high levels of positive affect before learning reported higher levels of mastery goals in the control condition than in the PA condition. Therefore, inducing positive activating affect may cause decreases in mastery goals when participants are highly positively activated because they do not want this state being disrupted.
However, our results are different to previous studies (e.g., [8, 72]) and a meta-analysis by Huang [58] reporting positive correlations between positive affect and mastery goals. Nevertheless, Brown [73] also found a negative relation. The obtained results can be interpreted at least in two ways: first, there was no increase in levels of mastery goal orientation because, contrary to trait goal orientations, positive affect and state goals might not be positively correlated. Second, the results indicate that a relatively small intervention (variation of the colours and shapes of the learning material) cannot significantly alter deeply entrenched constructs like goal orientations so easily. The first explanation seems rather unlikely because it is assumed that the changes that were made to measure state level did not alter the items drastically; that is, the adaptions should not have resulted in constructing completely unrelated constructs compared to the original scale. Additionally, trait achievement goal orientations describe an individual’s tendency to try to achieve certain goals in various achievement situations. State achievement goals on the other hand may be linked more closely to the actual setting and can vary to some degree across different achievement situations, e.g., depending on experienced levels of control over the situation and the subjective value of reaching that specific goal [15]. Thus, trait and state levels should nevertheless be correlated substantially. Furthermore, there are findings that show that positive activating affect is associated with higher pursuit to accomplish one’s goals in academic settings [74]. Albeit goal orientations can be altered experimentally (e.g., [75, 76]), it is still more suitable to assume that goal orientations do not vary strongly by a slight intervention as realized in this experiment.
8.2. Limitations and Future Work
There are several constraints concerning our study. First, the assessment of positive and negative affect might be compromised in several ways due to single-source biases. In his component process model, Scherer (e.g., [12, 77]) defines affective states as different patterns of appraisals regarding affective, cognitive, motivational, peripheral physiological, and expressive components of emotional experiences. Self-assessment questionnaires do not address all of these components and therefore may not be sufficient for measuring affective experiences exhaustively. Hence, difficulties in using self-reports cannot be excluded; that is, participants might have answered our questionnaires, for example, based on social desirability. Moreover, retrospective assessment of affective states might be confounded by memory distortions. Affect further changes dynamically [19] during learning. These changes cannot be observed using questionnaires after the learning situation. Future research should consider these limitations by using multiple methods for assessing affective states, such as physiological data as well as video recordings of the learning situation.
Moreover, although there is evidence that bright and saturated colours as well as round shapes are associated with positive activating affect (e.g., [52, 54]), Elliot and Maier [47] state that empirical findings are not consistent in this field of research. The authors particularly doubt that colours with longer wavelengths elicit physiological arousal. Consequentially, more studies have to be performed in which the colouring scheme is varied. Additionally, our induction method is similar but not equivalent to the one that was used by Um et al. [8] and Plass et al. [9]; that is, we did not use anthropomorphic figures. Yet, it is an open question whether the two induction methods differ in eliciting affective states. Moreover, due to insignificant differences in pre- and postaffect it might also be assumed that the omission of anthropomorphic forms may create an affect induction that is too subtle for eliciting affective states that are perceived and expressed consciously by the learners. Furthermore, our study only considers interaction effects between affective states before learning and emotional design procedures intended to elicit positive activating affect. However, specific colours and shapes could also elicit negative affective states (e.g., the use of the colour red, which might be associated with academic failure) that may impair learning outcomes. To date, not much is known about the interaction between induced negative affect and the learners’ affective states before learning. This seems to be due to findings from correlational studies (see, e.g., [18] for a review) that negative affect (e.g., test anxiety) often is not beneficial for learning.
Nevertheless, our results on learning outcome form a consistent picture: inducing positive affect predicted better comprehension and transfer for participants with high levels of initial positive or negative affect. However, although our treatment seemingly worked for at least some of the participants, we do not know the mechanisms underlying these effects. In fact, the influence of negative activating affect before learning on our treatment cannot presently be explained because our affect induction was meant to induce positive affect and not to reduce negative affect. Additionally, further studies should assess prior knowledge with a performance test instead of using self-reports.
To sum up, the present study provides additional evidence for positive emotions’ potential to facilitate outcomes in multimedia learning. From an instructional point of view, the understanding of the mechanisms that elicit positive affect during learning is useful for improving outcomes and should thus be investigated in future research. Our study revealed complex patterns of interactions between the induction of affective states and preexperimental positive and negative affect in a short-time learning situation. If these patterns remain stable in future research, such treatments will require taking initial affective states of the learner seriously into consideration. However, treatments for fostering learning outcomes have to be applicable in real classrooms. It would do no harm if teachers strengthen their students’ positive affects (e.g., by using learning materials that contain emotional design principles). At best, students who are at least in a nonneutral affective state before learning will do better in terms of comprehending learning contents and transferring this information into new contexts. Somewhat challenging in classroom contexts is the adoption of the emotional design to the current affective status of each single student; this may only be an option in intelligent, personalized learning systems (e.g., intelligent tutoring systems [78]).
Disclosure
An earlier version of this work has been presented at EARLI conference 2015.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Acknowledgments
This publication was funded by the German Research Foundation (DFG) and the University of Würzburg in the funding programme Open Access Publishing.