CHAPTER FOUR RESULTS AND DISCUSSION
This chapter aims to present and discuss the results of the study. In accordance with the research questions, the results of the effects of semantic mapping strategy on participants’ reading comprehension and on different proficiency levels are presented first. Whether text difficulty and text structure have any effects on the results of using semantic mapping strategy are presented next. Then, the experimental group’s
responses to the semantic mapping training and application, including the
post-treatment questionnaire and the interviews of the experimental group will be described. All the results of the study will be discussed in detail in the last section.
Effects of Semantic Mapping Strategy on Reading Comprehension
In this section, the test results of the control and experimental groups are
presented. In order to investigate the effects of semantic mapping strategy on reading comprehension, all the scores on recall protocols and multiple-choice comprehension tests were translated into percentage, and then SPSS Multivariate Tests (one-way MANOVA) were employed for the analysis.
Written Recall Protocols
The means and standard deviation of the three the written recall protocols between the experimental and the control groups are listed in Table 9.
Table 9
Means and Standard Deviation of the Written Recall Protocols of the Two
Groups
(total score for each article= 100) Experimental Group (N=64)
M SD
Control Group (N=64) M SD
Article 1 67.00 10.30 65.72 10.72
Article 2 48.58 14.57 38.72 19.41
Article 3 33.86 14.42 27.31 15.26
Average 49.91 13.10 43.92 15.13
According to Table 9, the experimental group had higher means than the control
group. The results of one-way MANOVA (see Table 10) showed that treatment (semantic mapping strategy) had a significant overall effect on the written recall protocols, F(3,124)= 4.341 (p < .01). That is, there was a significant difference between the two groups, and the experimental group significantly outperformed the control group. Thus, semantic mapping activity facilitated students to recall idea units after reading these articles.
Table 10
Summary of Multivariate Analysis for the Written Recall Protocols of the Two Groups
Effect Value Hypothesis df Error df F
Treatment Pillai's Trace .095 3 124 4.341**
** p < .01
Multiple-choice Comprehension Test
Table 11 presents the means and standard deviation of the three multiple-choice comprehension tests between the experimental and the control groups.
Table 11
Means and Standard Deviation of the Multiple-choice Comprehension Tests of the Two Groups
(total score for each article= 100) Experimental Group (N=64)
M SD
Control Group (N=64) M SD
Article 1 64.41 16.24 59.33 16.64
Article 2 66.41 20.03 58.59 22.37
Article 3 64.06 20.53 55.93 16.01
Average 64.96 15.60 57.95 18.34
As shown in Table 11, the mean scores of the experimental group were higher than those of the control group. However, the results of one-way MANOVA (see Table 12) indicated that treatment (semantic mapping strategy) had no significant overall effect on the multiple-choice comprehension tests, F(3,124)= 2.641 (p > .05);
no significant difference was found between the experimental and the control groups.
Table 12
Summary of Multivariate Analysis for the Multiple-choice Comprehension Tests of the Two Groups
Effect Value Hypothesis df Error df F
Treatment Pillai's Trace .060 3 124 2.641
Since no significant overall effect of treatment on the multiple-choice
comprehension tests existed, the subsequent Univariate F tests was conducted to test if treatment had effect on each article (see Table 13). The results showed that no significant effect between the two groups was found on Article 1 (F= 3.045, p > .05).
But there were significant differences between the two groups’ performance on Article 2 (F= 4.333, p < .05) and Article 3 (F= 6.235, p < .05), and the experimental group significantly outperformed the control group in comprehending Article 2 (M=66.41 vs.
58.59) and Article 3 (M= 64.06 vs. 55.93). Accordingly, though semantic mapping strategy did not have significant overall effect on students’ multiple-choice
comprehension tests, it still enhanced the experimental group to comprehend two of the three articles.
Table 13
Summary of ANOVA for the Multiple-choice Comprehension Tests between the Two Groups
SS df MS F
Article1 Between Groups 825.195 1 825.195 3.045
Within Groups 30407.547 126 270.219
Article2 Between Groups 1953.125 1 1953.125 4.333*
Within Groups 56796.875 126 450.769
Article3 Between Groups 2112.500 1 2112.500 6.235*
Within Groups 42687.500 126 388.790
* p < .05
Based on the results presented in Tables 9 to 13, it was obvious that semantic mapping strategy was facilitative in promoting students’ reading comprehension.
Effects of Semantic Mapping Strategy on Different Proficiency Levels
In order to see the effects of semantic mapping strategy on learners of different
proficiency levels, SPSS Multivariate analysis was conducted on each proficiency level.
Written Recall Protocols
Table 14 shows the mean scores and standard deviation of the two high proficiency groups’ written recall protocols.
Table 14
Means and Standard Deviation of the Written Recall Protocols of the Two High-proficiency Groups
(total score for each article= 100) Experimental Group (N=32)
M SD
Control Group (N=32) M SD
Article 1 73.56 7.64 72.16 7.72
Article 2 58.31 11.24 47.97 18.41
Article 3 43.97 10.47 35.44 15.40
Average 58.61 9.78 51.86 13.84
According to Table 14, the high-proficiency students in the experimental group (HE) had higher recall scores than those in the control group (HC) after reading the three articles. Besides, the results of one-way MANOVA analysis (see Table 15) also showed a significant overall effect of treatment between the two groups, F(3,60)=
3.275 (p < .05). That is, there was a significant difference between the written recall protocols of high proficiency students in experimental and control groups, and semantic mapping strategy enhanced the high-proficiency students’ recall performance after reading these articles.
Table 15
Summary of Multivariate Analysis for the Written Recall Protocols of the Two High-proficiency Groups
Effect Value Hypothesis df Error df F
Treatment Pillai's Trace .141 3 60 3.275*
* p < .05
As to the two low-proficiency groups, Table 16 shows their means and standard
deviation of the written recall protocols after reading the three articles.
Table 16
Means and Standard Deviation of the Written Recall Protocols of the Two Low-proficiency Groups (total score for each article= 100)
Experimental Group (N=32) M SD
Control Group (N=32) M SD
Article 1 60.44 8.27 59.28 9.41
Article 2 38.84 10.45 29.47 15.80
Article 3 23.75 10.10 19.19 9.99
Average 41.01 9.61 35.98 11.73
As indicated in Table 16, the low-proficiency students in the experimental group (LE) still had higher means than the low-proficiency students in the control group (LC). The results of one-way MANOVA analysis (see Table 17) also revealed that the treatment had a significant overall effect on the three written recall protocols,
F(3,60)= 2.830 (p < .05). Accordingly, semantic mapping strategy also facilitated the
low-proficiency students to recall more idea units after reading these articles.
Table 17
Summary of Multivariate Analysis for the Written Recall Protocols of the Two Low-proficiency Groups
Effect Value Hypothesis df Error df F
Treatment Pillai's Trace .124 3 60 2.830*
* p < .05
Multiple-choice Comprehension Tests
Table 18 presents means and standard deviation of the three multiple-choice comprehension tests between the two high proficiency groups.
Table 18
Means and Standard Deviation of the Multiple-choice Comprehension Tests of the Two High-proficiency Groups
(total score for each article= 100) Experimental Group (N=32)
M SD
Control Group (N=32) M SD
Article 1 73.94 10.73 68.66 15.21
Article 2 80.47 13.82 67.97 20.31
Article 3 75.63 15.01 62.50 14.14
Average 76.68 13.19 66.38 16.55
As shown in Table 18, HE still had higher means than HC in the three multiple-choice comprehension tests. Table 19, the results of one-way MANOVA analysis, indicated that a significant overall effect of treatment on the multiple-choice comprehension tests was found, F(3,60)= 6.215 (p < .01). That is, semantic mapping strategy enhanced the high-proficiency students’ comprehension of these articles.
Table 19
Summary of Multivariate Analysis for the Multiple-choice Comprehension Tests of the Two High-proficiency Groups
Effect Value Hypothesis df Error df F
Treatment Pillai's Trace .237 3 60 6.215**
Table 20 reveals the means and standard deviation of the three multiple-choice comprehension tests between the two low-proficiency groups.
Table 20
Means and Standard Deviation of the Multiple-choice Comprehension Tests of the Two Low-proficiency Groups
(total score for each article= 100) Experimental Group (N=32)
M SD
Control Group (N=32) M SD
Article 1 54.86 15.26 50.00 12.32
Article 2 52.34 14.70 49.22 20.56
Article 3 52.50 18.84 49.38 15.23
Average 52.23 16.27 49.53 16.04
As shown in Table 20, LE and LC had very similar means after reading the three articles. The results of one-way MANOVA analysis showed no significant overall effect of treatment between the two low-proficiency groups’ multiple-choice
comprehension tests, F(3, 60)= .856 (p > .05). Besides, the results of the subsequent
Univariate F tests (see Table 21) revealed that treatment had no significant effect on
each article (p > .05). Obviously, semantic mapping strategy did not enhance the
low-proficiency students’ comprehension on the three articles.
Table 21
Summary of ANOVA for the Multiple-choice Comprehension Tests between the Two Low-proficiency Groups
SS df MS F
Article1 Between Groups 380.250 1 380.250 1.977
Within Groups 11925.500 62 192.347
Article2 Between Groups 156.250 1 156.250 .489
Within Groups 19804.688 62 319.430
Article3 Between Groups 156.250 1 156.250 .533
Within Groups 18187.500 62 293.347
Based on the results presented in Tables 14 to 21, the high-proficiency students in the experimental group significantly outperformed those in the control group both in recall protocols and multiple-choice comprehension tests. However, the
low-proficiency students in the experimental group only performed significantly better than control group in the recall protocols. Clearly, it was the high-proficiency students that benefited more from semantic mapping instruction.
Effects of Difficulty Level and Structure of a Text on Semantic Mapping Strategy
In order to investigate whether the difficulty level and the structure of a text influenced the effects of semantic mapping strategy on students’ comprehension of the three articles in Practice Phase, the effect of treatment (semantic mapping strategy) on each article was further analyzed.
Difficulty Level of a Text and Semantic Mapping Strategy
According to readability level measured by Flesch-Kincaid Grade Level, the difficulty level of the three articles used in Practice Phase was Article 2 (8.0) >
Article 3 (7.6) > Article 1 (6.3). Article 2 and Article 3 were classified as Challenging;
while Article 1 was Easy.
The results in Table 9 showed the significant overall effect of treatment
(semantic mapping strategy) on the three written recall protocols between the two
groups, F(3,124) = 4.341 (p < .01). The subsequent LSD Pairwise Comparisons (see
Table 22) showed that no significant difference was found between the two groups in the recall protocol of Article 1 (p > .05). But, the experimental group performed significantly better than the control group in the recall protocols of Article 2 (p < .01) and Article 3 (p < .05). Clearly, semantic mapping strategy helped the experimental group to recall more idea units of the challenging texts (Article 2 and Article 3).
TABLE 22
Summary of LSD Pairwise Comparisons for the Written Recall Protocols of the Two Groups
(total score for each article= 100) (I) Means of
Exp. Group
(J) Means of Ctrl. Group
Std. Error Mean Difference (I-J)
Article 1 67.00 65.72 1.86 1.28
Article 2 48.58 38.72 3.03 9.86**
Article 3 33.86 27.31 2.62 6.55*
* p < .05 ** p < .01
As to the effect of treatment on three multiple-choice comprehension tests, Table 12 showed no significant overall effect of treatment between the two groups (p > .05).
While, based on the means (see Table 11) and the results of subsequent univariate F test (see Table 13), the experimental group and the control group also showed significant differences in the multiple-choice comprehension tests of Article 2 (M=
66.41 vs. 58.59, p < .05) and Article 3 (M= 64.06 vs. 55.93, p < .05). It was obvious that the experimental groups performed significantly better than the control group in reading the two challenging texts, Article 2 and Article 3. That is, semantic mapping strategy promoted students’ comprehension of challenging texts.
The results mentioned above indicated that semantic mapping strategy did not
facilitate students’ reading comprehension when the text was easy (Article 1), but it
did help students to comprehend the challenging texts both in terms of recall protocols
and multiple-choice questions. Clearly, the difficulty level of the text influenced the
effects of semantic mapping strategy on reading comprehension.
Structure of a Text and Semantic Mapping Strategy
According to Carrell (1984b), readers comprehended a text better when the structure of the text was more organized. Since semantic mapping strategy was an effective technique to help students see the structure of a text (Armbruster et al., 1984;
Reutzel, 1986), it was worthwhile to investigate the relationships between the structure of a text and semantic mapping strategy; that is, whether the structure of a text influenced the effects of semantic mapping strategy on reading comprehension. In this study, Article 2 represented a well-organized text and Article 3 was a
less-organized text. The following discussion focused on the effects of semantic mapping strategy on the comprehension of these two articles.
The results of Table 22 showed that the experimental group significantly outperformed the control group in the recall protocols of Article 2 (M= 48.58 vs.
38.72, p < .01) and Article 3 (M = 33.86 vs. 27.31, p < .05). Table 13 showed that the scores of the multiple-choice comprehension tests of Article 2 and Article 3 between the two groups were also significantly different (F = 4.333 & 6.235, p < .05) with the experimental group performed significantly better than the control group (see Table 11). Obviously, semantic mapping strategy did facilitate the experimental group to recall and comprehend both the well-organized text and the less-organized text.
Besides, the experimental group recalled the well-organized text (Article 2, p < .01) better than the less-organized text (Article 3, p < .05)
In addition, taking the proficiency levels into consideration, the results in Table 15 showed that treatment had a significant overall effect on the recall protocols of the two high-proficiency groups. The follow-up LSD Pairwise Comparison (see Table 23) indicated HE performed significantly better than HC in the recalls of Article 2 (M=
58.31 vs. 47.97, p < .01) and Article 3 (M= 43.97 vs. 35.44, p < .05). Clearly,
semantic mapping strategy enhanced the high-proficiency students’ recall
Table 23
Summary of LSD Pairwise Comparisons for the Written Recall Protocols of the Two High-proficiency Groups (total score for each article= 100)
(I) Means of Exp. Group
(J) Means of Ctrl. Group
Std. Error Mean Difference (I-J)
Article 1 73.56 72.16 1.36 1.40
Article 2 58.31 47.97 2.70 10.34**
Article 3 43.97 35.44 2.33 8.53*
* p < .05 ** p < .01
performance after reading Article 2 and Article 3.
As to the low-proficiency groups’ recall protocols, the results in Table 17 showed a significant overall effect of treatment. Besides, the subsequent LSD Pairwise
Comparisons (see Table 24) revealed LE did not significantly outscored LC after reading Article 3 (p > .05). But LE performed better than LC in Article 2, and a significant statistical difference was found (Mean difference= 9.37, p < .01). That is, semantic mapping strategy only helped the low-proficiency students recall more idea units of Article 2, the well-organized text.
Table 24
Summary of LSD Pairwise Comparisons for the Written Recall Protocols of the Two Low-proficiency Groups (total score for each article= 100)
(I) Means of Exp. Group
(J) Means of Ctrl. Group
Std. Error Mean Difference (I-J)
Article 1 60.44 59.28 1.57 1.16
Article 2 38.84 29.47 2.37 9.37**
Article 3 23.75 19.19 1.78 4.56
** p < .01
Concerning the multiple-choice comprehension tests, the results presented in
Table 19 showed that treatment had a significant overall effect on the multiple-choice
comprehension tests of the two low-proficiency groups (p < .05). Table 25, the
subsequent LSD Pairwise Comparisons, showed that HE significantly outscored HC
in the multiple-choice comprehension tests of Article 2 and Article 3 (p< .01).
Table 25
Summary of LSD Pairwise Comparisons for the Multiple-choice Comprehension Tests of the Two High Proficiency Groups
(total score for each article= 100) (I) Means of
Exp. Group
(J) Means of Ctrl. Group
Std. Error Mean Difference (I-J)
Article 1 73.94 68.66 2.33 5.28
Article 2 80.47 67.97 3.07 12.50**
Article 3 75.63 62.50 2.58 13.13**
** p < .01
Accordingly, semantic mapping strategy facilitated the high-proficiency students to comprehend both well-organized and less-organized texts. As to the low-proficiency students’ performance on the multiple-choice comprehension tests, the results in Table 21 showed that no significant effect was found on Article 2 and Article 3 (p > .05).
That is, semantic mapping strategy did not help the low-proficiency students comprehend either the well-organized text (Article 2) or the less-organized text (Article 3).
Based on the results discussed above, semantic mapping strategy helped the high-proficiency students to recall and comprehend both well-organized and
less-organized texts, but it only facilitated low-proficiency students to recall the idea units of the well-organized text.
Students’ Attitudes toward Semantic Mapping Strategy
This section presented the experimental group’s responses to the instruction that incorporated semantic mapping strategy. Their results on the post-treatment
questionnaire and their opinions elicited from the interviews are reported below.
Responses on the Post-treatment Questionnaire
The questionnaire contained ten items. Items 1 to 7 were used to evaluate students’ attitudes toward the semantic mapping strategy training in reading class.
Items 8 to 10 aimed to investigate students’ responses toward their independent
application of semantic mapping strategy in Practice Phase. Students’ responses were described and discussed as the positive responses or the negative ones. The former included “strongly agree” and “agree” responses. The latter contained responses of
“disagree” and “strongly disagree.” Table 26 presents the frequency and a percentage distribution of participants’ responses. The means (M) and standard deviation (SD) between the two different proficiency levels are included.
Concerning the participants’’ attitudes toward the semantic mapping strategy training in the reading class (see Table 26, Items 1 to 7), Item 5 received the highest score (M = 4.18), then Item 2(M = 4.08), Item 6 (M = 4.05), Item 1 (M = 3.98), Item 3 (M = 3.83), and Item 7 (M =3.72). Item 4 scored the lowest (M = 2.97). To be more specific, thirty-one HE students (97%) and twenty-seven LE students (85%) agreed on the effect of semantic mapping strategy on their understanding of text structure (Item 5); no students disagreed. With regard to whether the semantic map gave them a general idea of the content before reading (Item 2), twenty-nine HE students (91%) and twenty-eight LE students (88%) agreed and no one disagreed. Besides, fifty-two (H: 27, 84% & L: 25, 78%) students agreed that the semantic map helped them remember the content (Item 6), and only 3% of the HE students disagreed. More than eighty percent of HE students (81%) and LE students (85%) expressed that semantic mapping strategy helped them comprehend the text in the reading class (Item 1). Only one HE student (3%) and one LE student (3%) did not think so. More HE students (81%) than LE students (65%) thought that the semantic map helped them predict the content of the text (Item 3), but one HE student (3%) and one LE student (3%) did not.
As to whether they liked their teacher to use semantic mapping strategy to teach
reading (Item 7), twenty-four HE students (76%) and twenty-two LE students (69%)
expressed positive responses, while two HE students (6%) and two LE students (6%)
did not like the instruction. Concerning vocabulary learning (Item 4), only twelve HE
Table 26
Summary of Descriptive Statistics of the Participants’ Responses to the
Post-treatment Questionnaire (N= 32 for each proficiency level)
Items 5
a4 3 2 1 M SD
High 8(25)b 18(56) 5(16) 1(3) 0(0) 4.03 .74 Low 4(13) 23(72) 4(13) 1(3) 0(0) 3.94 .62 1. Using the semantic mapping
strategy in the reading course helps me comprehend
the text. Total 12 41 9 1 0 3.98 .68
High 8(25) 21(66) 3(9) 0(0) 0(0) 4.16 .57 Low 4(13) 24(75) 4(13) 0(0) 0(0) 4.00 .51 2. The teacher-student
interactive map used in class helps me understand the content of the text briefly
before reading. Total 12 45 7 0 0 4.08 .54
High 6(19) 20(63) 5(16) 1(3) 0(0) 3.97 .69 Low 2(6) 19(59) 10(31) 1(3) 0(0) 3.69 .64 3. The teacher-student
interactive map used in class assists me to predict the content of the text.
Total 8 39 15 2 0 3.83 .68
High 2(6) 10(31) 9(28) 11(34) 0(0) 3.09 .96 Low 1(3) 8(25) 8(25) 15(47) 0(0) 2.84 .92 4. The teacher-student
interactive map used in class assists me to guess and learn the new words in the text.
Total 3 18 17 26 0 2.97 .94
High 12(38) 19(59) 1(3) 0(0) 0(0) 4.34c .55 Low 6(19) 21(66) 5(16) 0(0) 0(0) 4.03 .59 5. The teacher-student
interactive map used in class helps me understand the
structure of the text. Total 18 40 6 0 0 4.18 .59
High 10(31) 17(53) 4(13) 1(3) 0(0) 4.13 .75 Low 6(19) 19(59) 7(22) 0(0) 0(0) 3.97 .65 6. The teacher-student
interactive map used in class helps me memorize the
content of the text. Total 16 36 11 1 0 4.05 .70
High 4(13) 20(63) 6(19) 2(6) 0(0) 3.69 .78 Low 4(13) 18(56) 8(25) 2(6) 0(0) 3.75 .76 7. I like my teacher to use
semantic mapping strategy in the reading class.
Total 8 38 14 4 0 3.72 .77
High 2(6) 21(66) 9(28) 0(0) 0(0) 3.78 .55 Low 2(6) 17(53) 10(31) 3(9) 0(0) 3.56 .76 8. In Practice Phase, creating
the map by myself after reading the text facilitates me
to comprehend the text. Total 4 38 19 3 0 3.67 .67
High 4(13) 20(63) 7(22) 1(3) 0(0) 3.84 .68 Low 5(16) 13(41) 11(34) 2(6) 1(3) 3.59 .95 9. In Practice Phase, creating
the map by myself after reading helps me answer the
multiple-choice questions Total 9 33 18 3 1 3.72 .83 High 5(16) 21(66) 5(16) 1(3) 0(0) 3.94 .67 Low 4(13) 17(53) 8(25) 3(9) 0(0) 3.69 .82 10. In Practice Phase, creating
the map by myself after reading helps me recall the content of the text
Total 9 38 13 4 0 3.81 .75
a 5 = strongly agree, 4 = agree, 3 = no idea, 2 = disagree, 1 = strongly disagree
b The number in parenthesis is the percentage and has been rounded to the nearest whole number
c The numbers in bold indicated a significant difference existed, p = .32 < .05.