CHAPTER 4: RESULT
4.5 Trend of Learning Outcomes in KB Studies
國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
55
Scardamalia & Bereiter, 2010). Another finding indicated that Canada was the country that employed KBPs the most, followed by Hong Kong, Singapore, and Taiwan. Idea-related KBPs were discovered to be the most likely to be employed in KB studies.
4.5 Trend of Learning Outcomes in KB Studies
Figure 4-19 shows that 42% of learning outcomes in KB studies were social learning outcomes (n = 47), followed by 37% of cognitive learning outcomes (n = 42) and 21% of metacognitive learning outcomes (n = 24).
Figure 4-19 Categories of Learning Outcomes in KB Studies
To explore the above findings, this study analyzed the trend of learning outcomes categories in KB studies over three time periods. Figure 4-20 showed an upward trend for all three categories of learning outcomes over three time periods. However, the number of KB studies that examined social learning outcomes (n = 45) was higher than those using
cognitive learning outcomes (n = 41) and metacognitive learning outcomes (n = 23) between 2006 and 2016.
‧
國立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
Figure 4-20 Trend of KB Studies Among Three Categories of Learning Outcomes Over Three Time Periods
To further explore findings above, Figure 4-21 showed that 65% of basic learning outcomes (n = 73) were examined in KB studies and 35% of higher-order learning outcomes (n = 40) were examined in KB studies.
Figure 4-21 Basic Learning Outcomes and Higher-Order Learning Outcomes in KB Studies
Table 4-8 illustrates the basic learning outcomes and higher-order learning outcomes findings in detail. Basic cognitive learning outcome (n = 25) was higher than higher-order cognitive learning outcome (n = 17). Basic metacognitive learning outcome (n = 18) was
‧
higher than higher-order metacognitive learning outcome (n = 6). Basic social learning outcome (n = 30) was higher than higher-order social learning outcome (n = 17).
Table 4-8
Percentage of Learning Outcomes in KB Studies and Distribution Frequencies in Three Time Periods
To explore the above findings, this study analyzed the trend of learning outcomes subcategories in KB studies over three time periods. Figure 4-22 showed that with the exception of higher-order cognitive learning outcome and higher-order metacognitive learning outcomes, all other subcategories of learning outcomes showed an upward trend in KB studies over the three time periods. Basic cognitive learning outcome showed a transition from 10 to 15 in number of KB studies after the year 2011. Basic metacognitive learning outcome showed an increase from three to 15 in number of KB studies after the year 2011.
Basic social learning outcome showed a transition from 12 to 16 in number of KB studies after 2011. Higher-order social learning outcome showed a transition from six to 11 in number of KB studies after the year of 2011. In addition, higher-order cognitive learning outcome was sustained between 2006 and 2016.
‧
國立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
Figure 4-22 Trend of KB Studies Among Subcategories of Learning Outcomes Over Three Time Periods
Overall, social learning outcomes were examined the most in the KB studies over the past 16 years. Among the subcategories of learning outcomes, all basic learning outcomes were higher than higher-order learning outcomes. Furthermore, basic social learning outcomes were examined the most in the KB studies. The rationale of these learning outcomes findings will be discussed in the following chapter.
‧
In this study we aimed to identify the current trend of KB studies, methodologies, online learning platforms, KBPs usage, and learners’ learning outcomes. The analysis of this study traced the patterns of KB studies between 2001 and 2016. This section highlights the five conclusions drawn from the study that correspond to the findings revealed in previous chapter and provides recommendations for future KB studies.
5.1 Conclusion
5.1.1 Trend of KB Studies in Both Eastern and Western Countries
Findings revealed that KB studies conducted in Eastern countries were slightly higher than Western countries. However, this study had found that Canada was the top country for conducting KB studies over the past 16 years. The pioneers of KB studies began doing research in Canada. Thus, this study included many KB studies conducted in Canada.
In terms of educational levels, most of the KB studies engaged Grade 1-6 participants.
Findings showed the differences between Eastern countries and Western countries regarding educational levels of participants in KB studies. Eastern countries focused on Grade 10-12 and undergraduate participants in KB studies; however, Western countries emphasized Grade 1-6 participants in KB studies.
Despite over one-half of the KB studies being conducted among learners, one finding revealed that part of the KB studies had shifted from learners to teachers, especially in Eastern countries. This finding indicates that KB researchers have started to figure out the importance of KB studies among teachers, rather than merely concentrating on learners in KB studies.
Regarding the subject domains in KB studies, the findings show that overall, the KB studies were mainly related to Science. KB studies conducted in Eastern countries were also
‧
國立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
focused on Technology; however, Western countries had more emphasis on History and Science in KB studies. This finding implies the feasibility for promoting KB pedagogy for the subject domains stated above.
To summarize, KB studies conducted in Eastern countries engaged Grade 10-12 and undergraduate participants in Technology. In contrast, KB studies conducted in Western countries engaged Grade 1-6 participants primarily on History and Science.
5.1.2 Trend of Methodology in KB Studies
The findings show that case study was the most popular research design employed in KB studies over the past 16 years. Although KB researchers have adopted other research designs in addition to case study, the findings have verified the effectiveness of adopting case study for KB studies.
In terms of analysis methods, mixed methods analysis was the most popular method for analyzing data. Although most of the KB activities can be interpreted through qualitative analysis, qualitative approaches cannot fulfill the demands of interpreting data. Many KB studies are using quantitative results with qualitative findings to address research questions, for instance study ID16. Denzin (as cited in Jick, 1979) explained that the process of using multiple methods to examine the degree of external validity is called between-method triangulation. Thus, the mixed methods analysis employed in KB studies has a
between-method triangulation purpose.
Overall, case study with mixed methods analysis is the current trend of methodology in KB studies. All qualitative and quantitative methods support each other for triangulation purposes.
‧
國立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
61
5.1.3 Trend of Online Learning Platforms in KB Studies
The findings revealed that over one-half of the online learning platforms employed in KB studies were KF. The main reason is that KF was evolved from CSILE to support
collective work value to a community (Scardamalia & Bereiter, 2010). Moreover, all the KB tools embedded in KF are based on KBPs. There are abundant research findings that prove the effectiveness of using KF for idea-related pedagogy. Thus, KF is the best choice for novice teachers in KB practice.
5.1.4 Trend of KBPs Employed in KB Studies
The findings revealed the most KBP employed in KB studies was community
knowledge, collective responsibility. Among the countries, Canada employed this KBP the most in KB studies. The main reason is that KB stresses community knowledge, collective responsibility during the interaction with KB activities.
In terms of KBP categories, idea-related KBPs were employed the most in KB studies over the past 16 years. The main reason is that idea-related KBPs are part of principle-based KB that are characteristic for promoting KB practice. The findings suggest that it is important for idea-related KBPs to be employed in KB studies.
5.1.5 Trend of Learning Outcomes Examined in KB Studies
The findings revealed that most of the learning outcomes examined in KB studies were social learning outcomes. This finding indicates the importance of interaction and
collaborative work on KB activities. Learners can share their ideas by posting notes on KF and the other members can reply to particular notes. Furthermore, they may synthesize diverse ideas by linking notes contributed by the members.
Among the subcategories of learning outcomes, all the basic learning outcomes in the
‧
國立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
number of KB studies were higher than for higher-order learning outcomes. The main reason for this is that basic learning outcomes can be easily examined as compared to higher-order learning outcomes. In other words, novice KB learners and teachers can easily achieve basic learning outcomes through interaction KB activities on KF. However, higher-order learning outcomes can be achieved when novice KB learners and teachers are familiar with three core KB characteristics and 12 KBPs.
5.2 Recommendations
5.2.1 Promoting Interdisciplinary KB Research
Although most of the KB studies are conducted in a particular subject domain, this study has discovered a least number of KB studies with interdisciplinary links. To coordinate with interdisciplinary pedagogy, future KB research can involve interdisciplinary by comparing the differences between single subjects and interdisciplinary subjects.
5.2.2 Promoting Experimental Design in KB Research
Although the findings have revealed that some of the selected KB studies employed experimental designs, the results of particular KB studies cannot be generalized to the worldwide population. To conduct meta-analysis in future KB research, the number of experimental design in KB research should increase. Thus, it is important to cultivate KB researchers in teacher communities in order to conduct KB research with experimental designs.
5.2.3 Promoting Different Learning Platforms in KB Research
Findings revealed in this study focus on online learning platforms employed in KB studies. However, the offline learning environment also plays an important role in promoting
‧
國立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
63
KB practice. Through analyzing both different learning platforms, future KB research will be able to synthesize the effectiveness of KB tools in different learning platforms.
5.2.4 Promoting Practice-Related KBPs in KB Research
Based on the findings revealed in this study, idea-related KBPs have been examined the most in KB studies. However, practice-related KBPs should not be neglected. This study recommends that future KB research put effort into examining practice-related KBPs.
5.2.5 Promoting Higher-Order Learning Outcomes in KB Research
The findings revealed that social learning outcomes have been examined the most in KB studies. Among the three categories of learning outcomes, the number of basic learning outcomes was higher than for the higher-order learning outcomes. Hence, future KB research could analyze the possible methods to assist novice learners and teachers in achieving
higher-order learning outcomes during KB practice.
‧
國立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
‧
Andale (2017).Cohen’s Kappa Statistic. Retrieved fromhttp://www.statisticshowto.com/cohens-kappa-statistic/
Bereiter, C. (1994). Constructivism, socioculturalism and Popper’s World 3. Educational Researcher, 23(7), 21-23.
Boland, A., Cherry, M. G., & Dickson, R. (Eds.) (2014). Doing a systematic review: A student’s guide. London: SAGE.
Campbell, J. L., Quincy, C., Osserman, J., & Pedersen, O. K. (2013). Coding in-depth semistructured interviews: Problems of unitization and intercoder reliability and agreement. Sociological Methods & Research, 42(3), 294-320. Retrieved from
https://sociology.dartmouth.edu/sites/sociology.dartmouth.edu/files/coding_in_depth_se mi.pdf
Cacciamani, S., Cesareni, D., Martini, F., Ferrini, T., & Fujita, N. (2012). Influence of participation, facilitator styles, and metacognitive reflection on knowledge building in online university courses. Computers and Education, 58(3), 874-884.
doi:10.1016/j.compedu.2011.10.019
Cesareni, D., Cacciamani, S., & Fujita, N. (2016). Role taking and KB in a blended university course. International Journal of Computer-Supported Collaborative Learning, 11(1), 9-39. doi:10.1007/s11412-015-9224-0
Cesareni, D., Martini, F., & Mancini, I. (2011). Building a community among teachers, researchers and university students. A blended approach to training. International Journal of Computer-Supported Collaborative Learning, 6(4), 625-646.
doi:10.1007/s11412-011-9126-8
Chai, C. S., & Tan, S. C. (2011). Two exploratory studies of the relationships between teachers' epistemic beliefs and their online interactions. International Journal of
‧
Continuing Engineering Education and Life-Long Learning, 21(1), 13-24.
doi:10.1504/IJCEELL.2011.039691
Chai, C. S., & Tan, S. C. (2009). Professional development of teachers for
computer-supported collaborative learning: a knowledge-building approach. Teachers College Record, 111(5), 1296-1327.
Chai, C. S., & Khine, M. S. (2006). An analysis of interaction and participation patterns in online community. Educational Technology and Society, 9(1), 250-261.
Chan, C. K. K., & Chan, Y. Y. (2011). Students' views of collaboration and online participation in Knowledge Forum. Computers & Education, 57(1), 1445-1457.
doi:http://dx.doi.org/10.1016/j.compedu.2010.09.003
Chen, B., & Hong, H. Y. (2016). Schools as knowledge-building organizations: Thirty years of design research. Educational Psychologist, 51(2), 266-288.
doi:10.1080/00461520.2016.1175306
Chen, B., Scardamalia, M., & Bereiter, C. (2015). Advancing knowledge‐ building discourse through judgments of promising ideas. International Journal of Computer-Supported Collaborative Learning, 10(4), 345-366. doi:10.1007/s11412-015-9225-z
Chen, W., & Looi, C. K. (2011). Active classroom participation in a group scribbles primary science classroom. British Journal of Educational Technology, 42(4), 676-686.
doi:10.1111/j.1467-8535.2010.01082.x
Coll, C., Rochera, M. J., & De Gispert, I. (2014). Supporting online collaborative learning in small groups: Teacher feedback on learning content, academic task and social
participation. Computers and Education, 75, 53-64. doi:10.1016/j.compedu.2014.01.015 Egger, M., Dickersin, K., & Smith, G. D. (2008). Problems and limitations in conducting
systematic reviews. Retrieved from https://www.researchgate.net/publication/227989644 Erkunt, H. (2010). Emergence of epistemic agency in college level educational technology
‧
course for pre-service teachers engaged in CSCL. Turkish Online Journal of Educational Technology, 9(3), 38-51.
Gilbert, N. J., & Driscoll, M. P. (2002). Collaborative knowledge building: A case study.
Educational Technology Research and Development, 50(1), 59-79.
Goh, A., Chai, C. S., & Tsai, C. C. (2013). Facilitating students' development of their views on nature of science: A knowledge building approach. Asia-Pacific Education
Researcher, 22(4), 521-530. doi:10.1007/s40299-012-0050-0
Green, S. (2005). Systematic review and meta-analysis. Singapore Medical Journal, 46(6), 270-274.
Hatano, G., & Inagaki, K. (1986). Two courses of expertise. Retrieved from
http://eprints2008.lib.hokudai.ac.jp/dspace/bitstream/2115/25206/1/6_P27-36.pdf Hong, H. Y., Chen, B., & Chai, C. S. (2016). Exploring the development of college students'
epistemic views during their knowledge building activities. Computers and Education, 98, 1-13. doi:10.1016/j.compedu.2016.03.005
Hong, H. Y., & Chiu, C. H. (2016). Understanding how students perceive the role of ideas for their knowledge work in a knowledge-building environment. Australasian Journal of Educational Technology, 32(1), 32-46.
Hong, H. Y., Scardamalia, M., Messina, R., & Teo, C. L. (2015). Fostering sustained idea improvement with principle-based knowledge building analytic tools. Computers and Education, 89, 91-102. doi:10.1016/j.compedu.2015.08.012
Hong, H. Y., Chai, C. S., & Tsai, C. C. (2015). College students constructing collective knowledge of natural science history in a collaborative knowledge building community.
Journal of Science Education and Technology, 24(5), 549-561.
doi:10.1007/s10956-015-9546-8
Hong, H. Y., Chang, Y. H., & Chai, C. S. (2014). Fostering a collaborative and creative
‧
climate in a college class through idea-centered knowledge-building. Instructional Science, 42(3), 389-407. doi:10.1007/s11251-013-9289-y
Hong, H. Y., & Scardamalia, M. (2014). Community knowledge assessment in a knowledge building environment. Computers and Education, 71, 279-288.
doi:10.1016/j.compedu.2013.09.009
Hong, H. Y. (2014). Exploring college students' perceptions of learning and online
performance in a knowledge building environment. Asia-Pacific Education Researcher, 23(3), 511-522. doi:10.1007/s40299-013-0125-6
Hong, H. Y., Chen, F. C., Chai, C. S., & Chan, W. C. (2011). Teacher-education students' views about knowledge building theory and practice. Instructional Science, 39(4), 467-482. doi:10.1007/s11251-010-9143-4
Hong, H. Y., & Lin, S. P. (2010). Teacher-education students' epistemological belief change through collaborative knowledge building. Asia-Pacific Education Researcher, 19(1), 99-110.
Hong, H. Y., Scardamalia, M., Messina, R., & Teo, C. (2008). Principle-based design to foster adaptive use of technology for building community knowledge. Paper presented at
the Proceedings of the 8th international conference on International conference for the learning sciences - Volume 1, Utrecht, The Netherlands. Retrieved from
http://gerrystahl.net/proceedings/icls2008/papers/paper278.pdf
International Labour Organization (n.d.). Regions and countries. Retrieved July 14, 2017, from http://www.ilo.org/global/regions/lang--en/index.htm
International Standard Classification of Education (2011). ISCED coding schema. Retrieved April 12, 2017, from
http://www.uis.unesco.org/Education/Documents/isced-2011-en.pdf Internet World Stats (n.d.). World regions. Retrieved July 14, 2017, from
‧
Jick, T. D. (1979). Mixing qualitative and quantitative methods: Triangulation in action.
Administrative Science Quarterly, 24(4), 602-611. Retrieved May 16, 2017, from
http://www.pm.lth.se/fileadmin/_migrated/content_uploads/Jick_1979__Mixing_qualitat ive_and_quantitative_methods_-_Triangulation_in_action.pdf
Kitchenham, B. (2004). Procedures for performing systematic reviews. Retrieved July 10, 2017, from
http://www.ifs.tuwien.ac.at/~weippl/systemicReviewsSoftwareEngineering.pdf
Lai, M., & Law, N. (2013). Questioning and the quality of knowledge constructed in a CSCL context: A study on two grade-levels of students. Instructional Science, 41(3), 597-620.
doi:10.1007/s11251-012-9246-1
Lai, M., & Law, N. (2006). Peer scaffolding of knowledge building through collaborative groups with differential learning experiences. Journal of Educational Computing Research, 35(2), 123-144. doi:10.2190/GW42-575W-Q301-1765
Lin, C. Y., & Reigeluth, C. M. (2016). Scaffolding wiki-supported collaborative learning for small-group projects and whole-class collaborative KB. Journal of Computer Assisted Learning, 32(6), 529-547. doi:10.1111/jcal.12140
Lipsey, M. W. & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: SAGE.
Lossman, H., & So, H. J. (2010). Toward pervasive knowledge building discourse: Analyzing online and offline discourses of primary science learning in Singapore. Asia Pacific Education Review, 11(2), 121-129. doi:10.1007/s12564-009-9063-7
Majumder, K. (2015, April 29). A young researcher’s guide to a systematic review. Retrieved from
http://www.editage.com/insights/a-young-researchers-guide-to-a-systematic-review Markauskaite, L., & Sutherland, L. M. (2008). Exploring individual and collaborative
‧
dimensions of knowledge building in an online learning community of practice.
Informatics in Education, 7(1), 105-126.
Mirabella, D. (2016, November 30). Quora: Are Turkey and Iran considered Western countries or Eastern? Retrieved from
https://www.quora.com/Are-Turkey-and-Iran-considered-Western-countries-or-Eastern Moss, J., & Beatty, R. (2006). Knowledge building in mathematics: Supporting collaborative
learning in pattern problems. International Journal of Computer-Supported Collaborative Learning, 1(4), 441-465. doi:10.1007/s11412-006-9003-z
Nason, R., Chalmers, C., & Yeh, A. (2012). Facilitating growth in prospective teachers' knowledge: Teaching geometry in primary schools. Journal of Mathematics Teacher Education, 15(3), 227-249. doi:10.1007/s10857-012-9209-0
National Research Council. (2012). Education for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century. Committee on Defining Deeper Learning and
21st Century Skills, J. W. Pellegrino and M. L. Hilton, Editors. Board on Testing and Assessment and Board on Science Education, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press. Retrieved May 10, 2017, from
http://www.hewlett.org/wp-content/uploads/2016/08/Education_for_Life_and_Work.pdf Ng, E., & Bereiter, C. (1991).Three levels of goal orientation in learning. The Journal of the
Learning Science, 1(3&4), 243-271.
One World Nations Online (n.d.). Countries and regions of the world. Retrieved July 14, 2017, from http://www.nationsonline.org/oneworld/countries_of_the_world.htm Oshima, J., & Oshima, R. (2007) CSCL-based pre-service teacher program as knowledge
building. IFIP International Federation for Information Processing, 230, 187-194.
Oshima, J., Oshima, R., Murayama, I., Inagaki, S., Takenaka, M., Yamamoto, T.,
‧
Yamaguchi, E., & Nakayama, H. (2006). Knowledge-building activity structures in Japanese elementary science pedagogy. International Journal of Computer-Supported Collaborative Learning, 1(2), 229-246. doi:10.1007/s11412-006-8995-8
Pelletier, J., Reeve, R., & Halewood, C. (2006). Young children's knowledge building and literacy development through Knowledge Forum. Early Education and Development, 17(3), 323-346. doi:10.1207/s15566935eed1703_2
Popper, K. R. (1978). Three worlds: The tanner lectures on human values. Retrieved from http://tannerlectures.utah.edu/_documents/a-to-z/p/popper80.pdf
Resendes, M., Scardamalia, M., Bereiter, C., Chen, B., & Halewood, C. (2015). Group-level formative feedback and metadiscourse. International Journal of Computer-Supported Collaborative Learning, 10(3), 309-336. doi:10.1007/s11412-015-9219-x
Scardamalia, M. & Bereiter, C. (2010). A brief history of knowledge building. Canadian Journal of Learning and Technology, 36(1), 1-16. Retrieved from the ERIC database.
(EJ910456)
Scardamalia, M., & Bereiter, C. (2006). Knowledge building: Theory, pedagogy, and technology. In Sawyer, K. (Ed.), Cambridge Handbook of the Learning Sciences (pp.97-118). New York, NY: Cambridge University Press. Retrieved from http://ikit.org/fulltext/2006_KBTheory.pdf
Scardamalia, M. (2004). CSILE/Knowledge Forum. In Education and technology: An encyclopedia (pp.183-192). Santa Barbara: ABC-CLIO. Retrieved from
http://www.ikit.org/fulltext/CSILE_KF.pdf
Scardamalia, M. (2002). Collective cognitive responsibility for the advancement of knowledge. In Smith, B. (Ed.), Liberal education in a knowledge society (pp.67-98).
Chicago: Open Court. Retrieved from http://ikit.org/fulltext/inpressCollectiveCog.pdf Scardamalia, M., Bereiter, C., & Steinbach, R. (1984).Teachability of reflective processes in
‧
written composition. Cognitive Science, 8, 173-190. Retrieved from
https://pdfs.semanticscholar.org/a895/bbb467b1df55b0b238bddbff04f125ee1971.pdf Seitamaa-Hakkarainen, P., Viilo, M., & Hakkarainen, K. (2010). Learning by collaborative
designing: Technology-enhanced knowledge practices. International Journal of Technology and Design Education, 20(2), 109-136. doi:10.1007/s10798-008-9066-4
Seitamaa-Hakkarainen, P., Raunio, A. M., Raami, A., Muukkonen, H., & Hakkarainen, K.
(2001). Computer support for collaborative designing. International Journal of Technology and Design Education, 11(2), 181-202. doi:10.1023/A:1011277030755
So, H. J., Seah, L. H., & Toh-Heng, H. L. (2010). Designing collaborative knowledge building environments accessible to all learners: Impacts and design challenges.
Computers and Education, 54(2), 479-490. doi:10.1016/j.compedu.2009.08.031
Sun, Y., Zhang, J., & Scardamalia, M. (2010). Knowledge building and vocabulary growth over two years, Grades 3 and 4. Instructional Science, 38(2), 147-171.
doi:10.1007/s11251-008-9082-5
Teplovs, C., Donoahue, Z., Scardamalia, M., & Philip, D. (2007). Tools for concurrent,
Teplovs, C., Donoahue, Z., Scardamalia, M., & Philip, D. (2007). Tools for concurrent,