This research attempts to assist teachers or students to know students’ logical thinking about this inquiry topic. Therefore, this diagnosis scheme focused on operation processes assessments, and it cannot be used to assess proficient degree of experiment objects.
Experiment Results shows the scientific inquiry diagnosis system which can really help students and teachers in scientific inquiry learning. The diagnosis report provides useful information such as error operations and decisions, learning difficulties, learning suggestions. Moreover, this diagnosis result also includes adaptive experiments to assist students in inquiry learning by dynamic adjusting experiments’ contents from CIMAS. Besides, behavior pattern mining can discover some new or high level inquiry behaviors.
In the future, this study will focus on doing another behavior mining researches to discover various and possible experimental behaviors. Learning suggestions will also be concerned in this study, such as how to automatic offer appropriate curriculums and construct adaptive experiments.
48
Reference
[1] C.C. Tsai, Laboratory Exercises Help Me Memorize the Scientific Truths”: A Study of Eighth Graders’ Scientific Epistemological Views and Learning in Laboratory Activities, Science Education, 83, 1999
[2] C.F. Li, Design and Implement of a Computerized Interactive Multiple Assessment System, Master’s thesis, National Chiao Tung University, 2010 [3] C.H. Lee , G.G. Lee, Y. Leu, Application of automatically constructed concept
map of learning to conceptual diagnosis of e-learning,Expert Systems with Applications 36, 2009
[4] C.Y. Su, T.I. Wang, Construction and analysis of educational assessments using knowledge maps with weight appraisal of concepts, Computer & Eudcation 55, 2010
[5] D. J. Ketelhut, C. Dede, J. Clarke, A Multi-user Virtual Environment for Building Higher Order Inquiry Skills in Science, British journal of Educational Technology, 2010
[6] D. Yaron, M. Karabinos, K. Evans, J. Cuadros, J. Davenport, G. Leinhardt, J. G.
Greeno, The ChemCollective Digital Library, in ConfChem, 2008
[7] E. Kosba, V. Dimitroca, R. Boyle, Adaptive feedback to support teachers in web-based distance education, User Model User-Adap Inter, 2007.
[8] J.R. Anderson and B. J. Reiser, The Lisp Tutor (10), 1985
[9] J.R. Anderson, A.T. Corbett, K. R. Koedinger, and R. Pelletier, Cognitive tutors:
lessons learned, Journal of the Learning Sciences 4(2), 1995
[10] J.S. Heh, S.C. Li, A. Chang, M. Chang, T.C. Liu, Diagnosis Mechanism and Feedback System to Accomplish the Full-Loop Learning Architecture.
Educational Technology & Society 11 (1), 2008
[11] M. X. Fan, Measuring Student’s Science Process Skill in VEE with Graph Edit Distance, Master’s thesis, Chung Yuan Christian University, 2010
[12] N. T. Heffernan and K. R. Koedinger, Building a 3rd Generation ITS for Symbolization: Adding a Tutorial Model with Multiple Tutorial Strategies, Computer Science Department, Carnegie Mellon University, PA, 2001
[13] National Committee on Science Education Standards and Assessment, National Science Education Standards, Washington, DC: National Academy Press, 1996 [14] National Science Teacher Association, Scientific Inquiry, DC: National Science
Teacher Association, 2004
[15] S. Bull , J. Kay,Metacognition and Open Learner Models,In: The 3rd Workshop on Meta-Cognition and Self-Regulated Learning in Educational
49 Technologies ,2007
[16] S. Bull, Supporting Learning with Open Learner Models, 4th Hellenic Conference with International Participation: Information and Communication Technologies in Education, Athens, 2004
[17] S.B. Blessing, A programming by demonstration authoring tool for
model-tracing tutors, International Journal of Artificial Intelligence in Education 8, 1997
[18] V. Dimitrova, R. Mizoguchi, B. du Boulay, A. Graesser, Learner Trust in Learner Model Externalisations, Artificial Intelligence in Education, IOS Press,
Amsterdam, 2009
[19] V. N. Lunetta, The school science laboratory: historical perspectives and contemporary teaching, International handbook of science education, 1998 [20] Y.L. Chi, Ontology-based curriculum content sequencing system with semantic
rules, Expert Systems with Applications 36 ,2009
[21] Z.C. Zacharia, G. Olympiou, Physical versus virtual manipulative experimentation in physics learning, Learning and Instruction,2010
[22] 吳坤璋, 科學探究能力與科學創造力理論模式之研究, 博士論文 , 2006 [23] 桂怡芬,吳毓瑩,自然科實作評量的效度探討, 中國測驗學會測驗年刊, 1998 [24] 魯俊賢, 吳毓瑩,過程技能之二階段實作評量:規劃、實踐與效益探究,科學教
育學刊, 2007
50
Appendix
Assessment Knowledge Acquisition Algorithm
(目標說明)針對蒸散速率實驗。請老師建立相關知識與實驗評量標準，分三部份。
Part 1 : 知識建立
此部份請依循步驟建立與蒸散速率實驗相關的概念圖與技能圖 Step 1 : 關於蒸散速率實驗是否新建立相關的學科概念圖?
IF(YES) Step 2 else Step 4 Step 2 : 新增概念圖
Step 2.1 : 請先列出本次實驗所涵蓋的所有概念？(可多次增加)
概念名稱: 輸入文字 新增
Step 2.2 : 請列出 Step 3.1 概念中的先備概念？
概念名稱:
輸入文字
上層概念名稱: 輸入文字 新增
Step 2.3 : 請列出列表中概念中的上層概念？
概念名稱:
輸入文字
上層概念名稱: 輸入文字 新增
Step 2.4 :預覽與調整概念圖
概念資料
概念名稱: Concept1-2-1 [請選擇]
父概念:Concept1-2 [請選擇]
先備概念: Concept2-2 [請選擇]
IF(step 2 FINISH) Step 4
Step 3:請選擇蒸散速率實驗相關的學科概念圖?(可複選)
Step 3.1 概念圖名稱:
輸入文字
Step 3.2 是否要重新調整概念間關係？
IF(YES) Step 2.4 ELSE Step 4
51
Step 4 : 關於蒸散速率實驗是否新建立相關的過程技能圖?
IF(YES) Step 5 else Step 6 Step 5 : 新增概念圖
Step 5.1 : 請先列出本次實驗所涵蓋的所有過程技能？(可多次增加)
概念名稱: 輸入文字 新增
Step 5.2 : 請列出 Step 5.1 過程技能中的先備過程技能？
過程技能名稱:
輸入文字
上層過程技能名稱: 輸入文字 新增
Step 5.3 : 請列出列表中過程技能中的上層過程技能？
過程技能名稱:
輸入文字
上層過程技能名稱: 輸入文字 新增
Step 5.4 :預覽與調整過程技能圖
過程技能資料
過程技能名稱: Skill1-2-1 [請選擇]
父過程技能: Skill1-2 [請選擇]
先備過程技能: Skill2-2 [請選擇]
IF(step 5 FINISH) Part2
Step 6 :請選擇蒸散速率實驗相關的過程技能圖?(可複選)
Step 7.1 過程技能圖名稱:
輸入文字
Step 7.2 是否要重新調整過程技能間關係？
IF(YES) Step 5.4 ELSE Part2
52
IF(Environment Variable Count==0) (Column 3) Disable 是否有時間上的限制？ IF(NO) (Column 2) Disable
53 Step3 :
有哪些單一實驗動作，表達哪些概念或是過程技能知識，表達程度又是多少？
請選擇動作 [從 CIMAS 實驗動作倒入]
等待 摘葉 浸水 切根 倒紅墨水 插入植物 請選擇此動作相關的概念與技能
概念圖 技能圖
動作 學科概念 概念程度 過程技能 技能程度
等待 Concept1-2 0.8 Skill1-2 0.7
Step4 :順序性動作(存在操作先後順序，若無依序操作，可能會導致實驗誤差。(中
間可穿插其他動作))，是可以表達哪些概念或是技能知識，表達程度又是多少？
請依序選擇動作 [從 CIMAS 實驗動作倒入]
等待 摘葉 浸水 切根 倒紅墨水 插入植物 請選擇此動作相關的概念與技能
概念圖 技能圖
動作 學科概念 概念程度 過程技能 技能程度
1. 芹菜浸水 2. 切根
3. 插入紅墨水 4. 等待
C1 1 P2 1
C3 1 P4 1
54
Step5 :有哪些評量連續性動作(實驗的操作動作必頇是接連操作，才能達到設定
效果，才算完成操作)
，是可以表達哪些概念或是技能知識，表達程度又是多少？請依序選擇動作 [從 CIMAS 實驗動作倒入]
等待 摘葉 浸水 切根 倒紅墨水 插入植物 請選擇此動作相關的概念與技能
概念圖 技能圖
動作 學科概念 概念程度 過程技能 技能程度
Step6 :物件連續性動作(針對同一物件所操作兩動作間，必須是連續的。但可以
對其他物件進行操作。)，表達哪些概念或是技能知識，表達程度又是多少？
請選擇動作 [從 CIMAS 實驗動作倒入]
芹菜 燒杯 水盆 紅墨水 美工刀
請依序選擇動作 [從 CIMAS 實驗動作倒入]
摘葉 浸水 切根 插入植物 請選擇此動作相關的概念與技能
概念圖 技能圖
實驗器材 動作 學科概念 概念程度 過程技能 技能程度
芹菜 1. 芹菜浸水
2. 切根
C2 1 P1 1
C4 1 P1 1
55
Step7 : 除了以上實驗動作規則以外，還有哪些操作動作的評量規則，請在以下 作描述並舉例?
規則 : 輸入文字
例子(請以本實驗可以操作的動作表示) : 輸入文字
Part 2.2 : 實驗規劃評量規則建立
請選擇此動作相關的概念與技能
技能圖 概念圖
規劃訊息 技能 程度 概念 程度 訊息屬性 屬性值
假設_若 假設_若 1 若_物件 芹菜
若_物件屬性 葉數;莖切面積
若_比較值 增加;減少
假設_則 假設_則 1 則_物件 紅墨水燒杯
則_物件屬性 紅墨水量
則_比較值 增加;減少
56
---57
實驗特殊性的問題 : 運用 “且”(AND)，“或”(OR)，“數量”(Number)或不使 用，建立蒸散速率實驗整體評量規則
1. 規則一 : X 且 或
2. 規則二 : 數量 (若無選擇初始值=1)
3. 規則三 : 考量整體操作動作類型個數
4. 選擇實驗動作(選項從問題 Part2 的答案來):
輸入文字
(“且” “或”請選擇兩個以上) 5.
請選擇實驗動作相關的概念與技能
概念圖 技能圖
58
59 Students’ portfolios from CIMAS
Action List
1 2,2,6,6,6,6,6,10,12,23,19,11,20,20,1,9,5,5,5,5,5,13, 11,15,11,14,11 2 6,6,6,6,6,6,10,12,21,21,19,9,20,5,5,5,5,14,11,11,22,23 10 1,9,13,6,6,6,6,6,5,5,5,5,5,14,11,2, 21,10, 12,19,11 11 10,6,6,6,6,6,6,21,8,21,19,11,19,11,11,11,11,23,23,23,23 12 21,21,10,6,6,6,6,6,6,6,19,11,11,22
13 6,6,6,6,6,5,5,5,5,5,10,21,23,23,19,11,11,14,11
14 6,6,6,6,6,5,5,5,5,5,10,10,21,21,19,11,11,1,13,27,1,13,9,14,11,22
60 15 21,21,10,6,6,6,6,6,10,10,19,11,19,11,11 16 10,6,6,6,6,6,21,2,12,17,21,9,18,17,11,11,23 17 10,2,12,21,6,6,6,6,6,22, 9,9,21,21,16, 19,11 18 21,21,6,6,6,6,6,5,5,5,5,5, 14,11,11,22,22,22,22 19 6,6,6,6,6,10,21,14,19,11,11,22
20 2,12,21,2,10,12,1,9,13,6,6,6,6,6,5,5,5,5,5,14,19,11,23,14,22 21 21,1,9,21,2,10,5,5,5,6,6,6,6,14,19,11
22 6,6,6,5,5,5,7,7,10,21,1,9,14,14,19,11,2,10,6,6,6,6,6,21,17,12,19,11,22,23 23 6,6,6,6,6,6,6,10,21,19,11,11,11,6,6,6,6,6,10,17,21,20,9,18,11,11
24 10,10,19,21,21,6,6,6,6,6,6,6,6,6,6,8,6,14,19,11,11,22,31,1 25 2,12,6,6,6,6,6,10,10,10,14,19,11,11,22,2,12,13,2,2,12 26 10,10,21,6,6,6,6,6,21,19,11,11,21,21,10,10,6,6,6,6,6,19,11 27 21,10,10,6,6,6,6,6,5,5,5,5,19,11,22
28 6,6,6,6,6,6,8,1010,14,19,11,22 29 10,21,6,6,6,6,6,21,19,11,11,11,22 30 21,10,10,6,6,6,6,6,19,11,22