• 沒有找到結果。

本研究所建置的系統在曝光率的表現上符合模擬研究的曝光率標準,在 未來的使用上則端賴實際使用情況進行調整,其結論與建議條列如下:

一、 建議

1. 如果在已知施測群體的能力值分佈時,建議使用 SH-b 曝光控管模式,

對整體曝光率的控管會有較佳的表現。

2. 如果要施測的群體能力值分佈未知,則建議使用 ASHC-b 對於曝光率 的控管會較合理。

3. 本系統於初步測試中,三十五人左右的測驗狀況均能獲得穩定運作的 結果,但若要進行百人以上的大型測驗,則建議將系統移植到Unix 系統之作業系統與機架式主機,測驗進行的同時必須監控網路狀況以 確保測驗順利進行。

二、 結論

1. 由本系統的施測結果來看,SH-b 與 ASHC-b 的曝光率統計結果並無明 顯差異,因此,必須做更精確的條件控管,或施測更多的人數才比較 出在何種情況下,何種控管模式才是較佳的選擇。

2. 本系統所採用的是 Java2 物件導向模式的程式設計架構,本研究當中 所研發的類別以及函式庫均可以重複使用,對於未來研究不同曝光率 控管模式時,只要使用新的曝光控管模式演算法替換,就可以在不更 動原有程式架構的情況下,從事新的曝光率研究,這樣的系統架構有 助於未來研究不同曝光率控管模式在實際施測的狀況下的成效與比 較。

參考文獻

一、 中文部份

王寶墉(1995),現代測驗理論,臺北市心理出版社。

朱怡君(2005),a-分層電腦適性測驗之曝光率控制,碩士論文,嘉義縣國立 中正大學心理研究所,未出版。

余民寧(1997a)。試題反應理論的介紹─能力與試題參數的估計。研習資訊,

9(3),6-12。

余民寧(1997b)。試題反應理論的介紹─訊息函數。研習資訊,9(6),5-9。

余民寧(1997c)。試題反應理論的介紹─電腦化適性測驗。研習資訊,10(5),

5-9。

李茂能(2000)。中文電腦化適性測驗系統之應用與評鑑。文景書局。

何政翰(2004),國小數學領域電腦適性化測驗系統之建置,碩士論文,國立 臺中教育大學教育測驗統計研究所,未出版。

周文欽、歐滄和、許擇基、盧欽銘、金樹人、范德鑫(2003),心理與教育測 驗,臺北市心理出版社。

陳俊宏(2004),電腦適性測驗之模擬研究,碩士論文,國立臺中教育大學教 育測驗統計研究所,未出版。

陳昇座(2007),以能力分佈為基礎之 SHC 曝光率控制法,碩士論文,國立臺 中教育大學教育測驗統計研究所,未出版。

陳仁欽(2004),多分題之多向度電腦適性測驗,碩士論文,國立中正大學心理 學研究所。

郭冠廷(2005),電腦適性化測驗雛型系統之研究,碩士論文,中興大學資訊科 學研究所,未出版。

鄧景麟(2005),以三年級數學科能力指標為基礎的電腦適性測驗評量系統,

碩士論文,健康暨管理學院資訊工程學系碩士在職專班,未出版。

錢永財、劉家惠、郭伯臣(2005),初始階段試題 b 值分層選題對曝光率之影 響,第十屆人工智慧研討會論文,未出版。

錢永財(2006),以 a-鄰近法為選題策略之電腦化適性測驗模擬研究,碩士論 文,國立臺中教育大學教育測驗統計研究所,未出版。

二、 英文部份

Baker, F. B., & Kim, S.-H.(2004). Item Response Theory : Parameter Estimation Techniques. Basel, N. Y. : Marcel Dekker, Inc.

Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick, Statistical theories of mental test scores (chapters 17-20). Reading, MA: Addison-Wesley.

Chang, H. H. & Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20, 3, 231-229.

Chang, H.-H., & Ying, Z. (1999). α-Stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23, 211-222.

Chang, S.-W., & Ansley, T. N. (2003). A comparative study of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement, 40, 71-103.

Chang, S.-W., Ansley, T. N., & Lin, S. H. (2000). Performance of item exposure control methods in computerized adaptive testing: Further explorations.

Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA.

Chang, S.-W., Ansley, T. N., & Twu, B.-Y. (2002). Performance of item exposure control methods in computerized adaptive testing: Further Explorations.

Psychological Testing, 49(2), 235-263.

Chang, S. W., & Twu, B.-Y. (2001). Effects of changes in the Examinees’ ability distribution on the exposure control method in CAT. Paper presented at the

Annual Meeting of the American Educational Research Association, Seattle, WA.

Davey, T., & Parshall, C. G.(1995,April). New algorithms for item selection and exposure control with computerized adaptive testing. Paper presented at the annual meeting of American Educational Research Association, San Francisco.

Embretson, S. E., & Reise, S. P. (2000). Item Response Theory for Psychologists.

Mahwah, N. J. : Lawrence Erlbaum.

Hambleton R. K., & Swaminathan H., & Rogers H. J.(1991) Fundamentals of Item Response Theory : SAGE.

Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff Publishing.

Hambleton, R. K., Zaal, J. N., & Pieters, J. P. M. (1991). Computerized adaptive testing: Theory, applications, and standards.

In R. K. Hambleton & J. N. Zaal (Eds.), Advances in educational and psychological testing: Theory and applications. Boston: Kluwer Academic Publishers.

In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing:

Theory and practice (pp. 163-182). London: Kluwer Academic Publishers.

Harrison, D. A. (1986). Robustness of IRT parameter estimation to violations of the unidimensionality assumption. Journal of Educational Statistics, 11, 91-115.

Hattie, J. (1981). Decision criteria for determining unidimensionality.

Unpublished doctoral dissertation, University of Toronto, Canada.

Hetter, R. D., & Sympson, J. B. (1997). Item exposure control in CAT-ASVAB. In W. A.

Leung, C. K ., Chang , H. H., & Hau, K. T. (2000). Content Balancing in Stratified Comuterized Adaptive Testing Designs. Paper for presented at the AERA Annual Meeting 2000,New Orleans.

Leung, C. K ., Chang , H. H., & Hau, K. T. (2002). Comparing Three Itme Selection Approaches for Computerized Adaptive Testing with Content Balancing Requirement. The Journal of Technology, Learning, and Assessment, volumn 2,Number, ,December 2003.

Lord, F. M. (1977). Practical applications of item characteristic curve theory.

Jaurnal of Educational Measurement, 14, 117-138.

Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Eribaum Associates.

Stocking, M. L. (1994). Three practical issues for modern adaptive testing item pools (ETS Research Report 94-5). Princeton, NJ: Educational Testing Service.

Stocking, M. L., & Lewis, C. (1995). A new method for controlling item exposure in computerized adaptive testing (ETS Research Report RR-95-25).

Princeton, NJ:Educational Testing Service.

Stocking, M. L., & Lewis, C. (1998). Controlling item exposure conditional on ability in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 23,57-75.

Stocking, M. L., & Lewis, C. (2000). Methods of controlling the exposure of items in CAT.

Stocking, M. L., & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17 (3), 277-292.

Su, Ya-Hui (2007). Simultaneous Control over Item Exposure and Test Overlap in Computerized Adaptive Testing for Testlet-based Items and Multidimensional Items, Department of Psychology, National Chung Cheng University.

Wainer, H. (2000). Computerized Adaptive Testing: A Primer. (2nd Ed.) New Jersey: Lawrence Erlbaum Associates, Inc.

Weiss, D. J. (1974). Strategies of adaptive ability measurement (Research Report 74-5). University of Minnesota, Department of Psychology, Psychometric

Methods Program.

Weiss, D. J. (Ed.). (1983). New horizons in testing. New York: Academic Press.

附 錄

附錄 A 試題三參數

試題編號 鑑別度參數(a) 難度參數(b) 猜測度參數(c)

MATH001 0.6598 -2.6037 0.2249 MATH002 1.2989 -0.9858 0.2083 MATH003 1.4389 -0.0517 0.2108 MATH004 1.1761 -0.3154 0.2069 MATH005 1.3919 0.1376 0.1076 MATH006 1.8996 0.0172 0.2608 MATH007 1.5208 -2.1496 0.1654 MATH008 1.7526 -0.8597 0.2861 MATH009 1.5363 -0.9554 0.2408 MATH010 2.2814 -0.3294 0.2782 MATH011 2.1974 0.0476 0.2673 MATH012 1.4531 0.3144 0.1643 MATH013 1.3920 -0.5342 0.1973 MATH014 1.6329 0.5342 0.1028 MATH015 1.8085 -0.7651 0.2055 MATH016 1.5876 -1.1629 0.2167 MATH017 1.2397 -1.7524 0.1905 MATH018 1.2897 -1.6349 0.1969 MATH019 2.0020 -0.8662 0.3226 MATH020 1.4474 -1.1712 0.2045 MATH021 2.3050 -0.9058 0.2415 MATH022 2.0878 -0.7018 0.1685 MATH023 1.6835 -0.8952 0.2479 MATH024 1.5895 -0.9494 0.1598 MATH025 1.5542 -0.8684 0.1980 MATH026 1.8753 -0.4096 0.1833 MATH027 2.6310 0.1514 0.1898 MATH028 2.2066 -0.3999 0.2734 MATH029 2.1675 -0.3864 0.2862 MATH030 1.7039 -0.6293 0.2876 MATH031 1.1960 -1.5838 0.2420

試題編號 鑑別度參數(a) 難度參數(b) 猜測度參數(c)

MATH032 1.3181 -1.4419 0.2345 MATH033 1.3246 -1.4036 0.2721 MATH034 1.4538 -0.5677 0.1209 MATH035 1.2363 1.0051 0.2559 MATH036 0.9271 -2.3862 0.2187 MATH037 2.0356 -2.2307 0.1764 MATH038 1.2657 -1.5787 0.1780 MATH039 1.7685 -1.4406 0.1881 MATH040 1.8564 -0.4198 0.1580 MATH041 1.3122 -1.5814 0.1825 MATH042 1.9860 -1.9692 0.1521 MATH043 1.4001 -1.3071 0.2139 MATH044 1.9359 -1.4912 0.1861 MATH045 1.9192 -0.9342 0.2042 MATH046 2.0492 0.3827 0.2829 MATH047 2.0878 0.1839 0.2999 MATH048 1.4887 -1.3514 0.2530 MATH049 1.3617 -1.0495 0.2294 MATH050 1.7307 -0.7179 0.1721 MATH051 1.5442 -0.6461 0.1142 MATH052 1.8176 -0.6595 0.2259 MATH053 1.8336 -0.5460 0.2195 MATH054 1.6585 -0.4577 0.1945 MATH055 1.6834 -0.6882 0.2009 MATH056 1.7382 -0.8470 0.1826 MATH057 1.3103 0.2539 0.1439 MATH058 1.3476 -1.4844 0.1845 MATH059 1.3079 -2.4547 0.1790 MATH060 1.2370 -0.8944 0.2514 MATH061 1.3860 -1.7261 0.2379 MATH062 1.4820 0.2817 0.2515 MATH063 1.2337 -0.8466 0.1829 MATH064 0.7189 -1.9109 0.2047 MATH065 1.1967 -3.0894 0.1985 MATH066 1.3005 -0.4265 0.1522 MATH067 1.0449 -2.4809 0.1814 MATH068 1.4070 -0.4345 0.2098 MATH069 0.9574 -1.0713 0.2059

試題編號 鑑別度參數(a) 難度參數(b) 猜測度參數(c)

MATH070 0.7470 0.3804 0.1717 MATH071 1.3237 -1.0273 0.2174 MATH072 1.3305 -0.6709 0.1928 MATH073 1.4764 -1.1257 0.1799 MATH074 1.6650 -0.5787 0.2220 MATH075 1.0214 -1.4188 0.1836 MATH076 1.7939 1.1615 0.1279 MATH077 1.2782 -0.3616 0.2192 MATH078 1.0565 -0.5545 0.1981 MATH079 1.8868 0.1737 0.3805 MATH080 1.6179 -0.0080 0.3399 MATH081 1.8485 1.2439 0.0732 MATH082 1.0117 -0.5362 0.2951 MATH083 0.9461 -2.7444 0.1869 MATH084 0.8277 -1.6617 0.2116 MATH085 0.8083 -0.8454 0.2103 MATH086 1.2715 -1.0762 0.2205 MATH087 0.9774 -1.7915 0.1922 MATH088 1.2523 -1.9148 0.1417 MATH089 1.3645 -0.8234 0.1360 MATH090 1.4203 -1.4434 0.2146 MATH091 1.1685 -1.3669 0.1753 MATH092 1.6364 -1.7841 0.1941 MATH093 1.4577 -1.5589 0.2148 MATH094 1.3621 -1.5498 0.1795 MATH095 1.6995 -1.2237 0.3043 MATH096 1.2465 -1.2899 0.2028 MATH097 1.2201 -1.0787 0.2343 MATH098 1.3881 -1.1396 0.2449 MATH099 1.4330 0.6998 0.2505 MATH100 1.6178 -0.1727 0.2487 MATH101 1.3636 -1.6910 0.1884 MATH102 1.6218 -1.7756 0.1666 MATH103 1.3458 -1.8258 0.2143 MATH104 1.3432 -1.3603 0.2211 MATH105 1.6782 -0.7429 0.2757 MATH106 1.5132 -1.2713 0.1932 MATH107 1.1536 -1.4276 0.2417

試題編號 鑑別度參數(a) 難度參數(b) 猜測度參數(c)

MATH108 0.8373 -1.4352 0.2341 MATH109 1.6760 -0.4680 0.3843 MATH110 1.6994 -0.4219 0.3334 MATH111 1.5626 -0.4220 0.1643 MATH112 1.2965 -0.2764 0.1658 MATH113 2.4667 -0.1691 0.3305 MATH114 2.3337 0.2718 0.2047 MATH115 1.9445 -0.5471 0.1704 MATH116 1.6035 -0.5615 0.2716 MATH117 1.1496 -1.0472 0.2241 MATH118 1.2623 -1.5545 0.2277 MATH119 1.1189 -2.7156 0.1935 MATH120 0.9297 -0.1706 0.2036 MATH121 2.2693 -0.0122 0.2038 MATH122 1.1748 0.7330 0.1885 MATH123 2.5880 -0.0914 0.2630 MATH124 2.0913 0.2488 0.2786 MATH125 1.3301 0.4504 0.1396 MATH126 0.8537 2.0539 0.1999 MATH127 1.9865 -0.0420 0.2301 MATH128 1.6270 0.8774 0.2494 MATH129 1.8196 1.2085 0.1979 MATH130 1.0598 -2.0421 0.2301 MATH131 1.3611 -2.5515 0.1849 MATH132 1.3833 0.0837 0.2731 MATH133 0.9755 -2.0967 0.2007 MATH134 0.9687 -3.4808 0.2050 MATH135 1.9416 2.0477 0.2729 MATH136 1.4363 1.7808 0.2658 MATH137 0.7623 -0.8944 0.2259 MATH138 1.4190 1.4138 0.2671 MATH139 1.7251 -1.6973 0.1825 MATH140 1.9245 -0.2811 0.2318 MATH141 1.1164 -2.9881 0.2005 MATH142 0.8153 -2.0586 0.2051 MATH143 1.1831 -0.9949 0.2080 MATH144 1.0653 -2.0071 0.2359 MATH145 1.0844 -1.8593 0.1773

試題編號 鑑別度參數(a) 難度參數(b) 猜測度參數(c)

MATH146 1.2656 -0.6069 0.2049 MATH147 1.2810 -1.5961 0.1389 MATH148 1.1617 -1.5064 0.2032 MATH149 1.7248 -1.2984 0.1507 MATH150 1.3259 -1.5967 0.1811 MATH151 1.4755 -0.7243 0.1710 MATH152 1.7364 -0.5728 0.2482 MATH153 1.6586 -0.9854 0.1512 MATH154 2.0330 -0.9835 0.2509 MATH155 1.9038 -1.1834 0.1766 MATH156 1.8438 -1.2104 0.2554 MATH157 1.9324 -1.2191 0.1300 MATH158 1.8547 -0.9672 0.2193 MATH159 1.9333 -1.2210 0.1282 MATH160 2.0262 -0.9994 0.2017 MATH161 1.5937 -0.8380 0.1815 MATH162 1.6571 -0.7644 0.1845 MATH163 1.4283 -0.5276 0.1572 MATH164 1.4638 -0.2170 0.2033 MATH165 1.7462 -1.6581 0.1561 MATH166 1.5705 -0.8760 0.2273 MATH167 1.3277 -1.0019 0.1589 MATH168 1.2531 -0.9652 0.1588 MATH169 1.5046 -1.0303 0.2145 MATH170 1.5764 -0.9486 0.1485 MATH171 1.5474 -1.0848 0.2619 MATH172 1.6782 -1.1275 0.1937 MATH173 2.2519 -0.5105 0.1774 MATH174 2.1556 -0.5732 0.1862 MATH175 1.1690 -1.6900 0.2051 MATH176 1.0734 -1.2252 0.2276 MATH177 1.1117 -0.9338 0.1590 MATH178 1.3388 -0.5861 0.1859 MATH179 0.8119 0.4445 0.1882 MATH180 1.3906 -0.4093 0.2788 MATH181 1.9835 0.1317 0.3005 MATH182 0.9347 0.6525 0.2210 MATH183 1.5629 0.2056 0.4535

試題編號 鑑別度參數(a) 難度參數(b) 猜測度參數(c)

MATH184 1.8994 0.2220 0.2891 MATH185 0.7137 -0.9637 0.1837 MATH186 1.7161 0.3977 0.3674 MATH187 2.5912 0.4761 0.2627 MATH188 1.2305 0.2796 0.2334 MATH189 0.9963 -1.0042 0.1707 MATH190 1.5469 0.8062 0.2601 MATH191 1.1373 -0.9026 0.1795 MATH192 0.8546 -1.7028 0.1824 MATH193 1.4220 -0.1884 0.2063 MATH194 1.4655 0.8051 0.2242 MATH195 1.3189 -0.9898 0.2429 MATH196 1.5091 -0.4732 0.1662 MATH197 1.4188 0.7035 0.1570 MATH198 1.5622 -1.0913 0.2058 MATH199 1.3807 -0.8178 0.2374 MATH200 1.3633 -0.7711 0.1697 MATH201 1.4738 -0.3719 0.2139 MATH202 1.9615 -0.4508 0.2593 MATH203 2.1304 -0.0424 0.2334 MATH204 1.7876 -0.7399 0.2152 MATH205 2.0722 -0.8298 0.1685 MATH206 1.5301 -0.2422 0.1519 MATH207 1.9845 0.3446 0.2330 MATH208 1.3902 -0.8618 0.1600 MATH209 1.7002 -1.2097 0.1560 MATH210 1.1480 0.7980 0.1918 MATH211 1.1129 -1.1840 0.2031 MATH212 1.4393 -0.6793 0.2525 MATH213 1.5051 -0.5305 0.3325 MATH214 1.4639 -2.5163 0.1883 MATH215 1.7678 -2.4022 0.2113 MATH216 1.6905 -2.3526 0.1905 MATH217 2.2551 -2.3302 0.1803 MATH218 1.5925 -1.2786 0.1578 MATH219 2.3111 -2.2990 0.1677 MATH220 1.7282 -2.5174 0.1926 MATH221 2.1315 -0.5040 0.2621

試題編號 鑑別度參數(a) 難度參數(b) 猜測度參數(c)

MATH222 1.4938 -1.7257 0.1992 MATH223 1.5444 -1.5993 0.2104 MATH224 1.4637 -0.6883 0.1810 MATH225 1.9650 0.0586 0.1711 MATH226 2.3805 -1.7881 0.1612 MATH227 1.8638 -1.2246 0.2485 MATH228 1.4813 -0.3130 0.1689 MATH229 2.3842 -0.2314 0.1265 MATH230 1.6554 -1.4202 0.1693 MATH231 1.8779 -1.4911 0.1934 MATH232 1.8869 -1.0056 0.1434 MATH233 1.3491 0.2221 0.2655 MATH234 1.0418 -1.0609 0.1940 MATH235 1.5150 -1.1049 0.1390 MATH236 2.1994 -0.6951 0.2330 MATH237 1.6716 -1.2560 0.1951 MATH238 1.6731 -1.1998 0.1639 MATH239 1.4988 -0.6148 0.1547 MATH240 1.2573 -0.9050 0.1593 MATH241 1.8141 -0.9554 0.1973 MATH242 1.4487 -1.7121 0.2017 MATH243 1.2879 -1.8311 0.1816 MATH244 1.1157 -1.4191 0.1938 MATH245 1.4939 -1.3959 0.1503

附錄 B SH-b 所使用的曝光控制參數

試題

附錄 C ASHC-b 所使用的曝光控制參數

第9 層 1 1 1 1 1 1 1

第8 層 1 1 1 1 0.2327 1 1

第7 層 1 1 1 1 1 1 1

第6 層 1 1 1 1 1 1 1

第5 層 1 1 1 1 1 1 1

第4 層 1 1 1 0.8897 1 1 1

第5 層 1 1 1 0.7000 1 1 1

第6 層 1 1 1 0.5096 1 1 1

第7 層 1 0.4132 1 0.3461 0.7419 1 1 第8 層 0.2950 0.2020 0.2486 0.2000 0.2024 0.2110 0.8273 第9 層 1 1 0.6460 0.5583 0.8980 0.5677 1

第3 層 1 1 1 1 1 1 1

第2 層 1 1 1 1 1 1 1

第1 層 1 1 1 1 1 1 1

第204 題 第 205 題 第 206 題 第 207 題 第 208 題 第 209 題 第 210 題

第12 層 1 1 1 1 1 1 1

第11 層 1 1 1 1 1 1 1

第12 層 1 1 1 1 1 1 1

附錄 D 資料庫表單

表單名稱:user

欄位名稱 註解 主鍵

u_name 使用者帳號 9

u_password 使用者密碼 表單名稱:role

欄位名稱 註解 複合主鍵

u_name 使用者帳號 9

r_name 使用者被賦予角色名稱

(權限) 9

相關文件