本研究目的為發展COMTESS 並初步驗證其信效度及施測效率。研究者依據 工作社交技巧之理論與文獻常見之社交行為發展COMTESS 題庫,並經專家審 核、羅序分析驗證題庫及挑選適當題目後,建立COMTESS。COMTESS 完整涵 蓋工作社交技巧的二個向度,即「個人社交技巧」向度與「職務相關社交技巧」
向度。二向度內的題庫皆符合羅序模型之單向度與局部獨立性假設,具備建構效 度。COMTESS 共有 18 題,其中 2 題為分派題,16 題為高難度或低難度測驗 組,二向度之題目各半。COMTESS 之施測流程共有二階段:患者在第一階段先 作答2 題分派題以初步估計其能力組別,之後在第二階段作答 8 題相對應難度的 測驗組以更精準地評量患者之二向度工作社交技巧。
初步驗證COMTESS 於思覺失調症患者之信效度結果顯示 COMTESS 具有良 好的團體層級信度與可接受的個別信度,可精準地評估思覺失調症患者的「個人 社交技巧」與「職務相關社交技巧」。COMTESS 具有良好的收斂效度與已知族群 效度,可評量思覺失調症患者的工作社交技巧,且可有效區辨不同認知程度患者 間的工作社交技巧差異。COMTESS 之施測時間預估僅需 9.9 分鐘,可快速地評 量思覺失調症患者的工作社交技巧。
COMTESS 利用電腦化多階段測驗之優勢,每位患者僅須作答 10 題,約為 12.8%的題庫題數(78 題),且整體而言具有良好的信度與效度,顯示 COMTESS 可完整、快速且精準地評量思覺失調症患者之工作社交技巧。此外,透過電腦化 施測角色扮演測驗,可大幅減少施測者訓練時間與施測負擔,並增加臨床施測的 可行性。
然而,COMTESS 的題目對於患者普遍較簡單且缺乏複本題目,未來研究須 再擴充較困難的題目,並增加分派題與各難度測驗組的複本,以提升高能力患者 能力估計的信度,並減少練習效應。
參考文獻
勞動部統計處(2018)。105 年身心障礙者勞動狀況摘要分析。台北市:勞動部統 計處。取自 https://www.mol.gov.tw/statistics/2462/19476/19060/。
衛生福利部統計處(2018)。身心障礙人數按類別及年齡別分。台北市:衛生福 利部統計處。取自 https://dep.mohw.gov.tw/DOS/cp-2976-13825-113.html。
Aaronson, N., Alonso, J., Burnam, A., Lohr, K. N., Patrick, D. L., Perrin, E., & Stein, R.
E. (2002). Assessing health status and quality-of-life instruments: Attributes and review criteria. Quality of Life Research, 11, 193-205.
American Psychiatric Association. (2013). Desk reference to the diagnostic criteria from DSM-5™. Arlington, VA: American Psychiatric Publishing, Inc.
Andrich, D. (1978). A rating formulation for ordered response categories.
Psychometrika, 43, 561-573.
Bellack, A. S., Brown, C. H., & Thomas-Lohrman, S. (2006). Psychometric
characteristics of role-play assessments of social skill in schizophrenia. Behavior Therapy, 37, 339-352.
Bellack, A. S., Sayers, M., Mueser, K. T., & Bennett, M. (1994). Evaluation of social problem solving in schizophrenia. Journal of Abnormal Psychology, 103, 371-378.
Bevan, S., Gulliford, J., Steadman, K., Taskila, T., Thomas, R., & Moise, A. (2013).
Working with schizophrenia: Pathways to employment, recovery and inclusion.
Retrieved from London:
Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum Associates.
Briggs, D. C., & Wilson, M. (2003). An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement, 4, 87-100.
Burns, T., Catty, J., White, S., Becker, T., Koletsi, M., Fioritti, A., . . . Lauber, C. (2009).
The impact of supported employment and working on clinical and social functioning: Results of an international study of individual placement and support. Schizophrenia Bulletin, 35, 949-958.
Chien, I. C., Chou, Y. J., Lin, C. H., Bih, S. H., Chou, P., & Chang, H. J. (2004).
Prevalence and incidence of schizophrenia among national health insurance enrollees in Taiwan, 1996-2001. Psychiatry and Clinical Neurosciences, 58, 611-618.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.).
Hillsdale, NJ: Lawrence Erlbaum Associates.
Cook, D. A., & Beckman, T. J. (2006). Current concepts in validity and reliability for psychometric instruments: Theory and application. American Journal of Medicine, 119, 166.e167-166.e116.
Cook, J. A., & Razzano, L. (2000). Vocational rehabilitation for persons with schizophrenia: Recent research and implications for practice. Schizophrenia Bulletin, 26, 87-103.
Dickinson, D., Bellack, A. S., & Gold, J. M. (2007). Social/communication skills, cognition, and vocational functioning in schizophrenia. Schizophrenia Bulletin, 33, 1213-1220.
Donohue, B., Hasselt, V. B. V., Hersen, M., & Perrin, S. (1999). Role-play assessment of social skills in conduct disordered and substance abusing adolescents: An empirical review. Journal of Child & Adolescent Substance Abuse, 8, 1-28.
Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to
recognize their own incompetence. Current Directions in Psychological Science, 12, 83-87.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists.
Mahwah, NJ: Erlbaum.
Escobar, A., Trujillo-Martín, M., Rueda, A., Pérez-Ruiz, E., Avis, N. E., & Bilbao, A.
(2015). Cross-cultural adaptation, reliability and validity of the Spanish version of the Quality of Life in Adult Cancer Survivors (QLACS) questionnaire:
Application in a sample of short-term survivors. Health and Quality of Life Outcomes, 13, 182.
Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational Measurement (3rd ed.). New York, NY: American Council on Education;
Macmillan Publishing Co, Inc.
Goodwin, L. D., & Leech, N. L. (2006). Understanding correlation: Factors that affect the size of r. The Journal of Experimental Education, 74, 249-266.
Gurland, B. J., & Wilder, D. E. (1984). The CARE interview revisited: Development of an efficient, systematic clinical assessment. Journal of Gerontology, 39, 129-137.
Guy, W. (1976). ECDEU Assessment Manual for Psychopharmacology. Rockville, MD:
US Department of Heath, Education, and Welfare Public Health Service Alcohol, Drug Abuse, and Mental Health Administration.
Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993). Measuring health-related quality of life. Annals of Internal Medicine, 118, 622-629.
Haley, S. M., Andres, P. L., Coster, W. J., Kosinski, M., Ni, P., & Jette, A. M. (2004).
Short-form activity measure for post-acute care. Archives of Physical Medicine and Rehabilitation, 85, 649-660.
Haley, S. M., Coster, W. J., Andres, P. L., Kosinski, M., & Ni, P. (2004). Score comparability of short forms and computerized adaptive testing: Simulation study with the activity measure for post-acute care. Archives of Physical Medicine and Rehabilitation, 85, 661-666.
Halford, W. K., & Hayes, R. L. (1995). Social skills in schizophrenia: Assessing the relationship between social skills, psychopathology and community functioning.
Social Psychiatry and Psychiatric Epidemiology, 30, 14-19.
Harvey, P. D., Reichenberg, A., Bowie, C. R., Patterson, T. L., & Heaton, R. K. (2010).
The course of neuropsychological performance and functional capacity in older patients with schizophrenia: Influences of previous history of long-term
institutional stay. Biological Psychiatry, 67, 933-939.
Harvey, P. D., Velligan, D. I., & Bellack, A. S. (2007). Performance-based measures of functional skills: Usefulness in clinical treatment studies. Schizophrenia
Bulletin, 33, 1138-1148.
Hays, R. D., Morales, L. S., & Reise, S. P. (2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38, II28-II42.
Henry, A. D., & Lucca, A. M. (2004). Facilitators and barriers to employment: The perspectives of people with psychiatric disabilities and employment service providers. Work, 22, 169-182.
Hou, W. H., Chen, J. H., Wang, Y. H., Wang, C. H., Lin, J. H., Hsueh, I. P., . . . Hsieh, C.
L. (2011). Development of a set of functional hierarchical balance short forms for patients with stroke. Archives of Physical Medicine and Rehabilitation, 92, 1119-1125.
Jiang, S., Wang, C., & Weiss, D. J. (2016). Sample size requirements for estimation of item parameters in the multidimensional graded response model. Frontiers in
Psychology, 7, 109.
Jongbloed, L., & Morgan, D. (1991). An investigation of involvement in leisure activities after a stroke. American Journal of Occupational Therapy, 45, 420-427.
Juckel, G., Schaub, D., Fuchs, N., Naumann, U., Uhl, I., Witthaus, H., . . . Brune, M.
(2008). Validation of the Personal and Social Performance (PSP) Scale in a German sample of acutely ill patients with schizophrenia. Schizophrenia Research, 104, 287-293.
Kawata, A. K., & Revicki, D. A. (2008). Psychometric properties of the Personal and Social Performance scale (PSP) among individuals with schizophrenia living in the community. Quality of Life Research, 17, 1247-1256.
Lee, Y. C., Chen, S. S., Koh, C. L., Hsueh, I. P., Yao, K. P., & Hsieh, C. L. (2014).
Development of two Barthel Index-based supplementary scales for patients with stroke. PloS One, 9, e110494.
Lehman, A. F., Goldberg, R., Dixon, L. B., McNary, S., Postrado, L., Hackman, A., &
McDonnell, K. (2002). Improving employment outcomes for persons with severe mental illnesses. Archives of General Psychiatry, 59, 165-172.
Leucht, S., & Engel, R. R. (2006). The relative sensitivity of the Clinical Global Impressions Scale and the Brief Psychiatric Rating Scale in antipsychotic drug trials. Neuropsychopharmacology, 31, 406-412.
Linacre, J. (2009). A user’s guide to WINSTEP. Chicago, IL: MESA Press.
Mancuso, C. A., Peterson, M. G., & Charlson, M. E. (2001). Comparing discriminative validity between a disease-specific and a general health scale in patients with moderate asthma. Journal of Clinical Epidemiology, 54, 263-274.
Marwaha, S., & Johnson, S. (2004). Schizophrenia and employment─A review. Social
Psychiatry and Psychiatric Epidemiology, 39, 337-349.
Masters, G. N. (1988). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
Mathews, R. M., & Fawcett, S. B. (1979). Assessing dissemination capability: An evaluation of an exportable training package. Behavior Modification, 3, 49-62.
Mathews, R. M., Whang, P. L., & Fawcett, S. B. (1980). Development and validation of an occupational skills assessment instrument. Behavioral Assessment, 2, 71-85.
Mathews, R. M., Whang, P. L., & Fawcett, S. B. (1981). Behavioral assessment of job-related skills. Journal of Employment Counseling, 18, 3-11.
McGrath, J., Saha, S., Chant, D., & Welham, J. (2008). Schizophrenia: A concise overview of incidence, prevalence, and mortality. Epidemiologic Reviews, 30, 67-76.
Meier, V. J., & Hope, D. A. (1998). Assessment of social skills. In A. S. Bellack & M.
Hersen (Eds.), Behavioral assessment: A practical handbook (4th ed., pp. 232-254). Boston: Allyn & Bacon.
Melle, I., Friis, S., Hauff, E., & Vaglum, P. (2000). Social functioning of patients with schizophrenia in high-income welfare societies. Psychiatric Services, 51, 223-228.
Milanzi, E., Molenberghs, G., Alonso, A., Verbeke, G., & Boeck, P. D. (2015).
Reliability measures in item response theory: Manifest versus latent correlation functions. British Journal of Mathematical and Statistical Psychology, 68, 43-64.
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D.
L., . . . de Vet, H. C. (2010). The COSMIN study reached international
consensus on taxonomy, terminology, and definitions of measurement properties
for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63, 737-745.
Morosini, P. L., Magliano, L., Brambilla, L., Ugolini, S., & Pioli, R. (2000).
Development, reliability and acceptability of a new version of the DSM-IV Social and Occupational Functioning Assessment Scale (SOFAS) to assess routine social functioning. Acta Psychiatrica Scandinavica, 101, 323-329.
Mueser, K. T., Bellack, A. S., Douglas, M. S., & Morrison, R. L. (1991). Prevalence and stability of social skill deficits in schizophrenia. Schizophrenia Research, 5, 167-176.
Mueser, K. T., Bellack, A. S., Morrison, R. L., & Wixted, J. T. (1990). Social
competence in schizophrenia: Premorbid adjustment, social skill, and domains of functioning. Journal of Psychiatric Research, 24, 51-63.
Mueser, K. T., Salyers, M. P., & Mueser, P. R. (2001). A prospective analysis of work in schizophrenia. Schizophrenia Bulletin, 27, 281-296.
Murray, C. J. L., & Lopez, A. D. (1996). The global burden of disease: A comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge, MA: Harvard School of Public Health on behalf of the World Health Organization and the World Bank, Harvard University Press.
Nasrallah, H., Morosini, P., & Gagnon, D. D. (2008). Reliability, validity and ability to detect change of the Personal and Social Performance scale in patients with stable schizophrenia. Psychiatry Research, 161, 213-224.
Nasreddine, Z. S., Phillips, N. A., Bedirian, V., Charbonneau, S., Whitehead, V., Collin, I., . . . Chertkow, H. (2005). The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American
Geriatrics Society, 53, 695-699.
Ochoa, S., Usall, J., Cobo, J., Labad, X., & Kulkarni, J. (2012). Gender differences in schizophrenia and first-episode psychosis: A comprehensive literature review.
Schizophrenia Research and Treatment, 2012, 916198.
Patrick, D. L., Burns, T., Morosini, P., Rothman, M., Gagnon, D. D., Wild, D., &
Adriaenssen, I. (2009). Reliability, validity and ability to detect change of the clinician-rated Personal and Social Performance scale in patients with acute symptoms of schizophrenia. Current Medical Research and Opinion, 25, 325-338.
Perlick, D. A., Rosenheck, R. A., Clarkin, J. F., Sirey, J. A., Salahi, J., Struening, E. L.,
& Link, B. G. (2001). Stigma as a barrier to recovery: Adverse effects of perceived stigma on social adaptation of persons diagnosed with bipolar affective disorder. Psychiatric Services, 52, 1627-1632.
Pinkham, A. E., & Penn, D. L. (2006). Neurocognitive and social cognitive predictors of interpersonal skill in schizophrenia. Psychiatry Research, 143, 167-178.
Pinna, F., Deriu, L., Diana, E., Perra, V., Randaccio, R. P., Sanna, L., . . . Cagliari Recovery Study Group. (2015). Clinical Global Impression-severity score as a reliable measure for routine evaluation of remission in schizophrenia and schizoaffective disorders. Annals of General Psychiatry, 14, 6.
Ramírez, L. R.-B., Saracco-Álvarez, R., Escamilla-Orozco, R., & Orellana, A. F. (2014).
Validity of the Montreal Cognitive Assessment Scale (MoCA) for the detection of cognitive impairment in schizophrenia. Salud Mental, 37, 485-490.
Robinson, D. G., Woerner, M. G., McMeniman, M., Mendelowitz, A., & Bilder, R. M.
(2004). Symptomatic and functional recovery from a first episode of
schizophrenia or schizoaffective disorder. American Journal of Psychiatry, 161,
473-479.
Salzberg, C. L., Likins, M., McConaughy, E. K., & Lignugaris\Kraft, B. (1986). Social competence and employment of retarded persons. International Review of Research in Mental Retardation, 14, 225-257.
Schaub, D., Brune, M., Bierhoff, H. W., & Juckel, G. (2012). Comparison of self- and clinician's ratings of Personal and Social Performance in patients with
schizophrenia: The role of insight. Psychopathology, 45, 109-116.
Siemons, L., ten Klooster, P. M., van de Laar, M. A. F. J., van den Ende, C. H. M., &
Hoogeboom, T. J. (2013). Validity of summing painful joint sites to assess joint-pain comorbidity in hip or knee osteoarthritis. BMC Musculoskeletal Disorders, 14, 1-5.
Tesio, L. (2003). Measuring behaviours and perceptions: Rasch analysis as a tool for rehabilitation research. Journal of Rehabilitation Medicine, 35, 105-115.
Tianmei, S., Liang, S., Yun'ai, S., Chenghua, T., Jun, Y., Jia, C., . . . Hongyan, Z. (2011).
The Chinese version of the Personal and Social Performance Scale (PSP):
Validity and reliability. Psychiatry Research, 185, 275-279.
Tsang, H. W., Lam, P., & Ng, B. (2000). Predictors of employment outcome for people with psychiatric disabilities: A review of the literature since the mid '80s.
Journal of Rehabilitation, 66, 19-31.
Tsang, H. W., Ng, B., Chiu, I. Y., & Mann, S. (2000). Predictors of post-hospital employment status for psychiatric patients in Hong Kong: From perceptions of rehabilitation professionals to empirical evidence. International Journal of Social Psychiatry, 46, 306-312.
Tsang, H. W., & Pearson, V. (1996). A conceptual framework for work-related social skills in psychiatric rehabilitation. Journal of Rehabilitation, 62, 61-67.
Tsang, H. W., & Pearson, V. (2000). Reliability and validity of a simple measure for assessing the social skills of people with schizophrenia necessary for seeking and securing a job. Canadian Journal of Occupational Therapy, 67, 250-259.
Wade, D. T. (1992). Measurement in neurological rehabilitation. Oxford: Oxford University Press.
Wang, W. C., Chen, P. H., & Cheng, Y. Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9, 116-136.
World Health Organization. (2001). International classification of functioning, disability and health (ICF). Geneva: World Health Organization.
Wright, B. D., & Linacre, J. M. (1989). Observations are always ordinal; Measurements, however, must be interval. Archives of Physical Medicine and Rehabilitation, 70, 857-860.
Wright, B. D., & Linacre, J. M. (1994). Reasonable item mean-square fit values. Rasch Measurement Transactions, 8, 370.
Wright, B. D., & Master, G. N. (1982). Rating scale analysis. Chicago, IL: MESA Press.
Wright, B. D., & Mok, M. (2000). Rasch models overview. Journal of Applied Measurement, 1, 83-106.
Yu, L., Buysse, D. J., Germain, A., Moul, D. E., Stover, A., Dodds, N. E., . . . Pilkonis, P. A. (2011). Development of short forms from the PROMIS™ sleep disturbance and Sleep-Related Impairment item banks. Behavioral Sleep Medicine, 10, 6-24.
圖一、Salzberg 之「職業能力模型 (vocational competence)」
資料來源:修改自 Salzberg, Likins, McConaughy, & Lignugaris/Kraft (1986) 之職業 能力模型。
職業能力
工作責任 工作技能
社交職業能力
職務相關 社交技巧
個人 社交技巧
圖二、Tsang 之「三階層工作相關社交技巧模型 (three-tier model of work-related
圖三、工作社交技巧之架構圖
工作社交技巧
一般性 工作社交技巧
一般性 職務相關 社交技巧
一般性 個人社交技巧
職業特定 工作社交技巧
職業特定 職務相關 社交技巧
職業特定 個人社交技巧
圖四、電腦化多階段測驗施測流程
第一階段:施測分派題以初步區辨能力程度
分派題
個人社交技巧
高 低
職務相關社交技巧
高 低
第二階段:依據能力程度施測適當難度的測驗組
職務相關社交技巧 高難度測驗組 個人社交技巧 高難度測驗組
職務相關社交技巧 高難度測驗組 個人社交技巧 低難度測驗組
職務相關社交技巧 低難度測驗組 個人社交技巧 低難度測驗組 職務相關社交技巧
低難度測驗組 個人社交技巧 高難度測驗組
圖五、發展與驗證COMTESS 之流程圖
第一階段:發展COMTESS
6. 選題並建構COMTESS:以多向度羅序分析估計題庫難度與患者能力參數,並自題庫中 挑選篩檢題與高、低難度測驗組,以組成COMTESS。
1. 文獻回顧:彙整文獻中常評量或觀察思覺失調症患者之工作社交技巧行為與指標。
2. 編製初版題庫:編寫初版題庫之劇本與計分量尺。
5. 題庫驗證:請思覺失調症患者作答題庫,並以單向度羅序分析檢驗題庫之模型適配度。
4. 建置題庫之施測介面:使用投影片播放檔設計施測介面,設計4種隨機出題施測版本。
3. 專家審核初版題庫:請臨床專家確認初版題庫之重要性與情境適切性,並修改初版題庫 以及將修改版題庫拍攝為施測影片。
第二階段:初步驗證COMTESS之信度、效度與施測效率
• 驗證信度:以患者能力估計之標準誤計算COMTESS之個別信度與平均信度。
• 驗證收斂效度:以PSP作為效標,分析COMTESS與PSP之分數相關性。
• 驗證已知族群效度:以MoCA將患者依有/無明顯認知障礙分組,比較兩組COMTESS分
• 驗證已知族群效度:以MoCA將患者依有/無明顯認知障礙分組,比較兩組COMTESS分