第五章、 實驗二
第四節、 總結
國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
系統之影響,結果發現兩者皆有影響。且根據 FN 的振幅顯示兩者影響的程度相 近。推估當非預期結果或高錯誤可能性畫面呈現時皆會傳送錯誤偵測訊號至前扣 帶皮質並活化之,進而觀察到較大的 FN。對照至本實驗結果,顯示當一個畫面 同時包含了非預期結果及高錯誤可能性訊息時,會有最大的 FN 產生;而非預期 結果及高錯誤可能性各別出現時會引發振幅相近的 FN;當畫面並未包含非預期 結果及高錯誤可能性訊息時則不會觀察到 FN。顯示無論單看增強學習理論或是 錯誤可能性理論皆無法良好解釋此研究結果,唯有綜合兩者。故建議在錯誤偵測 系統中納入錯誤可能性之評估因素,並待後續研究確認其可行性。
第四節、總結
綜合本研究的兩個實驗,主要發現錯誤可能性對於個體在評估事件的影響。
由於過去主要用以解釋錯誤偵測系統的理論為增強學習理論,而增強學習理論之 主要核心為比較實際結果與預期之間的差異。本研究的實驗一點出有些無法單純 由增強學習理論所解釋的現象(風險因素),並在實驗二中更直接指出錯誤可能 行對於事件評估的影響。如此的現象更值得讓研究者重新思考不論增強學習理論 或是錯誤可能性理論皆無法全面解釋現實生活中的事件評估依據,唯有將各種評 估之因素納入並統整。
‧
Operations research, 961-981.
Bellebaum, C., Kobza, S., Thiele, S., & Daum, I. (2011). Processing of expected and unexpected monetary performance outcomes in healthy older subjects. Behavioral Neuroscience, 125(2), 241.
Bellebaum, C., Polezzi, D., & Daum, I. (2010). It is less than you expected:
The feedback-related negativity reflects violations of reward magnitude expectations. Neuropsychologia, 48(11), 3343-3350.
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control.
Psychological review, 108(3), 624.
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001).
Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron, 30(2), 619-639.
Brown, J. W., & Braver, T. S. (2005). Learned predictions of error likelihood in the anterior cingulate cortex. Science, 307(5712), 1118-1121.
Brown, J. W., & Braver, T. S. (2007). Risk prediction and aversion by anterior cingulate cortex. Cognitive, Affective, & Behavioral Neuroscience, 7(4), 266-277.
Chang, Y. F., & Yen, N. S. (2008). The feedback-related negativity is sensitive to the delayed outcome. Paper presented at the 15th annual
‧
meeting of the Cognitive Neuroscience Society, San Francisco, CA, U.S.A.
Chang, Y. F., Yen, N. S., Lin, K. Y., Chen, C. Y., & Kao, C. H. (2010).
The FRN is associated with the expectation. Paper presented at the 17th annual meeting of the Cognitive Neuroscience Society, Montreal.
Chung, H. K. (2011). Risk factor in somatic marker hypothesis. Unpublished master's thesis, Chengchi University, Taipei, Taiwan.
Cloninger, C. R. (1987). A systematic method for clinical description and classification of personality variants: A proposal. Archives of general psychiatry, 44(6), 573.
de Bruijn, E. R. A., Hulstijn, W., Verkes, R. J., Ruigt, G. S. F., & Sabbe, B. G. C. (2004). Drug-induced stimulation and suppression of action monitoring in healthy volunteers. Psychopharmacology, 177(1), 151-160.
Dehaene, S., Posner, M. I., & Tucker, D. M. (1994). Localization of a neural system for error detection and compensation. Psychological Science, 5(5), 303-305.
Galvan, A., Hare, T., Voss, H., Glover, G., & Casey, B. (2007). Risktaking and the adolescent brain: who is at risk? Developmental science, 10(2), 8-14.
Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E.
(1993). A neural system for error detection and compensation.
Psychological Science, 4(6), 385.
‧
Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295(5563), 2279-2282.
Gemba, H., Sasaki, K., & Brooks, V. (1986). Error' potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning. Neuroscience letters, 70(2), 223-227.
Gerra, G., Zaimovic, A., Timpano, M., Zambelli, U., Delsignore, R., &
Brambilla, F. (2000). Neuroendocrine correlates of temperamental traits in humans. Psychoneuroendocrinology, 25(5), 479-496.
Gibson, J., Krigolson, O., & Holroyd, C. (2006). Sensitivity of the feedback error-related negativity to reward probability.
Psychophysiology, 43, 41-42.
Goyer, J. P., Woldorff, M. G., & Huettel, S. A. (2008). Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards. Journal of Cognitive Neuroscience, 20(11), 2058-2069.
Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2007). It's worse than you thought: The feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology, 44(6), 905-912.
Hansenne, M., Pinto, E., Pitchot, W., Reggers, J., Scantamburlo, G., Moor, M., & Ansseau, M. (2002). Further evidence on the relationship between dopamine and novelty seeking: a neuroendocrine study.
Personality and individual differences, 33(6), 967-977.
‧
Heldmann, M., Russeler, J., & Munte, T. (2008). Internal and external information in error processing. BMC Neuroscience, 9(1), 33.
Hikosaka, O. (2010). The habenula: from stress evasion to value based decision making. Nature Reviews Neuroscience, 11(7), 503-513.
Hirsh, J. B., & Inzlicht, M. (2008). The devil you know. Psychological Science, 19(10), 962.
Hohnsbein, J., Falkenstein, M., & Hoormann, J. (1989). Error processing in visual and auditory choice reaction tasks. Journal of Psychophysiology, 3, 32.
Holroyd, & Krigolson. (2007). Reward prediction error signals associated with a modified time estimation task. Psychophysiology, 44(6), 913-917.
Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing : Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109(4), 679-709.
Holroyd, C. B., & Krigolson, O. E. (2007). Reward prediction error signals associated with a modified time estimation task. Psychophysiology, 44(6), 913-917.
Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology, 41(2), 245-253.
Holroyd, C. B., Nieuwenhuis, S., Yeung, N., Nystrom, L., Mars, R. B., Coles, M. G. H., & Cohen, J. D. (2004). Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nature
‧
Neuroscience, 7(5), 497-498.
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., &
Rushworth, M. F. S. (2006). Optimal decision making and the anterior cingulate cortex. Nature neuroscience, 9(7), 940-947.
Kéri, S., Decety, J., Roland, P. E., & Gulyás, B. (2004). Feature uncertainty activates anterior cingulate cortex. Human Brain Mapping, 21(1), 26-33.
Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A.,
& Carter, C. S. (2004). Anterior cingulate conflict monitoring and adjustments in control. Science, 303(5660), 1023-1026.
KreuSSel, L., Hewig, J., Kretschmer, N., Hecht, H., Coles, M. G. H., &
Miltner, W. H. (2012). The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. Psychophysiology, 49(2), 207-219.
Liu, X., Powell, D. K., Wang, H., Gold, B. T., Corbly, C. R., & Joseph, J. E. (2007). Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. The Journal of neuroscience, 27(17), 4587-4597.
Münte, T. F., Heldmann, M., Hinrichs, H., Marco-Pallares, J., Krämer, U.
M., Sturm, V., & Heinze, H. J. (2007). Nucleus accumbens is involved in human action monitoring: evidence from invasive electrophysiological recordings. Frontiers in human neuroscience, 1(11), 1-6.
Miltner, W. H., Braun, C. H., & Coles, M. G. (1997). Event-related brain
‧
potentials following incorrect feedback in a time-estimation task:
Evidence for a 'Generic' neural system for error-detection. Journal of Cognitive Neuroscience, 9(6), 788-798.
Moser, J. S., & Simons, R. F. (2009). The neural consequences of flip flopping: The feedback related negativity and salience of reward prediction. Psychophysiology, 46, 313-320.
Nieuwenhuis, S., Yeung, N., Holroyd, C. B., Schurger, A., & Cohen, J. D.
(2004). Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cerebral Cortex, 14(7), 741-747.
Niki, H., & Watanabe, M. (1979). Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain research, 171(2), 213-224.
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304(5669), 452-454.
Oldfield, R. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia, 9(1), 97-113.
Pfabigan, D. M., Alexopoulos, J., Bauer, H., & Sailer, U. (2011).
Manipulation of feedback expectancy and valence induces negative and positive reward prediction error signals manifest in eventrelated brain potentials. Psychophysiology, 48(5), 656-664.
Potts, G. F., Martin, L. E., Burton, P., & Montague, P. R. (2006). When things are better or worse than expected: The medial frontal cortex
‧
and the allocation of processing resources. Journal of Cognitive Neuroscience, 18(7), 1112-1119.
Salas, R., Baldwin, P., de Biasi, M., & Montague, P. R. (2010). BOLD Responses to Negative Reward Prediction Errors in Human Habenula.
Frontiers in Human Neuroscience, 4(36).
San Martín, R., Manes, F., Hurtado, E., Isla, P., & Ibañez, A. (2010).
Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task. NeuroImage, 51(3), 1194-1204.
Santesso, D. L., & Segalowitz, S. J. (2009). The errorrelated negativity is related to risk taking and empathy in young men. Psychophysiology, 46(1), 143-152.
Scheffers, M. K., Coles, M. G. H., Bernstein, P., Gehring, W. J., & Donchin, E. (1996). Eventrelated brain potentials and errorrelated processing: An analysis of incorrect responses to go and nogo stimuli. Psychophysiology, 33(1), 42-53.
Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593-1599.
Schultz, W., Tremblay, L., & Hollerman, J. R. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex, 10(3), 272-283.
Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction (Vol. 1): Cambridge Univ Press.
Weber, E. U., Shafir, S., & Blais, A.R. (2004). Predicting risk
‧
coefficient of variation. Psychological Review, 111, 430-445.Yen, N. S.*, Lai, Y. R., Chang, Y. F., Yeh, T. H., & Chen, K. H. (2007b, Sep.). The effect of expectancy on feedback-related negativity.
Poster presented at the 5th Annual Meeting of Society for Neuroeconomics, Boston, U.S.A.
Yeung, N., Holroyd, C., & Cohen, J. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice.
Cerebral Cortex, 15(5), 535-544.
Yu R, Zhou W, Zhou X. (2011). Rapid Processing of Both Reward Probability and Reward Uncertainty in the Human Anterior Cingulate Cortex. PLoS ONE 6(12): e29633.
Zani, A., & Proverbio, A. M. (2003). The cognitive electrophysiology of mind and brain: Academic Press.
Zhou, Z., Yu, R., & Zhou, X. (2010). To do or not to do? Action enlarges the FRN and P300 effects in outcome evaluation. Neuropsychologia, 48(12), 3606-3613.
Zirnheld, P. J., Carroll, C. A., Kieffaber, P. D., O'donnell, B. F., Shekhar, A., & Hetrick, W. P. (2004). Haloperidol impairs learning and error-related negativity in humans. Journal of Cognitive Neuroscience, 16(6), 1098-1112.
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
附表說明
表一:ERN 與 FN 異同整理比較表。
表二:增強學習理論及錯誤可能性理論異同整理比較表。
表三:實驗一牌局設計。
表四:實驗二腦波數值。
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
附表
表一
ERN FN
全名 錯誤相關負波
(Error-Related Negativity)
回饋相關負波
(Feedback-Related Negativity)
別名 response ERN, rERN, NE feedback ERN, fern, FN
作業型態 反映作業 賭博作業、估計作業
錯誤來源 內在 外在
來源 ACC ACC
發生時間 事件後 50~150ms 回饋後 250~350ms
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
表二
增強學習理論 錯誤可能性理論 錯誤來源 回饋結果 錯誤可能性畫面 時間點 回饋結果呈現 錯誤可能性呈現時
來源 ACC ACC
注意力系統 不需介入 介入
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
表三
CV Condition % Condition 高風險牌 低風險牌 高風險牌 低風險牌 + 50% 50% 50% 75%
- 50% 50% 50% 25%
CV 10.72 4.12 10.72 10.72 EV 100 100 100 100
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
表四
預期結果 非預期結果
高錯誤可能性
-3.753 -4.072
(2.307) (2.740)
低錯誤可能性
-3.103 -3,750
(2.069) (1.858)
‧
圖一:典型 FN 波形(摘自 Gehring &Willoughby, 2002)。
圖二:增強學習理論機制示意圖 (摘自 Holroyd & Cole, 2002)。
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
附圖
圖一
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖二
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖三
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖四
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖五
‐5
‐4.5
‐4
‐3.5
‐3
‐2.5
‐2
‐1.5
‐1
‐0.5
0
變異程度 輸贏比率
μV
高風險 低風險
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖六
‐5
‐4
‐3
‐2
‐1
0
1
‐100 0 100 200 300 400 500
μV
Risk Level @ CV Condition
Low Risk@CV Condition High Risk@CV Condition Difference
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖七
‐7
‐6
‐5
‐4
‐3
‐2
‐1
0
Negative Positive
μV
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖八
‐8
‐7
‐6
‐5
‐4
‐3
‐2
‐1
0
變異程度 輸贏比率
μV
負向回饋 正向回饋
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖九
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖十
‐8
‐7
‐6
‐5
‐4
‐3
‐2
‐1
0
高風險 低風險
μV
負向回饋 正向回饋
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖十一
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖十二
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖十三
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖十四
‐7
‐6
‐5
‐4
‐3
‐2
‐1
0
低錯誤可能性 中錯誤可能性 高錯誤可能性
μV
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖十五
‐6
‐5
‐4
‐3
‐2
‐1
0
預期結果 非預期結果
μV
高錯誤可能性 低錯誤可能性
‧ 國
立 政 治 大 學
‧
N a tio na
l C h engchi U ni ve rs it y
圖十六
‐5
‐4.5
‐4
‐3.5
‐3
‐2.5
‐2
‐1.5
‐1
‐0.5
0
拒絕 接受
μV
獲利 損失