• 沒有找到結果。

Effects of intellectual variables,age,and gender on divergent thinking in adulthood

N/A
N/A
Protected

Academic year: 2021

Share "Effects of intellectual variables,age,and gender on divergent thinking in adulthood"

Copied!
11
0
0

加載中.... (立即查看全文)

全文

(1)International Journal of Behavioral Development 2001, 25 (6), 491–500 http://www.tandf.co.uk/journals/pp/01650254.html. # 2001 The International Society for the Study of Behavioural Development DOI: 10.1080/01650250042000483. Effects of intellectual variables, age, and gender on divergent thinking in adulthood Hayne W. Reese, Liang-Jei Lee, and Stanley H. Cohen. James M. Puckett, Jr. Texas A & M University–Kingsville, USA. West Virginia University, Morgantown, USA Divergent thinking was assessed in 400 adult women and men with tests of word association (associational  uency) and alternate uses (production  uency,  exibility, and originality). The participants were from four age cohorts: young (17–22 years old), middle-aged (40–50), young-old (60–70), and old-old (75‡). The test battery also included two intellectual ‘‘process’’ variables (inductive reasoning, memory span), one ‘‘dynamic resource variable’’ (intellectual speediness), one ‘‘structural resource variable’’ (vocabulary), and two moderator variables (depression, education). Hierarchical multiple regression analyses showed that divergent thinking was signiŽ cantly, linearly, positively, and moderately related to all of these variables except depression, which was not signiŽ cantly related to divergent thinking. Effects of age group and gender were assessed in analyses of variance (alpha ˆ .01). The age groups did not differ signiŽ cantly in associational  uency, but the middle-aged group was the best on production  uency,  exibility, and originality. Gender had a signiŽ cant effect on only one variable: Women had higher depression scores than men.. The study reported in this paper dealt with divergent thinking. In Guilford’s (1967) theory of intelligence, ‘‘divergent’’ thinking is contrasted with ‘‘convergent’’ thinking in the following way: Divergent thinking is related to creativity, as usually conceptualised (e.g., Simonton, 2000), in that both involve the production of a variety of new, original solutions to a problem. Divergent thinking is therefore useful for solving problems that do not have a single, objectively correct solution but rather have several potentially workable solutions whose originality or other kind of value can be assessed. Greater originality is expected if the production of ideas is  uent (many ideas are produced) and  exible (several categories of ideas are produced) (Guilford, 1967). In contrast, convergent thinking is intended to produce a single solution to a problem—not merely the subjectively best solution but the only objectively correct solution. Given this difference, tests of divergent thinking ask for the production of many alternative answers and tests of convergent thinking require arriving at a single true answer. Several tests have been developed to assess divergent thinking, and although their usefulness has been challenged, the challenges can themselves be challenged. For example, Sternberg (1985) questioned the usefulness of divergent thinking tests, but he may have been reacting to only their face validity, which is usually a trivial aspect of a test. Barron and Harrington (1981) also questioned their usefulness and concluded that ‘‘some divergent thinking tests, administered under some conditions and scored by some sets of criteria’’, are valid ‘‘in some domains’’ (p. 447). However, on the basis of. the evidence they cited, this conclusion seems to have been much too cautious. Although they stated that many studies failed to demonstrate construct validity, they did not specify the number and they cited no speciŽ c studies. In contrast, they referred to more than 75 studies that demonstrated construct validity, including more than 50 reviewed in an unpublished article they cited and 25 they speciŽ cally reviewed. Four issues were addressed in the present study. The Ž rst issue was about the nature of divergent thinking. Research with children and young adults has shown that training in  uency or  exibility yields an increase not only in the trained process but also in originality—originality of physical constructions in preschool children (Holman, Goetz, & Baer, 1977) and verbal productions in college students (Meadow, Parnes, & Reese, 1959). These results imply that originality is intrinsically related to  uency and  exibility. However, Goff (1992) found that creativity training increased older adults’  uency and  exibility but not their originality, implying that originality is a separate dimension of divergent thinking. Other Ž ndings indicate that divergent thinking is different from general intelligence but is correlated with general intelligence (McCrae, Arenberg, & Costa, 1987). The second issue addressed in the present study was whether divergent thinking is related to a different set of intellectual variables. The third issue was how divergent thinking is related to age. More research has been done on age differences in creativity than divergent thinking, but the presumed relation of creativity to divergent thinking implies that the age differences should be similar. The creativity research seems to have begun with. Correspondence should be addressed to Hayne W. Reese, 4516 French Lake Drive, Fort Worth, TX 76133, USA. Tel: (817) 346 2865. This research was supported by a grant (R01 AG06069) from the National Institute on Aging, United States Department of Health and Human Services, to the Ž rst author. Co-author Liang-Jei Lee is now at. the National Chengchi University, Taipei, Taiwan. We are indebted to Mike Gregory for aid in developing the scoring procedures for the alternate uses test. Preliminary reports were given at the Conference on Human Development, Pittsburgh, PA, April 1994, and the meeting of the International Society for the Study of Behavioral Development, Berne, Switzerland, July 1998..

(2) 492. REESE ET AL. / DIVERGENT THINKING IN ADULTHOOD. historical surveys in which biographies of persons identiŽ ed as highly creative were studied to determine the ages at which they made their creative contributions. Creative contributions were found to decline with age (e.g., Dennis, 1966; Lehman, 1953; for reviews of these and similar studies, see Botwinick, 1984, chap. 19; Gilhooly, 1988, chap. 9). The approach in other research has been to look at the creative process rather than the products of this process (e.g., Alpaugh & Birren, 1977; Bromley, 1956; for a relevant review, see Kausler, 1991, pp. 619–625). Like the biographical research, this research has shown a decline in creativity with increasing age. Therefore, divergent thinking should also decline with increasing age (Kausler, 1991, p. 620). In agreement with this hypothesis, some research has shown that divergent thinking begins to decline in middle age (Alpaugh & Birren, 1977; Guilford, 1967; McCrea et al., 1987; Ruth & Birren, 1985). However, some other research has shown that the decline begins after middle age (Baltes & Lindenberger, 1997; Jaquish & Ripple, 1981; Schaie & Hertzog, 1983). In short, prior research had not settled the issue of how early in adulthood the decline begins (Denney, 1990). The fourth issue investigated here was how divergent thinking is related to gender. Gender differences were not assessed in any study we located, and although gender differences in creativity were assessed in several studies, the results have been inconsistent (Osborn, 1963, p. 22). Some researchers found no statistically signiŽ cant gender differences (Agarwal & Kumari, 1982; Alpaugh & Birren, 1977; Bromley, 1956; Jaquish & Ripple, 1981) and others found gender differences, sometimes favouring women (Bharadwaj, 1985) and sometimes favouring men (Ruth & Birren, 1985, but using a test evidently biased in favour of male-typical knowledge). The foregoing overviews indicate that prior research had not deŽ nitively established the dimensionality of divergent thinking nor its relations to other intellectual variables, age, and gender during adulthood. The present study was designed to provide evidence about these relations by assessing four divergent thinking variables, four other intellectual variables, and two possible moderator variables in women and men from four adulthood age periods. The four intellectual variables were selected to represent two intellectual ‘‘processes’’, one ‘‘dynamic resource’’, and one ‘‘structural resource’’ (Salthouse, 1985, 1988). The process variables were inductive reasoning, which is an index of  uid intelligence (or  uid mechanics— Baltes, 1993), and memory span, which is an index of ‘‘shortterm acquisition and retrieval’’ (Horn, 1978a, b). The dynamic resource variable was speed of mental processing (Horn, 1978a, b); and the structural resource variable was vocabulary, which indexes verbal knowledge or crystallised intelligence (or crystallised pragmatics—Baltes, 1993). The possible moderator variables were depression and amount of education, which have been shown to be related to cognitive performance (depression: e.g., La Rue, Dessonville, & Jarvik, 1985; Luszcz, Bryan, & Kent, 1997; education: e.g., Chi & Ceci, 1987) and which might Ž t the taxonomy of variables. Depression, or rather its absence, might be a kind of dynamic resource variable and education might index general knowledge, which is a kind of structural resource variable; because of these possible classiŽ cations—and for stylistic simplicity—we refer herein to depression and education as ‘‘intellectual’’ variables. Except for depression and perhaps education, these variables re ect various kinds of convergent thinking and therefore we expected them to be positively related to but factorially. independent of divergent thinking. This expectation was veriŽ ed in our study by exploratory factor analyses and multiple regression analyses. The taxonomy also turned out to be consistent with the data in some other respects indicated in the Discussion section.. Method Participants The research participants were from a large-scale crosssectional study of cognition conducted by Reese, Puckett, and Cohen in 1986–90. In this study, 400 adults were given a battery of 24 questionnaires, tests, and tasks divided equally between two sessions and given in a Ž xed order designed to minimise carry-over effects. The battery yielded scores on well over a hundred different variables. The participants were from four age cohorts deŽ ned by age at last birthday: 17–22, 40–50, 60–70, and 75 or more years old, here designated young, middle-aged, young-old, and old-old. The selection criteria were age and gender. Additional selection criteria would have been hearing, vision, reading, and health adequate for participation, but all except one of the volunteers met these criteria. The exception was a 99-year-old man who was included in the study despite visual problems; he was the oldest participant in the study and he took all the tests in the battery reported in this paper except Letter Sets (inductive reasoning) and Finding A’s (intellectual speediness), which required better vision than he had. No attempt was made to match the age/gender groups on education, health, or other variables that might in uence performance. The reason is that matching, or ‘‘control by equation’’ (Baltes, Reese, & Nesselroade, 1988, pp. 216–218; Bitterman, 1960), must yield samples that are not representative of one or more of the age/gender populations (Krauss, 1980).. Demographic variables Thirteen demographic variables were assessed via self-report (except where indicated otherwise in the following list) in a structured, face-to-face interview given as the Ž rst task in the Ž rst session. They are deŽ ned in the following list and the age group statistics for the 400 participants who took one or both of the divergent thinking tests are presented in Table 1. (a) Age in years (to two decimal places) at the Ž rst testing session was used for correlations of age with other variables. Age in years at last birthday was used for assignment to age group. (b) Gender (examiner’s report). (c) Current marital status. (d) Predominant marital status during adulthood. (e) Location of current residence (rural vs. urban). (f) Location of usual residence during the preceding 10 years (rural vs. urban). (g) and (h) Population (to nearest thousand according to a Rand–McNally atlas) of the Greater Metropolitan Area in which the participant (g) was currently residing and (h) had usually resided during the preceding 10 years (less than 500 was coded as 0, more than 998,499 was coded as 999)..

(3) INTERNATIONAL JOURNAL OF BEHAVIORAL DEVELOPMENT, 2001, 25 (6), 491–500. 493. Table 1 Demographic characteristics of the age groups Age group Variable. Young. Middle-aged. Young-old. Old-old. Sample size Age mean (years)a Age range (years)a Gender: % women. 100 20.2 17–23 50.0. 92 44.4 40–51 53.3. 113 66.0 60–71 55.8. 95 80.5 75–99 52.6. Current marital status (%) Single Married Divorced Widowed. 95 3 2 0. 8 66 25 1. 6 65 14 15. 7 42 6 45. Predominant marital status (%) Single Married Divorced Widowed. 98 2 0 0. 18 70 12 0. 8 80 8 4. 10 73 4 13. Residence location (%) Currently urban Usually urban. 93 83. 84 83. 91 91. 95 95. Populationb Current residence Usual residence. 16 33. 35 42. 46 49. 44 46. Current occupation (%) (1) Manager/Professional (2) Tech/Sales/Service (3) Worker (4) Student/Houseperson (5) Unemployed (6) Retired. 1 38 5 47 9 0. 22 36 12 14 15 1. 6 17 3 1 4 69. 3 6 0 0 0 91. Career occupation (%) (1) Manager/Professional (2) Tech/Sales/Service (3) Worker (4) Student/Houseperson. 1 14 1 84. 28 33 15 24. 38 32 17 13. 41 27 18 14. Drug status (%)c None Sedative Other Drug done meand Health index mean. 97 0 3 1.0 2.0. 94 4 2 1.2 2.1. 92 6 2 1.2 1.8. 95 3 2 1.0 1.8. Note: See text for deŽ nitions of nonobvious variables. a Age at Ž rst session. b Percentage of participants who were from urban areas with population greater than 250,000. c Percentage of participants per category. See Item (k) in the Method section for deŽ nitions. One young-adult record was eliminated because of examiner error. d Only for the 23 participants who reported possibly being currently affected by drugs. Possible range: 1 (‘‘A little’’) to 3 (‘‘A lot’’).. (i) Current and (j) career occupation. The categories used were: (1) Manager/Professional: Managerial & Professional Specialties (codes 3–199 in the Standard Occupational ClassiŽ cation Manual, 1980). (2) Technical/Sales/Service : Technical, Sales, & Administrative Support (codes 203–389) and Service (codes 403–469). (3) Worker: Farming, Forestry, & Fishing (codes 473–499), Precision Production, Craft, & Repair (codes 503–699), and Operators, Fabricators, and Laborers (codes 703–889). (4) Student/Houseperson : Full-time students and. otherwise unemployed part-time students (all were in the Young group) and otherwise unemployed housepersons (1 in the Young group for Current, none for Career). (5) Unemployed: Not working but seeking employment. (6) Retired: Not working and not seeking employment. (The last three categories are not coded in the Standard Occupational ClassiŽ cation Manual.) (k) Drugs taken and possibly affecting performance at the time of testing. The questionnaire included None and the.

(4) 494. REESE ET AL. / DIVERGENT THINKING IN ADULTHOOD. following categories and examples: (1) Sedatives: ‘‘Librium, Valium, etc.’’; (2) Alcohol: ‘‘beer, liquor, wine, etc.’’; (3) Tranquillisers: ‘‘Chlorpromazine, Haldol, etc.’’; (4) Sleeping pills: ‘‘Phenobarbital, Seconal, etc.’’; (5) Other: ‘‘Quaaludes, Marijuana, etc’’. Categories (2) through (5) are combined as ‘‘Other’’ in Table 1. (l) Drug dose (1 ˆ a little, 2 ˆ a moderate amount, 3 ˆ a lot). Table 1 gives data only for the 23 participants who reported being possibly affected by drugs at the time of testing. (m) Health index (0 ˆ poor, 1 ˆ fair, 2 ˆ good, 3 ˆ excellent). The health index was the mean of three items: ‘‘How would you rate your health?’’ (Excellent, Good, Fair, Poor); ‘‘How much concern do you have about your health?’’ (Not concerned, Mildly concerned, Concerned, Very much concerned); and ‘‘How impaired are you in your everyday activities because of your health?’’ (None, Little, Some, A lot). The data in Table 1 indicate that except for the gender distributions, the age groups were reasonably typical of the respective age-range populations. Details about residence and recruitment procedures are reported elsewhere (Reese, Lee, Cohen, & Puckett, 2000).. Other variables Four intellectual variables other than divergent thinking and two moderator variables were assessed. They are identiŽ ed in the following paragraphs and the mean scores of the age groups are presented in the Results section in the top panel in Table 4. (a) Inductive reasoning was assessed with the Letter Sets test (Session 1, Task 3), using the standard scoring procedure (Eckstrom, French, Harman, & Derman, 1976). This test consists of 15 items, each with Ž ve four-letter sets; in four sets the letters are combined consistently with a rule (different for each item) and in the other set the combination is inconsistent with this rule. The participant is asked to Ž nd the rule and to identify the set that does not Ž t. (b) Memory span was assessed with the forward and backward Digit Span tests from the Wechsler Adult Intelligence Scale–Revised (Session 1, Tasks 4 and 5), using the standard scoring procedure: 1 point for each correct trial, summed across the forward and backward tests (Wechsler, 1981). In our study the Pearson correlation between scores on the forward and backward tests was moderately strong, r ˆ .57, p < .0001, and although it increased across age groups, the increase was nonsigniŽ cant, r ˆ .46, .52, .59, .64, ps for adjacent age groups > .50, p for young versus old-old > .07. (c) Intellectual speediness was assessed with the Finding A’s test (Session 2, Task 1), using the standard scoring procedure (Eckstrom et al., 1976). This is a speed test in which the participant crosses out words that contain the letter ‘‘a’’; the test has two parts, each with a 2-minute time limit for assessing 820 words arranged on four pages with Ž ve 41-word columns per page. The participant is informed that each column contains Ž ve words to be crossed out. (d) Vocabulary was assessed with the vocabulary test from the WAIS-R (Session 1, Task 9), using the standard scoring procedure (Wechsler, 1981). (e) Depression was assessed with the Center for Epidemiological Studies Depression Scale (Session 2, Task 10), using the standard scoring procedure (U.S. Department of Health, Education and Welfare, 1980). This scale is believed to be valid in the normal (nonclinical depression) range.. (f) Education was self-reported in the demographic interview (Session 1, Task 1) and was coded in years: 1–12 years through high school (12 years assigned for high school diploma or equivalent) plus 1–4 years of undergraduate college education (4 years assigned for bachelor’s degree) plus 1–4 years of postgraduate education (4 years assigned for Ph.D., Ed.D., and M.D.; no participant had any other doctoral degree).. Divergent thinking variables The divergent thinking variables were obtained from two tests: word association and alternate uses. Eleven of the 400 participants did not take the word-association test and 8 did not take the alternate uses test, but all 400 took at least one of these tests. The variables assessed with these tests are identiŽ ed in the following paragraphs and the mean scores of the age groups are presented in the bottom panel in Table 4. (a) Associational  uency, or ‘‘verbal productive thinking’’ (Horn, 1978a, b), was assessed with a 12-item word-association test constructed for this study (Session 1, Task 2). The stimulus items, in order of presentation, were husband, answer, garden, hand, doctor, trouble, order, sweet, ofŽ ce, thief, problem, and table, each with a 30-second time limit. The criteria for selecting the items were high frequency, at least one paradigmatic and one syntagmatic association within the Ž rst six associates in the Postman (1970) or Palermo and Jenkins (1964) association norms, and at least Ž ve associates within the Ž rst 90% of the associates (i.e., the relative frequency accumulated over the Ž ve most frequent associates was 90% or less). Each stimulus item was read to the participant and was printed on a card that remained visible throughout the 30second response period. Responses were given orally and were tape recorded for later transcription. The score was the mean number of associations per item (total number of associations, divided by 12). For each item, only the Ž rst instance of a repeated association was counted. (b) Production  uency, (c)  exibility, and (d) originality were assessed with a two-item ‘‘alternate uses’’ test (Session 2, Task 5). In this test, the participants were asked to respond Ž rst to ‘‘coat hanger’’ and then to ‘‘brick’’, giving ‘‘unusual uses’’ without an effective time limit for either item. SpeciŽ cally, the participant was told, ‘‘I’m going to name an everyday object, and I’d like you to tell me as many unusual uses of the object you can think of’’. Three minutes were to be allowed for each item, with up to two prompts to continue if the participant stopped responding, but all participants received the two prompts and stopped responding a third time before three minutes had elapsed. The responses were tape recorded and later transcribed. Details of the scoring procedures are given elsewhere (Reese et al., 2000). Brie y, the gists of the transcribed responses and the superordinate categories of the gists were identiŽ ed and were counted to obtain, respectively, the  uency and  exibility scores. The total number of different gists identiŽ ed was 1127 for coat hanger and 947 for brick; the total number of different superordinate categories identiŽ ed was 14 for coat hanger and 16 for brick. Examples for coat hanger are the transcribed responses ‘‘Make an antenna for a car radio’’ and ‘‘Hook it up to the radio and use it as an antenna’’. The gists were identiŽ ed as ‘‘Car antenna’’ and ‘‘Radio antenna’’ and the superordinate category was identiŽ ed as ‘‘Equipment’’, which for a coat hanger was deŽ ned as an object that functions passively or that.

(5) INTERNATIONAL JOURNAL OF BEHAVIORAL DEVELOPMENT, 2001, 25 (6), 491–500. is acted on in the course of some use. Examples for brick are the transcribed responses ‘‘Use it to chock a car wheel’’ and ‘‘Put it behind a wheel or something, you know, to keep things from rolling’’. The gists were identiŽ ed as ‘‘Car chock’’ and ‘‘Keep things from rolling’’ and the category was identiŽ ed as ‘‘Instrument’’, which for a brick was deŽ ned as an object used to aid some action or used with some other object. Originality was scored on the basis of the statistical unusualness of subordinate-level categories (Mervis & Rosch, 1981) of the gists rather than on the basis of the statistical unusualness of the gists themselves, which we believed might be too closely associated with vocabulary size. The data conŽ rmed this belief and the effectiveness of our solution; as indicated later (in Table 3), vocabulary was signiŽ cantly related to production  uency, which is based on gists, and was not signiŽ cantly related to originality based on subordinate-level categories of gists. We used subordinate-level categories because superordinate categories are too general for assessing originality. Examples of subordinate-level categories are ‘‘Antenna’’ for ‘‘Car antenna’’ and ‘‘Radio antenna’’ and ‘‘Chock’’ for ‘‘Car chock’’ and ‘‘Keep things from rolling’’. The number of participants in the overall sample who used each subordinate-level category was counted and this number was assigned to each subordinate-level category that a participant used. The participant’s originality score was based on the sum of these numbers, divided by the number of subordinate-level categories the participant used. The score that was recorded and analysed was the complement of this quotient, so that higher scores indicated more originality.. Procedure The participants were tested individually in two sessions about two or three days apart (range ˆ 0 to 9 days); the means were 1.97, 2.42, 2.52, and 2.77 days for the respective age groups. On average, each session lasted about an hour or two (range ˆ 0.8 to 4.6 hours); the Session 1 means were 1.47, 1.57, 1.61, and 1.64 hours for the respective age groups and the Session 2 means were 1.54, 1.73, 1.80, and 1.79 hours (session durations were recorded for only about two-thirds of the participants). The only statistically signiŽ cant correlations of these procedural variables with the divergent thinking variables were negligible—Session 2 duration correlated ¡.184 (p < .004) with associational  uency and .148 (p < .020) with originality (largest other j r j ˆ .075, p > .24).. Results Because of the large sample size, the probability of a Type I error was set at .01 except for tests of simple effects, for which it was set at .05 (Reese, 1970).. Preliminary analyses Reliabilities of the divergent thinking measures. The scoring of production  uency and  exibility required some subjective coding decisions; therefore, the inter-scorer reliabilities (Pearson correlations) were assessed with a 22% sample of the protocols scored by independent scorers. For the coat hanger and brick items, respectively, they were .95 and .89 for production  uency and .88 and .90 for  exibility. The scoring of originality had a subjective aspect—. 495. identiŽ cation of the subordinate-level categories of the gists— but this aspect occurred in the development of a dictionary of subordinate-level categories. The dictionary (in Reese et al., 2000) was developed by a joint effort of the four investigators and a graduate research assistant. After the dictionary had been developed, the scoring of originality was completely objective because the dictionary gave the subordinate-level category for each of the 2074 gists that were identiŽ ed. Internal consistency reliabilities of the four divergent thinking measures were also assessed. The index used for associational  uency was Cronbach’s alpha based on the  uency scores counted separately for each of the 12 items; the index used for production  uency,  exibility, and originality was the Pearson correlation between the scores for the coat hanger and brick items, corrected with the Spearman–Brown formula. All of the obtained internal consistencies were statistically signiŽ cant (ps < .001). The internal consistencies for associational  uency (.93), production  uency (.83), and  exibility (.71) were high and fully adequate. The internal consistency for originality was low (.40), but still at a level judged to be adequate when sample sizes and group differences are large, as in the present study (Thorndike & Hagen, 1955, pp. 139–140). Thus, the tests provided internally consistent information, though less so for originality than for the other three divergent thinking variables. Dimensionality of divergent thinking. We used two steps to test the assumption that associational  uency and production  uency,  exibility, and originality are aspects of a single kind of thinking that is different from other intellectual abilities. In the Ž rst step, we ran an exploratory factor analysis (principal components with varimax rotation and Kaiser normalisation), which showed that the four putative divergent thinking variables constituted one factor and that the other six intellectual variables constituted other factors (for details, see Reese et al., 2000). Consistent with these results, hierarchical multiple regression analyses, summarised in the next subsection, showed that three of the four divergent thinking variables were signiŽ cantly but only moderately related to Ž ve of the other six intellectuals variables. In the second step, we tested the linearity and strength of relations among the divergent thinking variables, using hierarchical multiple regression analyses in which the age groups were combined and the linear, quadratic, and cubic components of each ‘‘independent’’ variable were entered in that sequence. The results are summarised in Table 2. All of the obtained correlations were positive, as expected, but not all were linear. (a) Associational  uency and (b) originality were linearly related to each of the other three divergent thinking variables, (c) production  uency was curvilinearly related to the other three, and (d)  exibility was linearly related to associational  uency and originality and curvilinearly related to production  uency. The presence of curvilinear relations indicates that these variables constitute separate dimensions of divergent thinking.. Relations of divergent thinking to other intellectual variables The linearity of relations among variables is often not tested in correlational research. However, testing it is important because although the usual index of relation—the Pearson correlation coefŽ cient—is a valid estimate of the accuracy of prediction.

(6) 496. REESE ET AL. / DIVERGENT THINKING IN ADULTHOOD. Table 2 Hierarchical regression tests of linearity of relations among the divergent thinking variables Criterion variable. Component. Relations with associational  uency Production  uency Flexibility Originality b Relations with production  uency Associational  uency Flexibility. Originality. Relations with  exibility Associational  uency Production  uency Originality Relations with originality Associational  uency Production  uency Flexibility. R. Increment in R2. F changea. Linear Linear Linear. .423 .451 .279. .179 .204 .078. 82.84 97.04 31.87. Linear Quadratic Linear Quadratic Cubic Linear Quadratic. .423 .462 .884 .906 .909 .465 .485. .179 .035 .782 .039 .006 .216 .019. Linear Linear Quadratic Linear. .451 .884 .895 .469. Linear Linear Linear. .279 .465 .469. df. p. 1, 379 1, 379 1, 379. .001 .001 .001. 82.48 16.82 1400.09 84.35 13.42 107.45 9.53. 1, 1, 1, 1, 1, 1, 1,. 379 378 390 389 388 390 389. .001 .001 .001 .001 .001 .001 .003. .204 .782 .019 .220. 97.04 1400.09 37.59 109.82. 1, 1, 1, 1,. 379 390 389 390. .001 .001 .001 .001. 078 .216 .220. 31.87 107.45 109.82. 1, 379 1, 390 1, 390. .001 .001 .001. Note: Data are included only for components that signiŽ cantly increased R2 (alpha ˆ .01). a F for increment in R2. b For the quadratic component, R ˆ .295; increment in R2 ˆ .009; p for increment in R2 ˆ .049.. whenever a linear prediction equation is used, it is a valid estimate of the strength of relation only if the true relation is linear (e.g., Blommers & Lindquist, 1960). In the present study, the linearity and strength of relations among the variables were tested with hierarchical multiple regression analyses in which the age groups were combined and the linear, quadratic, and cubic components of each independent variable were entered in that sequence. These analyses are summarised in the Ž rst six panels in Table 3. Depression was not signiŽ cantly related to any of the divergent thinking variables, but the other intellectual variables were signiŽ cantly related to all except originality. All of the signiŽ cant relations were moderate, linear, and positive. The strongest relations were for vocabulary (the mean of the signiŽ cant correlations was 0.309), followed closely by education (mean 0.275) and inductive reasoning (mean 0.273) and less closely by intellectual speediness (mean 0.210) and memory span (mean 0.186).. Relations of variables to age and gender Variables other than divergent thinking. The top panel in Table 4 shows the age group means on the six intellectual variables other than divergent thinking. The pairwise differences in this panel (and the bottom panel) were assessed with Fisher’s LSD test; the Newman–Keuls, Sheffe , and Tukey tests are more popular, but they are too conservative with respect to Type II errors (Reese, 1970). As can be seen, the main effect of age group was signiŽ cant for all six variables. Vocabulary and education peaked in middle-age and the means for the other four variables were highest in the young group and generally decreased steadily thereafter.. The main effect of gender was signiŽ cant only for depression (p < .0001); women had a higher mean (13.58) than men (9.28). However, the main effect of gender ‘‘approached’’ signiŽ cance for memory span, F(1, 392) ˆ 5.44, p < .021, favouring men (14.72 vs. 13.84), and for intellectual speediness, F(1, 391) ˆ 6.16, p < .014, favouring women (52.81 vs. 49.48) (smallest other p > .06). The age group by gender interaction was not signiŽ cant for any of the variables (smallest p > .10). Divergent thinking variables. The bottom panel in Table 3 shows hierarchical multiple regressions of the divergent thinking variables on age. As can be seen, associational  uency was signiŽ cantly related to the linear component of age and had virtually no relation to the quadratic component of age. In contrast, production  uency,  exibility, and originality had no signiŽ cant relation to the liner component of age but were signiŽ cantly related to the quadratic component of age. The least-squares regression equations—linear for associational  uency and curvilinear for the other variables—are shown graphically in Figure 1, with divergent thinking scores transformed into standard scores (M ˆ 50, SD ˆ 10). As can be seen, the regression line for production originality was somewhat different from the lines for production  uency and  exibility, which were virtually identical, and all three of these lines re ect stronger age differences than the straight line for associational  uency. To assess the joint effects of age and gender on divergent thinking, we began with a multivariate analysis of variance including all four divergent thinking variables. This analysis revealed signiŽ cant main effects of age group and gender and.

(7) 497. INTERNATIONAL JOURNAL OF BEHAVIORAL DEVELOPMENT, 2001, 25 (6), 491–500. Table 3 Hierarchical regression tests of linearity of relations of the six intellectual variables and age with the four divergent thinking variables Criterion variable. Component. R. Increment in R2. F changea. Relations with inductive reasoning Associational  uency Production  uency Flexibility Originality. Linear Linear Linear Linear. .280 .256 .281 .064. .078 .066 .079 .004. 31.63 26.40 32.08 1.54. 1, 1, 1, 1,. 372 375 375 375. .001 .001 .001 .22. Relations with memory span Associational  uency Production  uency Flexibility Originality. Linear Linear Linear Linear. .177 .181 .199 .018. .031 .033 .040 .000. 12.48 13.27 16.14 < 1.00. 1, 1, 1, 1,. 387 390 390 390. .001 .001 .001 .73. Relations with intellectua l speediness Associational  uency Production  uency Flexibility Originality. Linear Linear Linear Linear. .277 .172 .180 .101. .077 .029 .033 .010. 32.19 11.81 13.10 4.00. 1, 1, 1, 1,. 386 389 389 389. .001 .001 .001 .05. Relations with vocabulary Associational  uency Production  uency Flexibility Originality. Linear Linear Linear Linear. .312 .284 .332 .058. .097 .081 .110 .003. 40.60 33.28 46.97 1.29. 1, 1, 1, 1,. 376 379 379 379. .001 .001 .001 .26. Relations with depression Associational  uency Production  uency Flexibility Originality. Linear Linear Linear Linear. .050 .058 .057 .023. .002 .003 .003 .001. < 1.00 1.31 1.26 < 1.00. 1, 1, 1, 1,. 381 384 384 384. .34 .26 .27 .66. Relations with education Associational  uency Production  uency Flexibility Originality. Linear Linear Linear Linear. .335 .235 .255 .042. .112 .053 .065 .002. 48.93 22.77 27.20 < 1.00. 1, 1, 1, 1,. 387 390 390 390. .001 .001 .001 .42. Linear Quadratic Linear Quadratic Linear Quadratic Linear Quadratic. .131 .134 .070 .229 .095 .235 .090 .162. .017 .001 .005 .052 .009 .055 .008 .026. 6.71 < 1.00 1.90 19.52 3.59 19.00 3.16 7.30. 1, 1, 1, 1, 1, 1, 1, 1,. 387 386 390 389 390 389 390 389. .010 .56 .17 .001 .06 .001 .08 .007. Relations with age Associational  uency Production  uency Flexibility Originality. df. p. Note: Data for linear component are included regardless of statistical signiŽ cance. Data for quadratic and cubic components are included only if increment in R2 was signiŽ cant (alpha ˆ .01), except for quadratic component of age (bottom panel).. no signiŽ cant age group by gender interaction: respectively, Pillai’s trace ˆ 0.139, 0.041, 0.033; multivariate F(12, 1125; 4, 373; 12, 1125) ˆ 4.54, 3.99, 1.03; p < .001, < .004, > .41. In follow-up analyses, each divergent thinking variable was analysed in a separate univariate analysis of variance with age group and gender as independent variables. The univariate analyses of variance revealed signiŽ cant main effects of age group for production  uency and  exibility, but not for originality and associational  uency (production  uency: F(3, 384) ˆ 7.63, p < .001;  exibility: F(3, 384) ˆ 7.73, p < .001; originality: F(3, 384) ˆ 3.38, p < .019; associational  uency; F(3, 381) ˆ 2.79, p ˆ .041). For both of. the latter variables, however, the main effect of age group met a lenient criterion of signiŽ cance (alpha ˆ .05) and the regression analysis (Table 3) indicated strictly signiŽ cant relations to age. We therefore analysed the simple effects for these variables as well as for production  uency and  exibility. The age group means are shown in the bottom panel in Table 4. As can be seen, the young group exhibited more associational  uency than the other age groups, but the difference was signiŽ cant only for the young versus old-old contrast. The table also shows that production  uency,  exibility, and originality were greatest in the middle-aged group and least in the old-old group, but that not all of the.

(8) 498. REESE ET AL. / DIVERGENT THINKING IN ADULTHOOD. Table 4 Age group means (and standard deviations) on the intellectual and divergent thinking variables Age group Variable Intellectual variables Inductive reasoning Memory span Intellectual speediness Vocabulary Depressiona Education (years) Divergent thinking variables Associational  uencyb Production  uency Flexibility Originalityb. Young. Middle-aged. Young-old. Old-old. p. 20.08x (5.18) 15.74xy (3.90) 57.40x (14.15) 49.63xy (12.40) 14.73x yz (8.95) 13.19 (1.71). 17.09x (5.58) 14.49x (4.06) 54.30y (13.83) 56.38x z (11.49) 11.05x (10.30) 14.03x (2.82). 12.39x (5.78) 14.30y (3.74) 48.73x yz (12.56) 54.11y (13.64) 9.61y (7.24) 13.68y (3.11). 7.16x (4.06) 12.60x y (3.85) 44.14xyz (13.11) 52.16z (13.27) 10.32z (8.10) 12.63x y (4.06). .0001. 6.43x (2.38) 5.66x (3.84) 3.56x (1.63) 17.82x (38.2). 6.20 (2.11) 7.35xy (4.51) 4.21xy (1.69) 22.22y (29.1). 6.08 (1.98) 6.30y (3.28) 3.70y (1.31) 20.38z (29.7). 5.60x (2.02) 4.91y (2.52) 3.18y (1.15) 7.90x yz (37.8). .041. .0001 .0001 .004 .0001 .010. .0001 .0001 .019. Note: (1) Means with the same superscript letter within a row were signiŽ cantly different from each other (alpha < .05). (2) The last column contains the probability of the main effect of age group in age group £ gender analyses of variance. (3) Each age group mean is the mean of the male and female subgroup means, unweighted by subgroup size. (4) Standard deviations are in parentheses. a High score indicates strong depression (maximum ˆ 60). b The tests of simple effects were statistically unjustiŽ ed because the main effect was nonsigniŽ cant.. pairwise differences were signiŽ cant. For production  uency and  exibility, (a) the middle-aged group had signiŽ cantly higher means than each of the other age groups and (b) the young-old group had signiŽ cantly higher means than the oldold group, but (c) the young group was signiŽ cantly different from only the middle-aged group. For originality, the old-old group had a signiŽ cantly lower mean than each of the other age groups, which did not differ signiŽ cantly from one another. The univariate analyses of variance also revealed that the main effect of gender was not signiŽ cant for any variable, although it met a lenient criterion of signiŽ cance for associational  uency, on which women outscored men (6.32 vs. 5.79), F(1, 381) ˆ 6.16, p < .014; smallest other p > .38. The age group by gender interaction was nonsigniŽ cant in all four analyses, smallest p > .15.. Discussion This study dealt with the nature of divergent thinking in adulthood and its relation to other intellectual variables, age, and gender. These issues are discussed in that order.. Dimensions of divergent thinking Our results are consistent with the implication of Goff’s (1992) study that divergent thinking consists of separate dimensions. On the one hand, our exploratory factor analyses (Reese et al., 2000) showed that originality was a dimension of divergent thinking, not only in the combined age groups but also in each. of the separate age groups. Also, like production  uency and  exibility it was curvilinearly related to age (Table 3). On the other hand, it was different from the other dimensions of divergent thinking: Unlike the other dimensions, it was not signiŽ cantly correlated with any of the six other intellectual variables (Table 3) and unlike production  uency and  exibility, it exhibited only a ‘‘marginally’’ signiŽ cant main effect of age group in the age group by gender analyses of variance (Table 4).. Relations to other intellectual variables As expected, divergent thinking was found to be different from the other intellectual variables but related to them. The strongest relations of divergent thinking were with the ‘‘structural resource’’ variables—vocabulary and perhaps education—for which the mean of the signiŽ cant correlations (Table 3) was .292, and the two ‘‘process’’ variables: inductive reasoning and memory span (mean 0.229). The relations with the ‘‘dynamic resource’’ variables were weaker. Intellectual speediness had some relation (mean 0.210); but depression, the absence of which we tentatively classiŽ ed in this category, was not signiŽ cantly related to divergent thinking. The last result was unexpected, but its generality is as yet unknown. Lewinsohn, Seeley, Roberts, and Allen (1997) found no relation of depression to a composite of cognitive tests in older adults (50–96 years), but Luszcz et al. (1997) obtained signiŽ cant relations to memory abilities in very old adults (70–96 years)..

(9) INTERNATIONAL JOURNAL OF BEHAVIORAL DEVELOPMENT, 2001, 25 (6), 491–500. 499. Figure 1. Plots of regressions of divergent thinking on age. The divergent thinking scores were standardised with means of 50 and standard deviations of 10; the curves were derived from statistically significant components of age (Table 3) as predictors in least-squares regression equations—linear for associational fluency and curvilinear for production fluency, flexibility, and originality.. Relations to Age We found marked age group differences in divergent thinking as re ected by production  uency and  exibility, but not as re ected by originality and associational  uency, for which the main effect of age group did not meet our conservative criterion of signiŽ cance (Table 4). However, both of the latter variables were positively and signiŽ cantly correlated with age (Table 3). Production  uency,  exibility, and originality were curvilinearly related to age, but associational  uency was linearly related to age (Tables 3 and 4). Baltes and Lindenberger (1997) also obtained a curvilinear relation of associational  uency to age in a sample comparable to ours in size (N ˆ 315) and age range (25–101 years) but different in nationality (German) and—presumably more importantly— with different measures of associational  uency (Baltes and Lindenberger did not assess divergent production). For production  uency,  exibility, and originality, two major kinds of age group differences emerged: First, the middle-aged group had the largest mean on these variables, although not signiŽ cantly larger in some comparisons; and second, the oldold group had the lowest mean on these variables, although not signiŽ cantly lower in some comparisons. The curves for production  uency,  exibility, and originality (Figure 1) show these age differences very clearly. The peaking of divergent thinking in middle age is consistent with the Ž ndings of Jaquish. and Ripple (1981), and the decline after middle age is in addition consistent with the Ž ndings of Lehman (1953), Guilford (1967), Alpaugh and Birren (1977), and McCrae et al. (1987). Given that  uid intelligence increases until early middle age and then declines (e.g., Schaie & Labouvie-Vief, 1974), the age trends might suggest that divergent thinking is a kind of  uid intelligence. We included only one marker of  uid intelligence—inductive reasoning—and inconsistent with this suggestion, it was somewhat less strongly correlated with divergent thinking than was crystallised intelligence (indexed by vocabulary).. Relations to gender Some previous research indicated gender differences in verbal creativity, especially for young participants. In the present study, however, gender had no signiŽ cant effect on any divergent thinking variable, although it ‘‘approached’’ signiŽ cance on associational  uency (p < .014). The interaction between gender and age group did not even approach signiŽ cance for any variable. Thus, in the heterogeneous population that was sampled in the present study, gender is evidently not an important determinant of divergent thinking and not an important moderator of the effect of age on divergent thinking..

(10) 500. REESE ET AL. / DIVERGENT THINKING IN ADULTHOOD. Conclusions Measures of divergent thinking consist of at least three dimensions, or outcome variables— uency,  exibility, and originality. Fluency and  exibility are highly correlated with each other and only moderately correlated with originality; therefore,  uency and  exibility presumably re ect mental operations that are at least highly similar and different from the mental operations underlying originality. Whatever these operations are, they evidently correlate moderately with structural resource variables and process variables, and less so with dynamic resource variables. This generalisation seems to be valid, at least with respect to the variables assessed in this study, because the sample size was relatively large and the demographics of the age-group samples were representative of the respective age-group populations. Gender differences in divergent thinking are evidently negligible, but age-group differences are large. The age-group similarities and differences obtained in this study suggest that the operations underlying divergent thinking are the same at all adult ages but vary with age in how effectively or efŽ ciently they are used. SpeciŽ cally, effectiveness or efŽ ciency peaks in middle age and declines markedly especially in the later portion of old age. The decline in old age is expectable, given its ubiquity in other research; but the peak in middle age is an important Ž nding because except for vocabulary, which is a structural resource variable, most other cognitive variables exhibit statistically signiŽ cant peaks in early adulthood, as in this study. Manuscript received October 1999 Revised manuscript received May 2000. References Agarwal, S., & Kumari, S. (1982). A correlationa l study of risk-taking and creativity with special reference to sex differences. Indian Educational Review, 17, 104–110. Alpaugh, P.K., & Birren, J.E. (1977). Variables affecting creative contribution s across the adult life span. Human Development, 20, 240–248. Baltes, P.B. (1993). The aging mind: Potential and limits. The Gerontologist, 33, 580–594. Baltes, P.B., & Lindenberger , U. (1997). Emergence of a powerful connectio n between sensory and cognitive functions across the adult life span: A new window to the study of cognitive aging? Psychology and Aging, 12, 12–21. Baltes, P.B., Reese, H.W., & Nesselroade, J.R. (1988). Life-span developmental psychology: Introduction to research methods. Hillsdale, NJ: Erlbaum. Barron, F., & Harrington, D.M. (1981). Creativity, intelligence , and personality. Annual Review of Psychology, 32, 439–476. Bharadwaj, R. (1985). Intelligence , sex, and age as correlates of the components of creativity. Asian Journal of Psychology and Education, 16, 41–44. Bitterman, M.E. (1960). Toward a comparative psychology of learning. American Psychologist, 15, 704–712. Blommers, P., & Lindquist, E.F. (1960). Elementary statistical methods in psychology and education. Boston, MA: Houghton Mif in. Botwinick, J. (1984). Aging and behavior: A comprehensive integration of research Ž ndings (3rd ed.). New York: Springer. Bromley, D.B. (1956). Some experimental tests of the effect of age on creative intellectua l output. Journal of Gerontology, 11, 74–82. Chi, M.T.H., & Ceci, S.J. (1987). Content knowledge: Its role, representation, and restructuring in memory development. In H.W. Reese (Ed.), Advances in child development and behavior (Vol. 20, pp. 91–142). Orlando, FL: Academic Press. Denney, N.W. (1990). Adult age difference s in traditional and practical problem solving. In E.A. Lovelace (Ed.), Aging and cognition: Mental processes, selfawareness and interventions (pp. 329–349). Amsterdam: North-Holland. Dennis, W. (1966). Creative productivity between the ages of 20 and 80 years. Journal of Gerontology, 21, 1–8. Eckstrom, R.B., French, J.W., Harman, H., & Derman, D. (1976). Kit of factorreferenced cognitive tests, 1976 revision. Princeton, NJ: Educationa l Testing Service.. Gilhooly, K.J. (1988). Thinking: Directed, undirected and creative (2nd ed.). London: Academic Press. Goff, K. (1992). Enhancing creativity in older adults. Journal of Creative Behavior, 26, 40–49. Guilford, J.P. (1967). The nature of human intelligence. New York: McGraw-Hill. Holman, J., Goetz, E.M., & Baer, D.M. (1977). The training of creativity as an operant and an examination of its generalization characteristics . In B.C. Etzel, J.M. LeBlanc, & D.M. Baer (Eds.), New developments in behavioral research: Theory, method, and application (pp. 441–471). Hillsdale, NJ: Erlbaum. Horn, J.L. (1978a). Human ability systems. In P.B. Baltes (Ed.), Life-span development and behavior (Vol. 1, pp. 211–256). New York: Academic Press. Horn, J.L. (1978b). The nature and development of intellectua l abilities. In R.T. Osborne, C.E. Noble, & N. Weyl (Eds.), Human variation: The biopsychology of age, race, and sex (pp. 107–136). New York: Academic Press. Jaquish, G.A., & Ripple, R.E. (1981). Cognitive creative abilities and self-esteem across the adult life-span. Human Development, 24, 110–119. Kausler, D.H. (1991). Experimental psychology, cognition, and human aging (2nd ed.). New York: Springer. Krauss, I.K. (1980). Between- and within-group comparisons in aging research. In L.W. Poon (Ed.), Aging in the 1980s: Psychological issues (pp. 542–551). Washington, DC: American Psychological Association. La Rue, A., Dessonville, C., & Jarvik, L.F. (1985). Aging and mental disorders. In J.E. Birren & K.W. Schaie (Eds.), Handbook of the psychology of aging (pp. 664–702). New York: Van Nostrand Reinhold. Lehman, H.C. (1953). Age and achievement. Princeton , NJ: Princeton University Press. Lewinsohn, P.M., Seeley, J.R., Roberts, R.E., & Allen, N.B. (1997). Center for Epidemiologic Studies Depression Scale (CES-D) as a screening instrument for depression among community-residing older adults. Psychology and Aging, 12, 277–287. Luszcz, M.A., Bryan, J., & Kent, P. (1997). Predicting episodic performance of very old men and women: Contribution s from age, depression, activity, cognitive ability, and speed. Psychology and Aging, 12, 340–351. McCrae, R.R., Arenberg, D., & Costa, P.T., Jr. (1987). Declines in divergent thinking with age: Cross-sectional, longitudinal , and cross-sequential analysis. Psychology and Aging, 2, 130–137. Meadow, A., Parnes, S.J., & Reese, H. [W.] (1959). In uence of brainstorming instructions and problem sequence on a creative problem solving test. Journal of Applied Psychology, 43, 413–416. Mervis, C.B., & Rosch, E. (1981). Categorizatio n of natural objects. Annual Review of Psychology, 32, 89–115. Osborn, A.F. (1963). Applied imagination: Principles and procedures of creative problem-solving (3rd rev. ed.). New York: Scribner’s. Palermo, D.S., & Jenkins, J.J. (1964). Word association norms: Grade school through college. Minneapolis, MN: University of Minnesota Press. Postman, L. (1970). The California norms: Association as a function of word frequency. In L. Postman & G. Keppel (Eds.), Norms of word association (pp. 241–320). New York: Academic Press. Reese, H.W. (1970). Multiple comparison methods. American Psychologist, 25, 365–366. Reese, H.W., Lee, L.-J., Cohen, S.H., & Puckett, J.M., Jr. (2000). Effects of intelligence, age, and sex on divergent thinking in adulthood. Unpublished paper, West Virginia University, Morgantown, WV. Ruth, J.E., & Birren, J.E. (1985). Creativity in adulthood and old age: Relations to intelligence , sex, and mode of testing. International Journal of Behavioral Development, 8, 99–109. Salthouse, T. [A.] (1985). A theory of cognitive aging. Amsterdam: NorthHolland. Salthouse, T.A. (1988). Resource-reductio n interpretations of cognitive aging. Developmental Review, 8, 238–272. Schaie, K.W., & Hertzog, C. (1983). Fourteen-yea r cohort-sequentia l analyses of adult intellectua l development. Developmental Psychology, 19, 531–543. Schaie, K.W., & Labouvie-Vief , G. (1974). Generational versus ontogeneti c components of change in adult cognitive behavior: A fourteen-yea r crosssequential study. Developmental Psychology, 10, 305–320. Simonton, D.K. (2000). Creativity: Cognitive, personal, developmental, and social aspects. American Psychologist, 55, 151–158. Standard occupational classiŽ cation manual (1980). Washington, DC: U.S. Department of Commerce, OfŽ ce of Federal Statistical Policy and Standards. Sternberg, R.J. (1985). Implicit theories of intelligence , creativity, and wisdom. Journal of Personality and Social Psychology, 49, 607–627. Thorndike, R.L., & Hagen, E. (1955). Measurement and evaluation in psychology and education. New York: Wiley. U.S. Department of Health, Education and Welfare. (1980). Basic data on depressive symptomatology, United States, 1974–75. Vital and Health Statistics-Series 11, No. 216. Hyattsville, MD: Department of Health, Education and Welfare. Wechsler, D. (1981). WAIS-R manual: Wechsler Adult Intelligence Scale—Revised. New York: Psychological Corporation..

(11)

(12)

參考文獻

相關文件

Dan-Gui finished Savoring the Mountains from a Boat in Yangshuo in middle age and therefore, the collection was not incorporated in his other two publications called

If the students are very bright and if the teachers want to help prepare these students for the English medium in 81, teachers can find out from the 81 curriculum

volume suppressed mass: (TeV) 2 /M P ∼ 10 −4 eV → mm range can be experimentally tested for any number of extra dimensions - Light U(1) gauge bosons: no derivative couplings. =&gt;

We have also discussed the quadratic Jacobi–Davidson method combined with a nonequivalence deflation technique for slightly damped gyroscopic systems based on a computation of

On the other hand, his outstanding viewpoint of preserving the pureness of the ch'an style of ancient masters, and promoting the examination of the state of realization by means

On the other hand, as prices rose in Summer clothing and footwear, rent and interior decoration, the indices of Clothing and footwear, and Rent and housing expenses increased 0.68%

On the other hand, the pre-Lunar New Year Sale on clothing, falling price in fresh pork and a waiver of welfare housing rentals by the Housing Institute for the first quarter of

On the other hand, rising prices in new arrivals of summer clothing, men’s and women’s footwear and the expiry of waiver of welfare housing rentals by the Housing Institute after