0.0447 −0.0068 0.0183 −1.8387 2.1370 −0.2239 −0.0006 −0.0069
−0.4135 0.0187 −0.0283 −0.6461 −0.8190 −2.5961 0.0016 −0.0118 0.5810 −0.7941 0.3617 1.8885 1.4977 −1.0446 −0.0084 −0.0136
−2.6638 0.3541 0.4499 0.5339 0.5253 0.1233 −0.0120 0.0140
−0.5402 −1.1908 −2.5037 0.0863 0.1083 0.0491 −0.0054 0.0003
−0.3187 −2.4136 1.1819 −0.5854 −0.4815 0.3180 −0.0100 0.0123
−0.0086 −0.0105 0.0014 0.0061 0.0075 −0.0032 2.7846 0.4957 0.0176 0.0070 −0.0058 0.0008 0.0073 −0.0181 −0.4956 2.7845
8. These points are different from the original star points of the spherical CCD clearly.
• n0 = 4
When n0 = 4, the sixteen locally D-optimal star points are
±
−0.1154 0.0969 0.1144 −0.1490 −0.0345 2.8179 −0.0006 −0.0069 1.1404 −0.6068 1.0294 −1.9710 1.1759 −0.0641 0.0016 −0.0118 2.1037 −1.2997 −0.0935 1.0461 −0.8659 0.1793 −0.0084 −0.0136 0.7290 0.4968 −2.5103 −0.9406 0.1742 0.0671 −0.0120 0.0140 0.8122 1.8104 0.7427 −0.7243 −1.7241 −0.1185 −0.0054 0.0003
−1.0341 −1.5520 −0.2541 −1.2607 −1.6921 −0.0660 −0.0100 0.0123 0.0090 −0.0041 −0.0079 −0.0045 −0.0103 0.0022 2.7896 0.4669 0.0141 −0.0039 0.0191 0.0075 0.0091 0.0071 −0.4668 2.7895
8. These points are different from the original star points of the spherical CCD clearly.
4.3 Comparison with Spherical CCD
We employ the relative locally D-efficiency in (1) to compare our conditionally locally D-optimal central composite designs and the spherical CCD’s. The relative locally D-efficiency of our conditionally locally D-optimal central composite design
and spherical CCD is defined as det¡
Mb−1(ξD∗)¢ det¡
Mb−1(ξCCD)¢,
where ξD∗ is our conditionally locally D-optimal central composite design with respect to b(0) and ξCCD is the spherical CCD . If the relative locally D-efficiency is less than 1, our conditionally locally D-optimal central composite design is better than the corresponding spherical CCD. That is the lower relative locally D-efficiency is, the better our conditionally locally D-optimal central composite design we get. Based on the different first-order design with n0 center points, the relative locally D-efficiencies are shown as follows. For each k, we have tried the cases of different b(0) by choosing values of R and angels φj, j = 1, · · · , k − 1. Given a first-order design (included the factorial design and n0 center points) and R, the best and the worst values of the relative locally D-efficiencies are shown in Tables 2 to 9. The results based on full factorial designs are in Tables 2 to 5, and the results in Tables 6 to 9 are the cases that we choose fractional factorial designs in the first-order designs.
R\k 2 3 4 5 6 7 8
0.25√
k 0.9920 0.9847 0.9777 0.9698 0.9595 0.9546 0.9516 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.9423 0.9070 0.8870 0.8727 0.8686 0.8657 0.8689 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.8935 0.8436 0.8241 0.8137 0.8152 0.8230 0.8357 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.8618 0.8072 0.7903 0.7839 0.7888 0.8032 0.8215 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) Table 2. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 1 and 2kfull factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest rel-ative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
R\k 2 3 4 5 6 7 8 0.25√
k 0.9965 0.9919 0.9874 0.9829 0.9775 0.9721 0.9681 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.9668 0.9439 0.9275 0.9148 0.9068 0.9011 0.9047 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.9314 0.8979 0.8782 0.8684 0.8624 0.8589 0.8748 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.9066 0.8685 0.8503 0.8432 0.8392 0.8336 0.8598 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) Table 3. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 2 and 2kfull factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest rel-ative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
R\k 2 3 4 5 6 7 8
0.25√
k 0.9977 0.9948 0.9920 0.9888 0.9848 0.9799 0.9703 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.9767 0.9581 0.9447 0.9321 0.9266 0.9203 0.9194 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.9493 0.9225 0.9044 0.8907 0.8851 0.8802 0.8910 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.9288 0.8981 0.8800 0.8695 0.8631 0.8565 0.8773 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) Table 4. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 3 and 2kfull factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest rel-ative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
R\k 2 3 4 5 6 7 8 0.25√
k 0.9978 0.9960 0.9934 0.9908 0.9884 0.9840 0.9752 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.9768 0.9661 0.9453 0.9420 0.9377 0.9307 0.9292 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.9591 0.9349 0.9198 0.9044 0.9033 0.8985 0.9012 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.9417 0.9151 0.8978 0.8859 0.8842 0.8720 0.8892 (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) (1.0000) Table 5. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 4 and 2kfull factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest rel-ative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
R\k 5(25−1V ) 6(26−1V I ) 7(27−1V II) 8(28−2V ) 0.25√
k 0.9695 0.9610 0.9531 0.9484 (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.8682 0.8567 0.8459 0.8330 (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.8043 0.7957 0.7914 0.7806 (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.7706 0.7645 0.7639 0.7524 (1.0000) (1.0000) (1.0000) (1.0000)
Table 6. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 1 and fractional factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest relative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
R\k 5(25−1V ) 6(26−1V I ) 7(27−1V II) 8(28−2V ) 0.25√
k 0.9844 0.9814 0.9747 0.9717 (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.9106 0.9071 0.8945 0.8880 (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.8616 0.8584 0.8488 0.8427 (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.8371 0.8333 0.8278 0.8198 (1.0000) (1.0000) (1.0000) (1.0000)
Table 7. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 2 and fractional factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest relative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
R\k 5(25−1V ) 6(26−1V I ) 7(27−1V II) 8(28−2V ) 0.25√
k 0.9910 0.9872 0.9822 0.9803 (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.9429 0.9293 0.9175 0.9130 (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.9007 0.8884 0.8771 0.8736 (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.8779 0.8666 0.8569 0.8535 (1.0000) (1.0000) (1.0000) (1.0000)
Table 8. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 3 and fractional factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest relative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
R\k 5(25−1V ) 6(26−1V I ) 7(27−1V II) 8(28−2V ) 0.25√
k 0.9932 0.9902 0.9861 0.9844 (1.0000) (1.0000) (1.0000) (1.0000) 0.5√
k 0.9536 0.9417 0.9303 0.9270 (1.0000) (1.0000) (1.0000) (1.0000) 0.75√
k 0.9173 0.9054 0.8944 0.8914 (1.0000) (1.0000) (1.0000) (1.0000)
√k 0.8915 0.8861 0.8763 0.8739
(1.0000) (1.0000) (1.0000) (1.0000)
Table 9. The relative locally D-efficiencies of our conditionally locally D-optimal cen-tral composite designs and the spherical CCD’s for n0 = 4 and fractional factorial design as the first-order design. In parentheses, the values, 1.0000, which indicate the highest relative locally D-efficiencies show our conditionally locally D-optimal central composite designs never work worse than the spherical CCD’s.
From above tables, our composite designs usually perform better than spherical CCD’s.
We also can identify that when φj = 0, j = 1, · · · , k − 1, i.e. the extremum point, b(0) = (0, · · · , 0, R), is the axial point, spherical CCD’s are also the best designs we are looking for. When R increases, the relative locally D-efficiencies decrease. Roughly the relative locally D-efficiencies decrease when k increases. Based on the same R and k, roughly the relative locally D-efficiencies of the fractional factorial designs (Tables 6 to 9) in the first-order design are lower than the full factorial designs (Tables 2 to 5) in the first-order design. The relative locally D-efficiencies are lower for the cases with fewer center points. Thus given small number of center points and a possible extremum point, locally D-optimal criterion should be adopted to search the possible additional star points to improve the coefficient estimation.
5 Conclusion
In this thesis, we study that which 2k additional experimental points, i.e. star points, should be added when the first-order design and center points are given. Fol-lowing the same structure of CCD, we find the symmetric and orthogonal 2k additional star points according to the locally D-optimal criterion. Because the design space can be described as a k-ball, we employ the polar coordinates to represent all experimental points. Then we rewrite the star points in terms of Givens rotation matrix. Hence our goal is transferred into an optimization problem. When k is larger, a simulated annealing algorithm, the Best Angles and Radius sampler, is employed to find the 2k star points numerically. In Section 4, based on the different first-order designs, the details are discussed and given a comparison with the spherical CCD’s.
References
[1] Box, G. E. P. and Hunter, J. S. (1957). Multi-factor Experimental Designs for Exploring Response Surfaces. The Annals of Mathematical Statistics, 28, 195-241.
[2] Box, G. E. P. and Wilson, K. B. (1951). On the Experimental Attainment of Optimum Conditions. Journal of the Royal Statistical Society, Ser. B, 13, 1-45.
[3] Chen, R.-B. and Lin, D. K. J. (2009). Conditionally Optimal Star Points in Central Composite Designs for Response Surface Methodology. Submitted.
[4] Cheng, R. C. H., Melas, V. B., and Pepelyshev, A. N. (2000). Optimal design for evaluation of an extremum point. In: Atkinson, A., Bogacka, B., and Zhigljavsky, A. (eds), Optimum Design 2000, Kluwer, 15-24.
[5] Melas, V. B., Pepelyshev, A. N., and Cheng, R. C. H. (2003). Designs for estimat-ing an extremal point of quadratic regression models in a hyperball. Metrika, 58.
193-208.
A Appendix: The Proof of Theorem
Suppose the first-order design contains a 2k full factorial design and n0 center points. Let b(0) be the given extremum point and s∗1, · · · , s∗2k be the star points of the locally D-optimal design, ξ∗D, for b(0). There exist a vector fb(0) = (bf(0)1 ,bf(0)2 , · · · ,bf(0)k ) with bf(0)i ≥ 0, i = 1, 2, · · · , k, and the corresponding fsm, m = 1, 2, · · · , 2k, such that ³
bf(0)´T
= G¡ b(0)¢T
and (fsm)T = G (s∗m)T, where G = G(ϑ), ϑ = (ϑ12, · · · , ϑ1k, ϑ23, · · · , ϑ2k, · · · , ϑ(k−1)k), is the rotation matrix and can be represented as the prod-uct of the Givens rotation matrices, Q
1≤i<j≤kGij(ϑij), with ϑij ∈ (π2)n, n ∈ Z. Then e
s1, · · · , fs2k are the additional star points of the locally D-optimal design for fb(0).
<proof>
In our design, we fix the supports of the first-order design on particular positions before adding star points. If we want to keep the supports of the first-order design after rotation, ϑij should be suggested as a value which belongs to a multiple of π2.
Let
ξD∗ =
0 , c1 , · · · , c2k , s∗1 , · · · , s∗2k n0/n , 1/n , · · · , 1/n , 1/n , · · · , 1/n
and
ξ =e
0 , ec1 , · · · , ec2k , es∗1 , · · · , es∗2k n0/n , 1/n , · · · , 1/n , 1/n , · · · , 1/n
,
where eci = Gci, i = 1, · · · , 2k and the set {c1, · · · , c2k} is equal to the set {ec1, · · · , ec2k}.
According to ξD∗ is the conditionally locally D-optimal design for b(0), we want to show ξ is the conditionally locally D-optimal design for fe b(0). First, consider the original notation,
fb(0)(x) = (fbT(0)(1)(x), fbT(0)(2)(x))T, where
fbT(0)(1)(x) = ((b(0)1 − x1), · · · , (b(0)k − xk)),
fbT(0)(2)(x) = ((b(0)1 − x1)2, · · · , (b(0)k − xk)2, 2(b(0)1 − x1)(b(0)2 − x2), · · · , 2(b(0)1 − x1)(b(0)k − xk), 2(b(0)2 − x2)(b(0)3 − x3), · · · , 2(b(0)2 − x2)(b(0)k − xk), · · · , 2(b(0)k−1− xk−1)(b(0)k − xk), 1),
and
M1(ξD∗) = R
fb(0)(1)(x)fbT(0)(1)(x)ξ∗D(dx), M2(ξD∗) = R
fb(0)(2)(x)fbT(0)(1)(x)ξ∗D(dx), M3(ξD∗) = R
fb(0)(2)(x)fbT(0)(2)(x)ξ∗D(dx),
Mb(0)(ξD∗) = M1(ξD∗) − M2T(ξD∗)M3−1(ξ∗D)M2(ξ∗D).
The number of supports, n0+ 2k+ 2k, is large than estimated parameters, (k+2)(k+1)2 . Thus M is a full rank matrix. So the inverse, M3−1(ξD∗), exists surely.
Let
fbg(0)(ex) = (fgT
b(0)(1)(ex), fgT
b(0)(2)(ex))T, where
fgT
b(0)(1)(ex) = (( fb(0)1 − ex1), · · · , ( fb(0)k− exk)), fgT
b(0)(2)(ex) = (( fb(0)1 − ex1)2, · · · , fb(0)k− exk)2, 2( fb(0)1− ex1)( fb(0)2− ex2), · · · , 2( fb(0)1− ex1)( fb(0)k− exk), 2( fb(0)2− ex2)( fb(0)3− ex3), · · · ,
2( fb(0)2− ex2)( fb(0)k− exk), · · · , 2( fb(0)k−1− exk−1)( fb(0)k− exk), 1), fbg(0)(1)(ex) = L1(ϑ)fb(0)(1)(x),
fbg(0)(2)(ex) = L2(ϑ)fb(0)(2)(x), L1(ϑ) =Q
1≤i<j≤kGij(ϑij) with ϑij ∈ (π2)n, n ∈ Z, is a k × k rotation matrix, L2(ϑ) is a k2+k+22 × k2+k+22 transformation matrix and a function of L1(ϑ).
Here L1(ϑ) and L2(ϑ) are also invertible. The proof we show in final part, (**).
Then
M1(eξ) = Z
fbg(0)(1)(ex)fgT
b(0)(1)(ex)eξ(dex)
= Z
L1(ϑ)fb(0)(1)(x)¡
L1(ϑ)fb(0)(1)(x)¢T
ξD∗(dx)
= L1(ϑ) Z
fb(0)(1)(x)fbT(0)(1)(x)ξD∗(dx)LT1(ϑ)
= L1(ϑ)M1(ξD∗)LT1(ϑ), M2(eξ) =
Z
fbg(0)(2)(ex)fgT
b(0)(1)(ex)eξ(dex)
= Z
L2(ϑ)fb(0)(2)(x)¡
L1(ϑ)fb(0)(1)(x)¢T
ξD∗(dx)
= L2(ϑ) Z
fb(0)(2)(x)fbT(0)(1)(x)ξD∗(dx)LT1(ϑ)
= L2(ϑ)M2(ξD∗)LT1(ϑ),
M3(eξ) = first-order terms, L1(ϑ).
Because the determinant of any Givens rotation is 1, det
In other words, eξ is the conditionally locally D-optimal design for fb(0). Thus es1, · · · , fs2k are the additional star points of the conditionally locally D-optimal design for fb(0). ¤
(**) Without loss of generality, the general forms are
L1(ϑ) = Y
Q4=
g11g22+ g12g21 · · · g1pg2q+ g1qg2p · · · g1(k−1)g2k+ g1kg2(k−1)
... . .. ... . .. ...
gp1gq2+ gp2gq1 · · · gppgqq+ gpqgqp · · · gp(k−1)gqk+ gpkgq(k−1)
... . .. ... . .. ...
g(k−1)1gk2+ g(k−1)2gk1 · · · g(k−1)pgkq+ g(k−1)qgkp · · · g(k−1)(k−1)gkk+ g(k−1)kgk(k−1)
,
is a k(k−1)2 × k(k−1)2 matrix, 1 ≤ n ≤ k and 1 ≤ p < q ≤ k.
Because any Givens rotation is invertible and orthogonal, the product,Q
1≤i<j≤kGij(ϑij), is invertible and orthogonal, too. Consider the given condition, ϑij ∈ (π2)n, n ∈ Z, Gij(ϑij) becomes a ”signed permutation matrix”, i.e. in a square matrix, there is ex-actly one nonzero entry in each row and each column and 0’s elsewhere, where the nonzero entries are ±1. It means any product of two different entries in each row or each column is ”zero”. Then the product, Q
1≤i<j≤kGij(ϑij), is a signed permutation matrix i.e. L1(ϑ) is a signed permutation matrix. Thus we get that Q1 is a permuta-tion matrix, Q2 and Q3 are zero matrices with different dimension. Now we focus on Q4. In Q4, each row vector is related to each two different row vectors in L1(ϑ). The property of permutation matrix can help us to get a result that there is exactly one nonzero entry, ±1, in each row of Q4 and 0’s elsewhere and each row is different. It means Q4 is a signed permutation matrix. As a result, L2(ϑ) is a signed permutation matrix, too. Because a signed permutation matrix is invertible, L1(ϑ) and L2(ϑ) are invertible.