Nonlinear Analysis 85 (2013) 160–173
Contents lists available atSciVerse ScienceDirect
Nonlinear Analysis
journal homepage:www.elsevier.com/locate/na
Smooth and nonsmooth analyses of vector-valued functions associated with circular cones
Yu-Lin Chang, Ching-Yu Yang, Jein-Shan Chen
∗Department of Mathematics, National Taiwan Normal University, Taipei 11677, Taiwan
a r t i c l e i n f o
Article history:
Received 10 January 2013 Accepted 29 January 2013 Communicated by S. Carl
MSC:
26A27 26B05 26B35 49J52 90C33 65K05 Keywords:
Circular cone Vector-valued function Semismooth function Complementarity Spectral decomposition
a b s t r a c t
LetLθbe the circular cone in Rnwhich includes a second-order cone as a special case. For any function f from R to R, one can define a corresponding vector-valued function fc(x) on Rnby applying f to the spectral values of the spectral decomposition of x ∈ Rnwith respect toLθ. We show that this vector-valued function inherits from f the properties of continuity, Lipschitz continuity, directional differentiability, Fréchet differentiability, continuous differentiability, as well as semismoothness. These results will play a crucial role in designing solution methods for optimization problem associated with the circular cone.
© 2013 Elsevier Ltd. All rights reserved.
1. Introduction
The circular cone [1,2] is a pointed closed convex cone having hyperspherical sections orthogonal to its axis of revolution about which the cone is invariant to rotation. Let its half-aperture angle be
θ
withθ ∈ (
0,
π2)
. Then, the n-dimensional circular cone denoted byLθ can be expressed asLθ
:=
x
= (
x1,
x2) ∈
R×
Rn−1| ∥
x∥
cosθ ≤
x1 :=
x
= (
x1,
x2) ∈
R×
Rn−1| ∥
x2∥
cotθ ≤
x1 .
(1)SeeFig. 1.
When
θ =
45°, the circular cone reduces to the well-known second-order cone (SOC, also called Lorentz cone) given by Kn:=
x
= (
x1,
x2) ∈
R×
Rn−1| ∥
x2∥ ≤
x1 :=
(
x1,
x2) ∈
R×
Rn−1| ∥
x∥
cos 45°≤
x1 .
∗Correspondence to: Member of Mathematics Division, National Center for Theoretical Sciences, Taipei Office, Taiwan. Tel.: +886 2 29325417; fax: +886 2 29332342.
E-mail addresses:[email protected](Y.-L. Chang),[email protected](C.-Y. Yang),[email protected],[email protected] (J.-S. Chen).
0362-546X/$ – see front matter©2013 Elsevier Ltd. All rights reserved.
http://dx.doi.org/10.1016/j.na.2013.01.017
(a) 0< θ <45°. (b)θ =45°. (c) 45°< θ <90°. Fig. 1. The graphs of circular cones.
Fig. 2. The grasping force forms a circular cone whereα =tan−1µ <45°.
With respect to SOC, for any x
= (
x1,
x2) ∈
R×
Rn−1, we can decompose x asx
= λ
1(
x)
u(x1)+ λ
2(
x)
u(x2),
(2)where
λ
1(
x)
,λ
2(
x)
and u(x1), u(x2)are the spectral values and the associated spectral vectors of x with respect toKn, given byλ
i(
x) =
x1+ (−
1)
i∥
x2∥ ,
u(xi)
=
1 2
1
, (−
1)
i x2∥
x2∥ ,
if x2̸=
0,
12
1
, (−
1)
iw,
if x2=
0,
for i
=
1,
2 withw
being any vector in Rn−1satisfying∥ w∥ =
1. If x2̸=
0, the decomposition(2)is unique. With this spectral decomposition(2), for any function f:
R→
R, the following vector-valued function associated withKn(n≥
1) is considered (see [3,4]):fsoc
(
x) =
f(λ
1)
u(1)+
f(λ
2)
u(2)∀
x= (
x1,
x2) ∈
R×
Rn−1.
(3) If f is defined only on a subset of R, then fsocis defined on the corresponding subset of Rn. The definition(3)is unambiguous whether x2̸=
0 or x2=
0. The above definition(3)is analogous to the one associated with the semidefinite coneSn; see [5,6]. It was shown [4] that the properties of continuity, strict continuity, Lipschitz continuity, directional differentiability, differentiability, continuous differentiability, and semismoothness are each inherited by fsocfrom f . These results are useful in the design and analysis of smooth and nonsmooth methods for solving second-order cone programs (SOCP) and second- order cone complementarity problem (SOCCP); see [3,4,7,8] and references therein.Recently, there have been found circular cone constraints involved in real engineering problems. For example, in the formulation of optimal grasping manipulation for multi-fingered robots, the grasping force of the i-th finger is subject to a contact friction constraint expressed as
| (
ui1,
ui3)| ≤ µ
ui1 (4)where
µ
is the friction coefficient; seeFig. 2.Indeed,(4)is a circular cone constraint corresponding to ui
= (
ui1,
ui2,
ui3) ∈
Lθ withθ =
tan−1µ <
45°. Note that the circular coneLθ is a non-self-dual (or non-symmetric) cone and its related study is rather limited. Nonetheless,162 Y.-L. Chang et al. / Nonlinear Analysis 85 (2013) 160–173
motivated by the real world application regarding circular cone, the structures and properties aboutLθ are investigated in [2]. In particular, the spectral factorization of z associated with the circular cone is characterized in [2, Theorem 3.1]. For convenience, we restate it as follows.
Theorem 1.1 ([2, Theorem 3.1]). For any z
= (
z1,
z2) ∈
R×
Rn−1, one hasz
= λ
1(
z) ·
u(z1)+ λ
2(
z) ·
u(z2) (5)where
λ
1(
z) =
z1− ∥
z2∥
cotθ
λ
2(
z) =
z1+ ∥
z2∥
tanθ
(6)and
u(z1)
=
1 1+
cot2θ
1 0 0 cotθ
1− w
=
sin2θ
− (
sinθ
cosθ)w
u(z2)
=
1 1+
tan2θ
1 0 0 tanθ
1w
=
cos2θ (
sinθ
cosθ)w
(7)with
w =
∥zz22∥if z2̸=
0, and any vector in Rn−1satisfying∥ w∥ =
1 if z2=
0.Analogous to(3), with the spectral factorization(5), for any function f
:
R→
R, we consider the following vector-valued function associated withLθ (n≥
1):fc
(
z) =
f(λ
1)
u(z1)+
f(λ
2)
u(z2)∀
z= (
z1,
z2) ∈
R×
Rn−1.
(8) Can the properties of continuity, strict continuity, Lipschitz continuity, directional differentiability, differentiability, continuous differentiability, and semismoothness be each inherited by fcfrom f ? These are what we want to explore in this paper.At last, we say a few words about notations. In what follows, for any differentiable (in the Fréchet sense) mapping F
:
Rn→
Rm, we denote its Jacobian (not transposed) at x∈
Rnby∇
F(
x) ∈
Rm×n, i.e.,(
F(
x+
u)−
F(
x)−∇
F(
x)
u)/∥
u∥ →
0 as u→
0. ‘‘:=
’’ means ‘‘define’’. We write z=
O(α)
(respectively, z=
o(α)
), withα ∈
R and z∈
Rn, to mean∥
z∥ /|α|
is uniformly bounded (respectively, tends to zero) asα →
0.2. Preliminaries
In this section, we review some basic concepts regarding vector-valued functions. These contain continuity, (local) Lipschitz continuity, directional differentiability, differentiability, continuous differentiability, as well as semismoothness.
Suppose F
:
Rn→
Rm. Then, F is continuous at x∈
Rnif F(
y) →
F(
x)
as y→
x, and F is continuous if F is continuous at every x∈
Rn. We say F is strictly continuous (also called ‘‘locally Lipschitz continuous’’) at x∈
Rnif there exist scalarsκ >
0 andδ >
0 such that∥
F(
y) −
F(
z)∥ ≤ κ∥
y−
z∥ ∀
y,
z∈
Rnwith∥
y−
x∥ ≤ δ, ∥
z−
x∥ ≤ δ;
and F is strictly continuous if F is strictly continuous at every x
∈
Rn. We say F is directionally differentiable at x∈
Rnif F′(
x;
h) :=
limt→0+
F
(
x+
th) −
F(
x)
t exists
∀
h∈
Rn;
and F is directionally differentiable if F is directionally differentiable at every x
∈
Rn. F is differentiable (in the Fréchet sense) at x∈
Rnif there exists a linear mapping∇
F(
x) :
Rn→
Rmsuch thatF
(
x+
h) −
F(
x) − ∇
F(
x)
h=
o(∥
h∥ ).
If F is differentiable at every x
∈
Rnand∇
F is continuous, then F is continuously differentiable. We notice that, in the above expression about strict continuity of F , ifδ
can be taken to be∞
, then F is called Lipschitz continuous with Lipschitz constantκ
.It is well-known that if F is strictly continuous, then F is almost everywhere differentiable by Rademacher’s Theorem;
see [9] and [10, Section 9J]. In this case, the generalized Jacobian
∂
F(
x)
of F at x (in the Clarke sense) can be defined as the convex hull of the generalized Jacobian∂
BF(
x)
, where∂
BF(
x) :=
limxj→x
∇
F(
xj) |
F is differentiable at xj∈
Rn
.
The notation
∂
Bis adopted from [11]. In [10, Chapter 9], the case of m=
1 is considered and the notations ‘‘∇ ¯
’’ and ‘‘∂ ¯
’’ are used instead of, respectively, ‘‘∂
B’’ and ‘‘∂
’’. Assume F:
Rn→
Rmis strictly continuous, then F is said to be semismooth at x if F is directionally differentiable at x and, for any V∈ ∂
F(
x+
h)
, we haveF
(
x+
h) −
F(
x) −
Vh=
o(∥
h∥ ).
Moreover, F is called
ρ
-order semismooth at x (0< ρ < ∞
) if F is semismooth at x and, for any V∈ ∂
F(
x+
h)
, we have F(
x+
h) −
F(
x) −
Vh=
O(∥
h∥
1+ρ).
The following lemma, proven by Sun and Sun [5, Theorem 3.6] using the definition of generalized Jacobian, enables one to study the semismooth property of fcby examining only those points x
∈
Rnwhere fcis differentiable and thus work only with the Jacobian of fc, rather than the generalized Jacobian. It is a very useful working lemma for verifying semismoothness property in Section4.Lemma 2.1. Suppose F
:
Rn→
Rnis strictly continuous and directionally differentiable in a neighborhood of x∈
Rn. Then, for any 0< ρ < ∞
, the following two statements are equivalent.(a) For any
v ∈ ∂
F(
x+
h)
and h→
0,F
(
x+
h) −
F(
x) − v
h=
o(∥
h∥ ) (
respectively, O(∥
h∥ )
1+ρ).
(b) For any h
→
0 such that F is differentiable at x+
h,F
(
x+
h) −
F(
x) − ∇
F(
x+
h)
h=
o(∥
h∥ ) (
respectively,
O(∥
h∥ )
1+ρ).
We say F is semismooth (respectively,
ρ
-order semismooth) if F is semismooth (respectively,ρ
-order semismooth) at every x∈
Rn. We say F is strongly semismooth if it is 1-order semismooth. Convex functions and piecewise continuously differentiable functions are examples of semismooth functions. The composition of two (respectively,ρ
-order) semismooth functions is also a (respectively,ρ
-order) semismooth function. The property of semismoothness, as introduced by Mifflin [12] for functionals and scalar-valued functions and further extended by Qi and Sun [13] for vector-valued functions, is of particular interest due to the key role it plays in the superlinear convergence analysis of certain generalized Newton methods [11,13–16]. For extensive discussions of semismooth functions, see [12,13,17].3. Properties of continuity and differentiability
In this section, we focus on the properties of continuity and differentiability between f and fc. We need some technical lemmas which come from the simple structure of the circular cone and basic definitions before starting the proofs.
Lemma 3.1. Let
λ
1≤ λ
2be the spectral values of x∈
Rnand m1≤
m2be the spectral values of y∈
Rn. Then, we have| λ
1−
m1|
2sin2θ + |λ
2−
m2|
2cos2θ = ∥
x−
y∥
2,
(9) and hence,| λ
i−
mi| ≤
c∥
x−
y∥ , ∀
i=
1,
2, where c=
max{
secθ,
cscθ}
.Proof. The proof follows from a direct computation.
Lemma 3.2. Let x
= (
x1,
x2) ∈
R×
Rn−1and y= (
y1,
y2) ∈
R×
Rn−1. (a) If x2̸=
0,
y2̸=
0, then we have∥
u(i)− v
(i)∥ ≤
2 sin cosθ
∥
x2∥ ∥
x−
y∥ ,
i=
1,
2,
(10)where u(i)
, v
(i)are the unique spectral vectors of x and y, respectively.(b) If either x2
=
0 or y2=
0, then we can choose u(i), v
(i)such that the left hand side of inequality(10)is zero.Proof. (a) From the spectral factorization(5), we know that u(1)
=
sin2θ
1
, (−
1)
cotθ ∥
xx22∥
, v
(1)=
sin2θ
1
, (−
1)
cotθ ∥
yy22∥
,
164 Y.-L. Chang et al. / Nonlinear Analysis 85 (2013) 160–173
where u(1)
, v
(1)are unique. This gives u(1)− v
(1)=
sin2θ
0
, (−
1)
cotθ(
∥xx22∥−
y2∥y2∥
)
. Then,∥
u(1)− v
(1)∥ =
sinθ
cosθ
x2∥
x2∥ −
y2∥
y2∥
=
sinθ
cosθ
x2−
y2∥
x2∥ + (∥
y2∥ − ∥
x2∥ )
y2∥
x2∥ · ∥
y2∥
≤
sinθ
cosθ
1∥
x2∥ ∥
x2−
y2∥ +
1∥
x2∥ |∥
y2∥ − ∥
x2∥|
≤
sinθ
cosθ
1∥
x2∥ ∥
x2−
y2∥ +
1∥
x2∥ ∥
x2−
y2∥
≤
2 sinθ
cosθ
∥
x2∥ ∥
x−
y∥ ,
where the inequalities follow from the triangle inequality. Similar arguments apply for
∥
u(2)− v
(2)∥
.(b) We can choose the same spectral vectors for x and y from the spectral factorization(5)since either x2
=
0 or y2=
0.Then, it is obvious.
Lemma 3.3. For any
w ̸=
0∈
Rn, we have∇
w
w∥w∥
=
1∥w∥
I−
wwT∥w∥2
.Proof. See [18, Lemma 3.3] or check it by direct computation.
Now, we are ready to present our first main result about continuity between f and fc.
Theorem 3.1. For any f
:
R→
R, fcis continuous at x∈
Rnwith spectral valuesλ
1, λ
2if and only if f is continuous atλ
1, λ
2. Proof. ‘‘⇐
’’ Suppose f is continuous atλ
1, λ
2. For any fixed x= (
x1,
x2) ∈
R×
Rn−1and y→
x, let the spectral factorizations of x,
y be x= λ
1u(1)+ λ
2u(2)and y=
m1v
(1)+
m2v
(2), respectively. Then, we discuss two cases.Case (i). If x2
̸=
0, then we havefc
(
y) −
fc(
x) =
f(
m1) v
(1)−
u(1) +
[f(
m1) −
f(λ
1)
] u(1)+
f(
m2) v
(2)−
u(2) +
[f(
m2) −
f(λ
2)
] u(2).
(11) Since f is continuous atλ
1, λ
2, and fromLemma 3.1,|
mi− λ
i| ≤
c∥
y−
x∥
, we know that f(
mi) −→
f(λ
i)
as y→
x. In addition, byLemma 3.2, we have∥ v
(i)−
u(i)∥ −→
0 as y→
x.
Thus, Eq.(11)yields fc(
y) −→
fc(
x)
as y→
x because both f(
mi)
and∥
u(i)∥
are bounded. Hence, fcis continuous at x∈
Rn.Case (ii). If x2
=
0, no matter y2is zero or not, we can arrange that x,
y have the same spectral vectors. Thus, fc(
y) −
fc(
x) =
[f(
m1) −
f(λ
1)
] u(1)+
[f(
m2) −
f(λ
2)
] u(2).
Then, fcis continuous at x∈
Rnby similar arguments.‘‘
⇒
’’ The proof for this direction is straightforward or refer to similar arguments for [4, Prop. 2].Theorem 3.2. For any f
:
R→
R, fcis directionally differentiable at x∈
Rnwith spectral valuesλ
1,λ
2if and only if f is directionally differentiable atλ
1,λ
2.Proof. ‘‘
⇐
’’ Suppose f is directionally differentiable atλ
1, λ
2. Fix any x= (
x1,
x2) ∈
R×
Rn−1, then we discuss two cases as below.Case (i). If x2
̸=
0, we have fc(
x) =
f(λ
1)
u(1)+
f(λ
2)
u(2) whereλ
i=
x1+ (−
1)
i(
tanθ)
(−1)i∥
x2∥
and u(i)= (−
1)
isinθ
cosθ (
tanθ)
(−1)i,
∥xxT22∥
for all i
=
1,
2. FromLemma 3.3, we know that u(i)is Fréchet-differentiable with respect to x, with∇
xu(i)= (−
1)
isinθ
cosθ
∥
x2∥
0 0
0 I
−
x2xT 2
∥
x2∥
2
∀
i=
1,
2.
(12)Also by the expression of
λ
i, we know thatλ
iis Fréchet-differentiable with respect to x, with∇
xλ
i=
1
, (−
1)
itan(−1)iθ ∥
xxT22∥
∀
i=
1,
2.
(13)In general, we cannot apply the chain rule, when functions are only directionally differentiable. But, it works well for single- variable functions, that is, when single-variable functions are composed of a differentiable function. From the hypothesis, f
is directionally differentiable at
λ
1, then it is easy to compute limt→0+
f
(λ
1+
t×
1) −
f(λ
1)
t
=
f′(λ
1;
1),
limt→0+
f
(λ
1−
t×
1) −
f(λ
1)
t
=
f′(λ
1; −
1),
limt→0+
f
(λ
1+
o(
t)) −
f(λ
1)
t
=
0.
Note that the spectral value function
λ
1(
x) =
x1−
cotθ∥
x2∥
is differentiable when x2̸=
0, which yieldsλ
1(
x+
th) = λ
1(
x) +
t∇
xλ
1h+
o(
t).
Let y
:= ∇
xλ
1h+
o(t)t . For the case of
∇
xλ
1h<
0, we know y<
0 as t is small. Thus, limt→0+
f
(λ
1(
x+
th)) −
f(λ
1(
x))
t
=
limt→0+
f
(λ
1(
x) +
ty) −
f(λ
1(
x))
t=
limt→0+
f
(λ
1(
x) − (−
ty)) −
f(λ
1(
x))
−
ty(−
y) =
lim−ty→0+
f
(λ
1(
x) − (−
ty)) −
f(λ
1(
x))
−
ty limt→0+
(−
y)
=
f′(λ
1(
x); −
1)(−∇
xλ
1h) =
f′(λ
1(
x); ∇
xλ
1h).
Here the positively homogeneous property of directionally differentiable functions is used in the last equation. Similarly, for the other case of
∇
xλ
1h≥
0, we havelim
t→0+
f
(λ
1(
x+
th)) −
f(λ
1(
x))
t
=
f′(λ
1(
x); ∇
xλ
1h).
In summary, the composite function f
◦ λ
1(·)
is directionally differentiable at x. Now we can apply the chain rule and the product rule on fc(
x) =
f(λ
1)
u(1)+
f(λ
2)
u(2). In other words,(
fc)
′(
x;
h) =
f(λ
1)∇
xu(1)h+
f′(λ
1; ∇
xλ
1h)
u(1)+
f(λ
2)∇
xu(2)h+
f′(λ
2; ∇
xλ
2h)
u(2)= (
A1,
A2) ∈
R×
Rn−1,
whereA1
=
f′
λ
1;
h1−
cotθ
x∥
T2xh2∥
2
sin2
θ +
f′
λ
2;
h1+
tanθ ∥
xT2xh2∥
2
cos2
θ
(14)and A2
=
f′
λ
2;
h1+
tanθ ∥
xT2xh2∥
2
−
f′
λ
1;
h1−
cotθ ∥
xT2xh2∥
2
sin
θ
cosθ ∥
xx22∥
+
f(λ
2) −
f(λ
1) λ
2− λ
1
I−
x2xT 2
∥
x2∥
2
h2
,
(15)with h
= (
h1,
h2) ∈
R×
Rn−1.Now, applying Eqs.(12)and(13)and using the fact that
λ
2− λ
1=
∥x2∥sinθcosθ in the A2term, we see that
(
fc)
′(
x;
h)
can be rewritten in a more compact form as below:(
fc)
′(
x;
h) =
f′
λ
1;
h1−
cotθ ∥
xT2xh2∥
2
u(1)+
f′
λ
2;
h1+
tanθ ∥
xT2xh2∥
2
u(2)
+
f(λ
2) −
f(λ
1) λ
2− λ
1
I−
x2xT 2
∥
x2∥
2
h2
.
(16) Case (ii). If x2=
0, we compute the directional derivative(
fc)
′(
x;
h)
at x for any direction h by definition. Let h= (
h1,
h2) ∈
R×
Rn−1. We have two subcases. First, consider the subcase of h2̸=
0. From the spectral factorization, we can choose u(1)=
sin2
θ, −
sinθ
cosθ
∥hh22∥
and u(2)
=
cos2
θ,
sinθ
cosθ
∥hh22∥
such that
fc(
x+
th) =
f(λ + △λ
1)
u(1)+
f(λ + △λ
2)
u(2) fc(
x) =
f(λ)
u(1)+
f(λ)
u(2)where
λ =
x1and△ λ
i=
t
h1
+ (−
1)
itan(−1)iθ∥
h2∥
for all i
=
1,
2. Thus, we obtain fc(
x+
th) −
fc(
x) =
[f(λ + △λ
1) −
f(λ)
] u(1)+
[f(λ + △λ
2) −
f(λ)
] u(2).
166 Y.-L. Chang et al. / Nonlinear Analysis 85 (2013) 160–173
Using the following facts lim
t→0+
f
(λ + △λ
1) −
f(λ)
t
=
limt→0+
f
(λ +
t(
h1−
cotθ∥
h2∥ )) −
f(λ)
t
=
f′(λ;
h1−
cotθ∥
h2∥ )
limt→0+
f
(λ + △λ
2) −
f(λ)
t
=
limt→0+
f
(λ +
t(
h1+
tanθ∥
h2∥ )) −
f(λ)
t
=
f′(λ;
h1+
tanθ∥
h2∥ )
yieldslim
t→0+
fc
(
x+
th) −
fc(
x)
t
=
limt→0+
f
(λ + △λ
1) −
f(λ)
t u(1)
+
limt→0+
f
(λ + △λ
2) −
f(λ)
t u(2)=
f′(λ;
h1−
cotθ∥
h2∥ )
u(1)+
f′(λ;
h1+
tanθ∥
h2∥ )
u(2) (17) which says(
fc)
′(
x;
h)
exists.Second, for the subcase of h2
=
0, the same arguments apply except h2/∥
h2∥
is replaced by anyw ∈
Rn−1with∥ w∥ =
1, i.e., choosing u(1)=
sin2
θ, −
sinθ
cosθw
and u(2)=
cos2
θ,
sinθ
cosθw
. Analogously, we obtain limt→0+
fc
(
x+
th) −
fc(
x)
t
=
f′(λ;
h1)
u(1)+
f′(λ;
h1)
u(2) (18)which implies
(
fc)
′(
x;
h)
exists in the form of(18). From all the above, it shows that fcis directionally differentiable at x when x2=
0 and its directional derivative(
fc)
′(
x;
h)
is either in the form of(17)or(18).‘‘
⇒
’’ Suppose fcis directionally differentiable at x∈
Rnwith spectral valuesλ
1, λ
2, we will prove that f is directionally differentiable atλ
1, λ
2. Forλ
1∈
R and any direction d1∈
R, let h:=
d1u(1)+
0u(2)where x= λ
1u(1)+ λ
2u(2). Then, x+
th= (λ
1+
td1)
u(1)+ λ
2u(2)andfc
(
x+
th) −
fc(
x)
t
=
f(λ
1+
td1) −
f(λ
1)
t u(1).
Since fcis directionally differentiable at x, the above equation implies f′
(λ
1;
d1) =
limt→0+
f
(λ
1+
td1) −
f(λ
1)
t exists
.
This means f is directionally differentiable at
λ
1. Similarly, f is also directionally differentiable atλ
2.Theorem 3.3. For any f
:
R→
R, fcis differentiable at x= (
x1,
x2) ∈
R×
Rn−1with spectral valuesλ
1,λ
2if and only if f is differentiable atλ
1,λ
2. Moreover, for given h= (
h1,
h2) ∈
R×
Rn−1, we have∇
fc(
x)
h=
b cxT2
∥
x2∥
cx2∥
x2∥
aI+ (¯
b−
a) ∥
xx22x∥
T22
h1 h2
,
when x2̸=
0,
where
a
=
f(λ
2) −
f(λ
1) λ
2− λ
1,
b
=
f′(λ
1)
sin2θ +
f′(λ
2)
cos2θ,
b¯ =
f′(λ
1)
cos2θ +
f′(λ
2)
sin2θ,
c= [
f′(λ
2) −
f′(λ
1)]
sinθ
cosθ.
When x2
=
0,∇
fc(
x) =
f′(λ)
I withλ =
x1.Proof. ‘‘
⇐
’’ The proof of this direction is identical to the proof shown as inTheorem 3.2, in which only ‘‘directionally differentiable’’ needs to be replaced by ‘‘differentiable’’. Since f is differentiable atλ
1andλ
2, we have that f′(λ
1; · )
and f′(λ
2; · )
are linear, which means f′(λ
i;
a+
b) =
f′(λ
i)
a+
f′(λ
i)
b. This together with Eqs.(14)and(15)yieldA1
=
f′
λ
1;
h1−
cotθ
x∥
T2xh2∥
2
sin2
θ +
f′
λ
2;
h1+
tanθ ∥
xT2xh2∥
2
cos2θ
=
f′(λ
1)
h1sin2θ −
f′(λ
1)
cotθ
xT2h2∥
x2∥
sin2
θ +
f′(λ
2)
h1cos2θ +
f′(λ
2)
tanθ
xT2h2∥
x2∥
cos2
θ
=
f′
(λ
1)
sin2θ +
f′(λ
2)
cos2θ
h1+
f′