Existence:
If g(a) = a or g(b) = b, then a or b is a fixed point of g and we are done.
Otherwise, it must be g(a) > a and g(b) < b. The function h(x) = g(x) − xis continuous on [a, b], with
h(a) = g(a) − a > 0 and h(b) = g(b) − b < 0.
By the Intermediate Value Theorem, ∃ x∗ ∈ [a, b] such that h(x∗) = 0. That is
g(x∗) − x∗ = 0 ⇒ g(x∗) = x∗. Hence g has a fixed point x∗in [a, b].
師大
Proof
Existence:
If g(a) = a or g(b) = b, then a or b is a fixed point of g and we are done.
Otherwise, it must be g(a) > a and g(b) < b. The function h(x) = g(x) − xis continuous on [a, b], with
h(a) = g(a) − a > 0 and h(b) = g(b) − b < 0.
By the Intermediate Value Theorem, ∃ x∗ ∈ [a, b] such that h(x∗) = 0.That is
g(x∗) − x∗ = 0 ⇒ g(x∗) = x∗. Hence g has a fixed point x∗in [a, b].
師大
Proof
Existence:
If g(a) = a or g(b) = b, then a or b is a fixed point of g and we are done.
Otherwise, it must be g(a) > a and g(b) < b. The function h(x) = g(x) − xis continuous on [a, b], with
h(a) = g(a) − a > 0 and h(b) = g(b) − b < 0.
By the Intermediate Value Theorem, ∃ x∗ ∈ [a, b] such that h(x∗) = 0. That is
g(x∗) − x∗ = 0 ⇒ g(x∗) = x∗. Hence g has a fixed point x∗in [a, b].
師大
Proof
Existence:
If g(a) = a or g(b) = b, then a or b is a fixed point of g and we are done.
Otherwise, it must be g(a) > a and g(b) < b. The function h(x) = g(x) − xis continuous on [a, b], with
h(a) = g(a) − a > 0 and h(b) = g(b) − b < 0.
By the Intermediate Value Theorem, ∃ x∗ ∈ [a, b] such that h(x∗) = 0.That is
g(x∗) − x∗ = 0 ⇒ g(x∗) = x∗. Hence g has a fixed point x∗in [a, b].
師大
Proof
Existence:
If g(a) = a or g(b) = b, then a or b is a fixed point of g and we are done.
Otherwise, it must be g(a) > a and g(b) < b. The function h(x) = g(x) − xis continuous on [a, b], with
h(a) = g(a) − a > 0 and h(b) = g(b) − b < 0.
By the Intermediate Value Theorem, ∃ x∗ ∈ [a, b] such that h(x∗) = 0. That is
g(x∗) − x∗ = 0 ⇒ g(x∗) = x∗. Hence g has a fixed point x∗in [a, b].
師大
Proof
Uniqueness:
Suppose that p 6= q are both fixed points of g in [a, b].By the Mean-Value theorem, there exists ξ between p and q such that
g0(ξ) = g(p) − g(q)
p − q = p − q p − q = 1.
However, this contradicts to the assumption that
|g0(x)| ≤ M < 1for all x in [a, b]. Therefore the fixed point of g is unique.
師大
Proof
Uniqueness:
Suppose that p 6= q are both fixed points of g in [a, b]. By the Mean-Value theorem, there exists ξ between p and q such that
g0(ξ) = g(p) − g(q)
p − q = p − q p − q = 1.
However, this contradicts to the assumption that
|g0(x)| ≤ M < 1for all x in [a, b]. Therefore the fixed point of g is unique.
師大
Proof
Uniqueness:
Suppose that p 6= q are both fixed points of g in [a, b]. By the Mean-Value theorem, there exists ξ between p and q such that
g0(ξ) = g(p) − g(q)
p − q = p − q p − q = 1.
However, this contradicts to the assumption that
|g0(x)| ≤ M < 1for all x in [a, b]. Therefore the fixed point of g is unique.
師大
Example 6
Show that the following function has a unique fixed point.
g(x) = (x2− 1)/3, x ∈ [−1, 1].
Solution: The Extreme Value Theorem implies that min
x∈[−1,1]g(x) = g(0) = −1 3, max
x∈[−1,1]g(x) = g(±1) = 0.
That is g(x) ∈ [−1, 1], ∀ x ∈ [−1, 1].
Moreover, g is continuous and
|g0(x)| =
2x 3
≤ 2
3, ∀ x ∈ (−1, 1).
By above theorem, g has a unique fixed point in [−1, 1].
師大
Example 6
Show that the following function has a unique fixed point.
g(x) = (x2− 1)/3, x ∈ [−1, 1].
Solution: The Extreme Value Theorem implies that min
x∈[−1,1]g(x) = g(0) = −1 3, max
x∈[−1,1]g(x) = g(±1) = 0.
That is g(x) ∈ [−1, 1], ∀ x ∈ [−1, 1].
Moreover, g is continuous and
|g0(x)| =
2x 3
≤ 2
3, ∀ x ∈ (−1, 1).
By above theorem, g has a unique fixed point in [−1, 1].
師大
Example 6
Show that the following function has a unique fixed point.
g(x) = (x2− 1)/3, x ∈ [−1, 1].
Solution: The Extreme Value Theorem implies that min
x∈[−1,1]g(x) = g(0) = −1 3, max
x∈[−1,1]g(x) = g(±1) = 0.
That is g(x) ∈ [−1, 1], ∀ x ∈ [−1, 1].
Moreover, g is continuous and
|g0(x)| =
2x 3
≤ 2
3, ∀ x ∈ (−1, 1).
By above theorem, g has a unique fixed point in [−1, 1].
師大
Example 6
Show that the following function has a unique fixed point.
g(x) = (x2− 1)/3, x ∈ [−1, 1].
Solution: The Extreme Value Theorem implies that min
x∈[−1,1]g(x) = g(0) = −1 3, max
x∈[−1,1]g(x) = g(±1) = 0.
That is g(x) ∈ [−1, 1], ∀ x ∈ [−1, 1].
Moreover, g is continuous and
|g0(x)| =
2x 3
≤ 2
3, ∀ x ∈ (−1, 1).
By above theorem, g has a unique fixed point in [−1, 1].
師大
Example 6
Show that the following function has a unique fixed point.
g(x) = (x2− 1)/3, x ∈ [−1, 1].
Solution: The Extreme Value Theorem implies that min
x∈[−1,1]g(x) = g(0) = −1 3, max
x∈[−1,1]g(x) = g(±1) = 0.
That is g(x) ∈ [−1, 1], ∀ x ∈ [−1, 1].
Moreover, g is continuous and
|g0(x)| =
2x 3
≤ 2
3, ∀ x ∈ (−1, 1).
By above theorem, g has a unique fixed point in [−1, 1].
師大
Let p be such unique fixed point of g. Then p = g(p) = p2− 1
3 ⇒ p2− 3p − 1 = 0
⇒ p = 1 2(3 −√
13).
師大
Fixed-point iteration or functional iteration
Given a continuous function g, choose an initial point x0 and generate {xk}∞k=0by
xk+1 = g(xk), k ≥ 0.
{xk} may not converge, e.g., g(x) = 3x. However, when the sequence converges, say,
k→∞lim xk= x∗, then, since g is continuous,
g(x∗) = g( lim
k→∞xk) = lim
k→∞g(xk) = lim
k→∞xk+1= x∗. That is, x∗is a fixed point of g.
師大
Fixed-point iteration or functional iteration
Given a continuous function g, choose an initial point x0 and generate {xk}∞k=0by
xk+1 = g(xk), k ≥ 0.
{xk} may not converge, e.g., g(x) = 3x.However, when the sequence converges, say,
k→∞lim xk= x∗, then, since g is continuous,
g(x∗) = g( lim
k→∞xk) = lim
k→∞g(xk) = lim
k→∞xk+1= x∗. That is, x∗is a fixed point of g.
師大
Fixed-point iteration or functional iteration
Given a continuous function g, choose an initial point x0 and generate {xk}∞k=0by
xk+1 = g(xk), k ≥ 0.
{xk} may not converge, e.g., g(x) = 3x. However, when the sequence converges, say,
k→∞lim xk= x∗, then, since g is continuous,
g(x∗) = g( lim
k→∞xk) = lim
k→∞g(xk) = lim
k→∞xk+1= x∗. That is, x∗is a fixed point of g.
師大
Fixed-point iteration or functional iteration
Given a continuous function g, choose an initial point x0 and generate {xk}∞k=0by
xk+1 = g(xk), k ≥ 0.
{xk} may not converge, e.g., g(x) = 3x. However, when the sequence converges, say,
k→∞lim xk= x∗, then, since g is continuous,
g(x∗) = g( lim
k→∞xk) = lim
k→∞g(xk) = lim
k→∞xk+1= x∗. That is, x∗is a fixed point of g.
師大
Fixed-point iteration or functional iteration
Given a continuous function g, choose an initial point x0 and generate {xk}∞k=0by
xk+1 = g(xk), k ≥ 0.
{xk} may not converge, e.g., g(x) = 3x. However, when the sequence converges, say,
k→∞lim xk= x∗, then, since g is continuous,
g(x∗) = g( lim
k→∞xk) = lim
k→∞g(xk) = lim
k→∞xk+1= x∗. That is, x∗is a fixed point of g.
師大
Fixed-point iteration
Given x0, tolerance T OL, maximum number of iteration M . Set i = 1 and x = g(x0).
While i ≤ M and |x − x0| ≥ T OL Set i = i + 1, x0 = xand x = g(x0).
End While
師大
Example 7 The equation
x3+ 4x2− 10 = 0
has a unique root in [1, 2]. Change the equation to the fixed-point form x = g(x).
(a) x = g1(x) ≡ x − f (x) = x − x3− 4x2+ 10
(b) x = g2(x) = 10x − 4x1/2
x3 = 10 − 4x2 ⇒ x2 = 10
x − 4x ⇒ x = ± 10 x − 4x
1/2
師大
Example 7 The equation
x3+ 4x2− 10 = 0
has a unique root in [1, 2]. Change the equation to the fixed-point form x = g(x).
(a) x = g1(x) ≡ x − f (x) = x − x3− 4x2+ 10
(b) x = g2(x) = 10x − 4x1/2
x3 = 10 − 4x2 ⇒ x2 = 10
x − 4x ⇒ x = ± 10 x − 4x
1/2
師大
Example 7 The equation
x3+ 4x2− 10 = 0
has a unique root in [1, 2]. Change the equation to the fixed-point form x = g(x).
(a) x = g1(x) ≡ x − f (x) = x − x3− 4x2+ 10
(b) x = g2(x) = 10x − 4x1/2
x3 = 10 − 4x2 ⇒ x2 = 10
x − 4x ⇒ x = ± 10 x − 4x
1/2
師大
Example 7 The equation
x3+ 4x2− 10 = 0
has a unique root in [1, 2]. Change the equation to the fixed-point form x = g(x).
(a) x = g1(x) ≡ x − f (x) = x − x3− 4x2+ 10
(b) x = g2(x) = 10x − 4x1/2
x3 = 10 − 4x2 ⇒ x2 = 10
x − 4x ⇒ x = ± 10 x − 4x
1/2
師大
(c) x = g3(x) = 12 10 − x31/2
4x2 = 10 − x3 ⇒ x = ±1
2 10 − x31/2
(d) x = g4(x) =
10 4+x
1/2
x2(x + 4) = 10 ⇒ x = ±
10 4 + x
1/2
(e) x = g5(x) = x −x33x+4x2+8x2−10
x = g5(x) ≡ x − f (x) f0(x)
師大
(c) x = g3(x) = 12 10 − x31/2
4x2 = 10 − x3 ⇒ x = ±1
2 10 − x31/2
(d) x = g4(x) =
10 4+x
1/2
x2(x + 4) = 10 ⇒ x = ±
10 4 + x
1/2
(e) x = g5(x) = x −x33x+4x2+8x2−10
x = g5(x) ≡ x − f (x) f0(x)
師大
(c) x = g3(x) = 12 10 − x31/2
4x2 = 10 − x3 ⇒ x = ±1
2 10 − x31/2
(d) x = g4(x) =
10 4+x
1/2
x2(x + 4) = 10 ⇒ x = ±
10 4 + x
1/2
(e) x = g5(x) = x −x33x+4x2+8x2−10
x = g5(x) ≡ x − f (x) f0(x)
師大
Results of the fixed-point iteration with initial point x0 = 1.5
師大
Theorem 8 (Fixed-point Theorem)
Let g ∈ C[a, b] be such thatg(x) ∈ [a, b]for all x ∈ [a, b].
Suppose that g0 exists on (a, b) and that ∃ k with0 < k < 1such that
|g0(x)| ≤ k, ∀ x ∈ (a, b).
Then, for any number x0 in [a, b],
xn= g(xn−1), n ≥ 1, converges to the unique fixed point x in [a, b].
師大
Theorem 8 (Fixed-point Theorem)
Let g ∈ C[a, b] be such thatg(x) ∈ [a, b]for all x ∈ [a, b].
Suppose that g0 exists on (a, b) and that ∃ k with0 < k < 1such that
|g0(x)| ≤ k, ∀ x ∈ (a, b).
Then, for any number x0 in [a, b],
xn= g(xn−1), n ≥ 1, converges to the unique fixed point x in [a, b].
師大
Theorem 8 (Fixed-point Theorem)
Let g ∈ C[a, b] be such thatg(x) ∈ [a, b]for all x ∈ [a, b].
Suppose that g0 exists on (a, b) and that ∃ k with0 < k < 1such that
|g0(x)| ≤ k, ∀ x ∈ (a, b).
Then, for any number x0 in [a, b],
xn= g(xn−1), n ≥ 1, converges to the unique fixed point x in [a, b].
師大
Proof: By the assumptions, a unique fixed point exists in [a, b].
Since g([a, b]) ⊆ [a, b], {xn}∞n=0 is defined and xn∈ [a, b] for all n ≥ 0. Using the Mean Values Theorem and the fact that
|g0(x)| ≤ k, we have
|x − xn| = |g(xn−1) − g(x)| = |g0(ξn)||x − xn−1| ≤ k|x − xn−1|, where ξn∈ (a, b).It follows that
|xn− x| ≤ k|xn−1− x| ≤ k2|xn−2− x| ≤ · · · ≤ kn|x0− x|. (1) Since 0 < k < 1, we have
n→∞lim kn= 0 and
n→∞lim |xn− x| ≤ lim
n→∞kn|x0− x| = 0.
Hence, {xn}∞ converges to x.
師大
Proof: By the assumptions, a unique fixed point exists in [a, b].
Since g([a, b]) ⊆ [a, b], {xn}∞n=0 is defined and xn∈ [a, b] for all n ≥ 0. Using the Mean Values Theorem and the fact that
|g0(x)| ≤ k, we have
|x − xn| = |g(xn−1) − g(x)| = |g0(ξn)||x − xn−1| ≤ k|x − xn−1|, where ξn∈ (a, b). It follows that
|xn− x| ≤ k|xn−1− x| ≤ k2|xn−2− x| ≤ · · · ≤ kn|x0− x|. (1) Since 0 < k < 1, we have
n→∞lim kn= 0 and
n→∞lim |xn− x| ≤ lim
n→∞kn|x0− x| = 0.
Hence, {xn}∞ converges to x.
師大
Proof: By the assumptions, a unique fixed point exists in [a, b].
Since g([a, b]) ⊆ [a, b], {xn}∞n=0 is defined and xn∈ [a, b] for all n ≥ 0. Using the Mean Values Theorem and the fact that
|g0(x)| ≤ k, we have
|x − xn| = |g(xn−1) − g(x)| = |g0(ξn)||x − xn−1| ≤ k|x − xn−1|, where ξn∈ (a, b).It follows that
|xn− x| ≤ k|xn−1− x| ≤ k2|xn−2− x| ≤ · · · ≤ kn|x0− x|. (1) Since 0 < k < 1, we have
n→∞lim kn= 0 and
n→∞lim |xn− x| ≤ lim
n→∞kn|x0− x| = 0.
Hence, {xn}∞ converges to x.
師大
Proof: By the assumptions, a unique fixed point exists in [a, b].
Since g([a, b]) ⊆ [a, b], {xn}∞n=0 is defined and xn∈ [a, b] for all n ≥ 0. Using the Mean Values Theorem and the fact that
|g0(x)| ≤ k, we have
|x − xn| = |g(xn−1) − g(x)| = |g0(ξn)||x − xn−1| ≤ k|x − xn−1|, where ξn∈ (a, b). It follows that
|xn− x| ≤ k|xn−1− x| ≤ k2|xn−2− x| ≤ · · · ≤ kn|x0− x|. (1) Since 0 < k < 1, we have
n→∞lim kn= 0 and
n→∞lim |xn− x| ≤ lim
n→∞kn|x0− x| = 0.
Hence, {xn}∞ converges to x.
師大
Proof: By the assumptions, a unique fixed point exists in [a, b].
Since g([a, b]) ⊆ [a, b], {xn}∞n=0 is defined and xn∈ [a, b] for all n ≥ 0. Using the Mean Values Theorem and the fact that
|g0(x)| ≤ k, we have
|x − xn| = |g(xn−1) − g(x)| = |g0(ξn)||x − xn−1| ≤ k|x − xn−1|, where ξn∈ (a, b). It follows that
|xn− x| ≤ k|xn−1− x| ≤ k2|xn−2− x| ≤ · · · ≤ kn|x0− x|. (1) Since 0 < k < 1, we have
n→∞lim kn= 0 and
n→∞lim |xn− x| ≤ lim
n→∞kn|x0− x| = 0.
Hence, {xn}∞ converges to x.
師大
Corollary 9
If g satisfies the hypotheses of above theorem, then
|x − xn| ≤ knmax{x0− a, b − x0} and
|xn− x| ≤ kn
1 − k|x1− x0|, ∀ n ≥ 1.
Proof: From (1),
|xn− x| ≤ kn|x0− x| ≤ knmax{x0− a, b − x0}.
For n ≥ 1, using the Mean Values Theorem,
|xn+1− xn| = |g(xn) − g(xn−1)| ≤ k|xn− xn−1| ≤ · · · ≤ kn|x1− x0|.
師大
Corollary 9
If g satisfies the hypotheses of above theorem, then
|x − xn| ≤ knmax{x0− a, b − x0} and
|xn− x| ≤ kn
1 − k|x1− x0|, ∀ n ≥ 1.
Proof: From (1),
|xn− x| ≤ kn|x0− x| ≤ knmax{x0− a, b − x0}.
For n ≥ 1, using the Mean Values Theorem,
|xn+1− xn| = |g(xn) − g(xn−1)| ≤ k|xn− xn−1| ≤ · · · ≤ kn|x1− x0|.
師大
Corollary 9
If g satisfies the hypotheses of above theorem, then
|x − xn| ≤ knmax{x0− a, b − x0} and
|xn− x| ≤ kn
1 − k|x1− x0|, ∀ n ≥ 1.
Proof: From (1),
|xn− x| ≤ kn|x0− x| ≤ knmax{x0− a, b − x0}.
For n ≥ 1, using the Mean Values Theorem,
|xn+1− xn| = |g(xn) − g(xn−1)| ≤ k|xn− xn−1| ≤ · · · ≤ kn|x1− x0|.
師大
Thus, for m > n ≥ 1,
|xm− xn| = |xm− xm−1+ xm−1− · · · + xn+1− xn|
≤ |xm− xm−1| + |xm−1− xm−2| + · · · + |xn+1− xn|
≤ km−1|x1− x0| + km−2|x1− x0| + · · · + kn|x1− x0|
= kn|x1− x0| 1 + k + k2+ · · · + km−n−1 . It implies that
|x − xn| = lim
m→∞|xm− xn| ≤ lim
m→∞kn|x1− x0|
m−n−1
X
j=0
kj
≤ kn|x1− x0|
∞
X
j=0
kj = kn
1 − k|x1− x0|.
師大
Thus, for m > n ≥ 1,
|xm− xn| = |xm− xm−1+ xm−1− · · · + xn+1− xn|
≤ |xm− xm−1| + |xm−1− xm−2| + · · · + |xn+1− xn|
≤ km−1|x1− x0| + km−2|x1− x0| + · · · + kn|x1− x0|
= kn|x1− x0| 1 + k + k2+ · · · + km−n−1 . It implies that
|x − xn| = lim
m→∞|xm− xn| ≤ lim
m→∞kn|x1− x0|
m−n−1
X
j=0
kj
≤ kn|x1− x0|
∞
X
j=0
kj = kn
1 − k|x1− x0|.
師大
Example 10
For previous example,
f (x) = x3+ 4x2− 10 = 0.
For g1(x) = x − x3− 4x2+ 10, we have g1(1) = 6 and g1(2) = −12, so g1([1, 2]) * [1, 2].Moreover,
g10(x) = 1 − 3x2− 8x ⇒ |g10(x)| ≥ 1 ∀ x ∈ [1, 2]
• DOES NOT guarantee to converge or not
師大
Example 10
For previous example,
f (x) = x3+ 4x2− 10 = 0.
For g1(x) = x − x3− 4x2+ 10, we have g1(1) = 6 and g1(2) = −12, so g1([1, 2]) * [1, 2].Moreover,
g10(x) = 1 − 3x2− 8x ⇒ |g10(x)| ≥ 1 ∀ x ∈ [1, 2]
• DOES NOT guarantee to converge or not
師大
Example 10
For previous example,
f (x) = x3+ 4x2− 10 = 0.
For g1(x) = x − x3− 4x2+ 10, we have g1(1) = 6 and g1(2) = −12, so g1([1, 2]) * [1, 2]. Moreover,
g10(x) = 1 − 3x2− 8x ⇒ |g10(x)| ≥ 1 ∀ x ∈ [1, 2]
• DOES NOT guarantee to converge or not
師大
Example 10
For previous example,
f (x) = x3+ 4x2− 10 = 0.
For g1(x) = x − x3− 4x2+ 10, we have g1(1) = 6 and g1(2) = −12, so g1([1, 2]) * [1, 2]. Moreover,
g10(x) = 1 − 3x2− 8x ⇒ |g10(x)| ≥ 1 ∀ x ∈ [1, 2]
• DOES NOT guarantee to converge or not
師大
For g3(x) = 12(10 − x3)1/2, ∀ x ∈ [1, 1.5], g30(x) = −3
4x2(10 − x3)−1/2< 0, ∀ x ∈ [1, 1.5], so g3 is strictly decreasing on [1, 1.5] and
1 < 1.28 ≈ g3(1.5) ≤ g3(x) ≤ g3(1) = 1.5, ∀ x ∈ [1, 1.5].
On the other hand,
|g03(x)| ≤ |g03(1.5)| ≈ 0.66, ∀ x ∈ [1, 1.5].
Hence, the sequence is convergent to the fixed point.
師大
For g3(x) = 12(10 − x3)1/2, ∀ x ∈ [1, 1.5], g30(x) = −3
4x2(10 − x3)−1/2< 0, ∀ x ∈ [1, 1.5], so g3 is strictly decreasing on [1, 1.5]and
1 < 1.28 ≈ g3(1.5) ≤ g3(x) ≤ g3(1) = 1.5, ∀ x ∈ [1, 1.5].
On the other hand,
|g03(x)| ≤ |g03(1.5)| ≈ 0.66, ∀ x ∈ [1, 1.5].
Hence, the sequence is convergent to the fixed point.
師大
For g3(x) = 12(10 − x3)1/2, ∀ x ∈ [1, 1.5], g30(x) = −3
4x2(10 − x3)−1/2< 0, ∀ x ∈ [1, 1.5], so g3 is strictly decreasing on [1, 1.5] and
1 < 1.28 ≈ g3(1.5) ≤ g3(x) ≤ g3(1) = 1.5, ∀ x ∈ [1, 1.5].
On the other hand,
|g03(x)| ≤ |g03(1.5)| ≈ 0.66, ∀ x ∈ [1, 1.5].
Hence, the sequence is convergent to the fixed point.
師大
For g3(x) = 12(10 − x3)1/2, ∀ x ∈ [1, 1.5], g30(x) = −3
4x2(10 − x3)−1/2< 0, ∀ x ∈ [1, 1.5], so g3 is strictly decreasing on [1, 1.5] and
1 < 1.28 ≈ g3(1.5) ≤ g3(x) ≤ g3(1) = 1.5, ∀ x ∈ [1, 1.5].
On the other hand,
|g03(x)| ≤ |g03(1.5)| ≈ 0.66, ∀ x ∈ [1, 1.5].
Hence, the sequence is convergent to the fixed point.
師大
For g3(x) = 12(10 − x3)1/2, ∀ x ∈ [1, 1.5], g30(x) = −3
4x2(10 − x3)−1/2< 0, ∀ x ∈ [1, 1.5], so g3 is strictly decreasing on [1, 1.5] and
1 < 1.28 ≈ g3(1.5) ≤ g3(x) ≤ g3(1) = 1.5, ∀ x ∈ [1, 1.5].
On the other hand,
|g03(x)| ≤ |g03(1.5)| ≈ 0.66, ∀ x ∈ [1, 1.5].
Hence, the sequence is convergent to the fixed point.
師大
For g4(x) =p10/(4 + x), we have r10
6 ≤ g4(x) ≤ r10
5 , ∀ x ∈ [1, 2] ⇒ g4([1, 2]) ⊆ [1, 2]
Moreover,
|g04(x)| =
√ −5
10(4 + x)3/2
≤ 5
√10(5)3/2 < 0.15, ∀ x ∈ [1, 2].
The bound of |g04(x)|is much smaller than the bound of |g30(x)|, which explains the more rapid convergence using g4.
師大
For g4(x) =p10/(4 + x), we have r10
6 ≤ g4(x) ≤ r10
5 , ∀ x ∈ [1, 2] ⇒ g4([1, 2]) ⊆ [1, 2]
Moreover,
|g04(x)| =
√ −5
10(4 + x)3/2
≤ 5
√10(5)3/2 < 0.15, ∀ x ∈ [1, 2].
The bound of |g04(x)|is much smaller than the bound of |g30(x)|, which explains the more rapid convergence using g4.
師大
For g4(x) =p10/(4 + x), we have r10
6 ≤ g4(x) ≤ r10
5 , ∀ x ∈ [1, 2] ⇒ g4([1, 2]) ⊆ [1, 2]
Moreover,
|g04(x)| =
√ −5
10(4 + x)3/2
≤ 5
√10(5)3/2 < 0.15, ∀ x ∈ [1, 2].
The bound of |g04(x)|is much smaller than the bound of |g30(x)|, which explains the more rapid convergence using g4.
師大
Exercise
Page 64: 1, 3, 7, 11, 13
師大
Suppose that f : R → R and f ∈ C2[a, b], i.e., f00exists and is continuous.If f (x∗) = 0and x∗= x + hwhere h is small, then byTaylor’stheorem
0 = f (x∗) = f (x + h)
= f (x) + f0(x)h + 1
2f00(x)h2+ 1
3!f000(x)h3+ · · ·
= f (x) + f0(x)h + O(h2).
Sincehissmall, O(h2)is negligible. It is reasonable to drop O(h2)terms. This implies
f (x) + f0(x)h ≈ 0 and h ≈ −f (x)
f0(x), if f0(x) 6= 0.
Hence
x + h = x − f (x) f0(x) is a better approximation to x∗.
師大
Suppose that f : R → R and f ∈ C2[a, b], i.e., f00exists and is continuous. If f (x∗) = 0and x∗= x + hwhere h is small,then byTaylor’stheorem
0 = f (x∗) = f (x + h)
= f (x) + f0(x)h + 1
2f00(x)h2+ 1
3!f000(x)h3+ · · ·
= f (x) + f0(x)h + O(h2).
Sincehissmall, O(h2)is negligible. It is reasonable to drop O(h2)terms. This implies
f (x) + f0(x)h ≈ 0 and h ≈ −f (x)
f0(x), if f0(x) 6= 0.
Hence
x + h = x − f (x) f0(x) is a better approximation to x∗.
師大
Suppose that f : R → R and f ∈ C2[a, b], i.e., f00exists and is continuous. If f (x∗) = 0and x∗= x + hwhere h is small, then byTaylor’stheorem
0 = f (x∗) = f (x + h)
= f (x) + f0(x)h + 1
2f00(x)h2+ 1
3!f000(x)h3+ · · ·
= f (x) + f0(x)h + O(h2).
Sincehissmall, O(h2)is negligible. It is reasonable to drop O(h2)terms. This implies
f (x) + f0(x)h ≈ 0 and h ≈ −f (x)
f0(x), if f0(x) 6= 0.
Hence
x + h = x − f (x) f0(x) is a better approximation to x∗.
師大
Suppose that f : R → R and f ∈ C2[a, b], i.e., f00exists and is continuous. If f (x∗) = 0and x∗= x + hwhere h is small, then byTaylor’stheorem
0 = f (x∗) = f (x + h)
= f (x) + f0(x)h + 1
2f00(x)h2+ 1
3!f000(x)h3+ · · ·
= f (x) + f0(x)h + O(h2).
Sincehissmall, O(h2)is negligible. It is reasonable to drop O(h2)terms. This implies
f (x) + f0(x)h ≈ 0 and h ≈ −f (x)
f0(x), if f0(x) 6= 0.
Hence
x + h = x − f (x) f0(x) is a better approximation to x∗.
師大
Suppose that f : R → R and f ∈ C2[a, b], i.e., f00exists and is continuous. If f (x∗) = 0and x∗= x + hwhere h is small, then byTaylor’stheorem
0 = f (x∗) = f (x + h)
= f (x) + f0(x)h + 1
2f00(x)h2+ 1
3!f000(x)h3+ · · ·
= f (x) + f0(x)h + O(h2).
Sincehissmall, O(h2)is negligible. It is reasonable to drop O(h2)terms. This implies
f (x) + f0(x)h ≈ 0 and h ≈ −f (x)
f0(x), if f0(x) 6= 0.
Hence
x + h = x − f (x) f0(x) is a better approximation to x∗.
師大
Suppose that f : R → R and f ∈ C2[a, b], i.e., f00exists and is continuous. If f (x∗) = 0and x∗= x + hwhere h is small, then byTaylor’stheorem
0 = f (x∗) = f (x + h)
= f (x) + f0(x)h + 1
2f00(x)h2+ 1
3!f000(x)h3+ · · ·
= f (x) + f0(x)h + O(h2).
Sincehissmall, O(h2)is negligible. It is reasonable to drop O(h2)terms. This implies
f (x) + f0(x)h ≈ 0 and h ≈ −f (x)
f0(x), if f0(x) 6= 0.
Hence
x + h = x − f (x) f0(x) is a better approximation to x∗.
師大
Suppose that f : R → R and f ∈ C2[a, b], i.e., f00exists and is continuous. If f (x∗) = 0and x∗= x + hwhere h is small, then byTaylor’stheorem
0 = f (x∗) = f (x + h)
= f (x) + f0(x)h + 1
2f00(x)h2+ 1
3!f000(x)h3+ · · ·
= f (x) + f0(x)h + O(h2).
Sincehissmall, O(h2)is negligible. It is reasonable to drop O(h2)terms. This implies
f (x) + f0(x)h ≈ 0 and h ≈ −f (x)
f0(x), if f0(x) 6= 0.
Hence
x + h = x − f (x) f0(x) is a better approximation to x∗.
師大
This sets the stage for theNewton-Rapbson’smethod, which starts with an initial approximation x0 and generates the sequence {xn}∞n=0defined by
xn+1 = xn− f (xn) f0(xn).
Since the Taylor’s expansion of f (x) at xnis given by f (x) = f (xn) + f0(xn)(x − xn) +1
2f00(xn)(x − xn)2+ · · · . At xn, one uses thetangent line
y = `(x) = f (xn) + f0(xn)(x − xn)
toapproximate the curveof f (x) and uses the zero of the tangent line to approximate the zero of f (x).
師大
This sets the stage for theNewton-Rapbson’smethod, which starts with an initial approximation x0 and generates the sequence {xn}∞n=0defined by
xn+1 = xn− f (xn) f0(xn).
Since the Taylor’s expansion of f (x) at xnis given by f (x) = f (xn) + f0(xn)(x − xn) +1
2f00(xn)(x − xn)2+ · · · . At xn, one uses thetangent line
y = `(x) = f (xn) + f0(xn)(x − xn)
toapproximate the curveof f (x) and uses the zero of the tangent line to approximate the zero of f (x).
師大
This sets the stage for theNewton-Rapbson’smethod, which starts with an initial approximation x0 and generates the sequence {xn}∞n=0defined by
xn+1 = xn− f (xn) f0(xn).
Since the Taylor’s expansion of f (x) at xnis given by f (x) = f (xn) + f0(xn)(x − xn) +1
2f00(xn)(x − xn)2+ · · · . At xn, one uses thetangent line
y = `(x) = f (xn) + f0(xn)(x − xn)
toapproximate the curveof f (x) and uses the zero of the tangent line to approximate the zero of f (x).
師大
Newton’s Method
Given x0, tolerance T OL, maximum number of iteration M . Set n = 1 and x = x0− f (x0)/f0(x0).
While n ≤ M and |x − x0| ≥ T OL
Set n = n + 1, x0= xand x = x0− f (x0)/f0(x0).
End While
師大
Three stopping-technique inequalities
(a). |xn− xn−1| < ε, (b). |xn− xn−1|
|xn| < ε, xn6= 0, (c). |f (xn)| < ε.
Note that Newton’s method for solving f (x) = 0 xn+1= xn− f (xn)
f0(xn), for n ≥ 1 is just a special case of functional iteration in which
g(x) = x − f (x) f0(x).
師大
Three stopping-technique inequalities
(a). |xn− xn−1| < ε, (b). |xn− xn−1|
|xn| < ε, xn6= 0, (c). |f (xn)| < ε.
Note that Newton’s method for solving f (x) = 0 xn+1= xn− f (xn)
f0(xn), for n ≥ 1 is just a special case of functional iteration in which
g(x) = x − f (x) f0(x).
師大
Example 11
The following table shows the convergence behavior of
Newton’s method applied to solving f (x) = x2− 1 = 0. Observe the quadratic convergence rate.
n xn |en| ≡ |1 − xn|
0 2.0 1
1 1.25 0.25
2 1.025 2.5e-2
3 1.0003048780488 3.048780488e-4 4 1.0000000464611 4.64611e-8
5 1.0 0
師大
Theorem 12
Assumef (x∗) = 0, f0(x∗) 6= 0andf (x),f0(x)andf00(x)are continuouson Nε(x∗).Then if x0is chosensufficiently closeto x∗, then
xn+1 = xn− f (xn) f0(xn)
→ x∗.
Proof: Define
g(x) = x − f (x) f0(x). Find an interval [x∗− δ, x∗+ δ]such that
g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ]
and
|g0(x)| ≤ k < 1, ∀ x ∈ (x∗− δ, x∗+ δ).
師大
Theorem 12
Assumef (x∗) = 0, f0(x∗) 6= 0andf (x),f0(x)andf00(x)are continuouson Nε(x∗). Then if x0is chosensufficiently closeto x∗,then
xn+1 = xn− f (xn) f0(xn)
→ x∗.
Proof: Define
g(x) = x − f (x) f0(x). Find an interval [x∗− δ, x∗+ δ]such that
g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ]
and
|g0(x)| ≤ k < 1, ∀ x ∈ (x∗− δ, x∗+ δ).
師大
Theorem 12
Assumef (x∗) = 0, f0(x∗) 6= 0andf (x),f0(x)andf00(x)are continuouson Nε(x∗). Then if x0is chosensufficiently closeto x∗, then
xn+1 = xn− f (xn) f0(xn)
→ x∗.
Proof: Define
g(x) = x − f (x) f0(x). Find an interval [x∗− δ, x∗+ δ]such that
g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ]
and
|g0(x)| ≤ k < 1, ∀ x ∈ (x∗− δ, x∗+ δ).
師大
Theorem 12
Assumef (x∗) = 0, f0(x∗) 6= 0andf (x),f0(x)andf00(x)are continuouson Nε(x∗). Then if x0is chosensufficiently closeto x∗, then
xn+1 = xn− f (xn) f0(xn)
→ x∗.
Proof: Define
g(x) = x − f (x) f0(x). Find an interval [x∗− δ, x∗+ δ]such that
g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ]
and
|g0(x)| ≤ k < 1, ∀ x ∈ (x∗− δ, x∗+ δ).
師大
Theorem 12
Assumef (x∗) = 0, f0(x∗) 6= 0andf (x),f0(x)andf00(x)are continuouson Nε(x∗). Then if x0is chosensufficiently closeto x∗, then
xn+1 = xn− f (xn) f0(xn)
→ x∗.
Proof: Define
g(x) = x − f (x) f0(x). Find an interval [x∗− δ, x∗+ δ]such that
g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ]
and
|g0(x)| ≤ k < 1, ∀ x ∈ (x∗− δ, x∗+ δ).
師大
Since f0 is continuous and f0(x∗) 6= 0, it implies that ∃ δ1 > 0 such that f0(x) 6= 0 ∀ x ∈ [x∗− δ1, x∗+ δ1] ⊆ [a, b].Thus, g is defined and continuous on [x∗− δ1, x∗+ δ1]. Also
g0(x) = 1 − f0(x)f0(x) − f (x)f00(x)
[f0(x)]2 = f (x)f00(x) [f0(x)]2 , for x ∈ [x∗− δ1, x∗+ δ1].Since f00 is continuous on [a, b], we have g0 is continuous on [x∗− δ1, x∗+ δ1].
By assumption f (x∗) = 0, so
g0(x∗) = f (x∗)f00(x∗)
|f0(x∗)|2 = 0.
Since g0 is continuous on [x∗− δ1, x∗+ δ1]and g0(x∗) = 0, ∃ δ with 0 < δ < δ1 and k ∈ (0, 1) such that
|g0(x)| ≤ k, ∀ x ∈ [x∗− δ, x∗+ δ].
師大
Since f0 is continuous and f0(x∗) 6= 0, it implies that ∃ δ1 > 0 such that f0(x) 6= 0 ∀ x ∈ [x∗− δ1, x∗+ δ1] ⊆ [a, b]. Thus, g is defined and continuous on [x∗− δ1, x∗+ δ1].Also
g0(x) = 1 − f0(x)f0(x) − f (x)f00(x)
[f0(x)]2 = f (x)f00(x) [f0(x)]2 , for x ∈ [x∗− δ1, x∗+ δ1]. Since f00 is continuous on [a, b], we have g0 is continuous on [x∗− δ1, x∗+ δ1].
By assumption f (x∗) = 0, so
g0(x∗) = f (x∗)f00(x∗)
|f0(x∗)|2 = 0.
Since g0 is continuous on [x∗− δ1, x∗+ δ1]and g0(x∗) = 0, ∃ δ with 0 < δ < δ1 and k ∈ (0, 1) such that
|g0(x)| ≤ k, ∀ x ∈ [x∗− δ, x∗+ δ].
師大
Since f0 is continuous and f0(x∗) 6= 0, it implies that ∃ δ1 > 0 such that f0(x) 6= 0 ∀ x ∈ [x∗− δ1, x∗+ δ1] ⊆ [a, b]. Thus, g is defined and continuous on [x∗− δ1, x∗+ δ1]. Also
g0(x) = 1 − f0(x)f0(x) − f (x)f00(x)
[f0(x)]2 = f (x)f00(x) [f0(x)]2 , for x ∈ [x∗− δ1, x∗+ δ1].Since f00 is continuous on [a, b], we have g0 is continuous on [x∗− δ1, x∗+ δ1].
By assumption f (x∗) = 0, so
g0(x∗) = f (x∗)f00(x∗)
|f0(x∗)|2 = 0.
Since g0 is continuous on [x∗− δ1, x∗+ δ1]and g0(x∗) = 0, ∃ δ with 0 < δ < δ1 and k ∈ (0, 1) such that
|g0(x)| ≤ k, ∀ x ∈ [x∗− δ, x∗+ δ].
師大
Since f0 is continuous and f0(x∗) 6= 0, it implies that ∃ δ1 > 0 such that f0(x) 6= 0 ∀ x ∈ [x∗− δ1, x∗+ δ1] ⊆ [a, b]. Thus, g is defined and continuous on [x∗− δ1, x∗+ δ1]. Also
g0(x) = 1 − f0(x)f0(x) − f (x)f00(x)
[f0(x)]2 = f (x)f00(x) [f0(x)]2 , for x ∈ [x∗− δ1, x∗+ δ1]. Since f00 is continuous on [a, b], we have g0 is continuous on [x∗− δ1, x∗+ δ1].
By assumption f (x∗) = 0, so
g0(x∗) = f (x∗)f00(x∗)
|f0(x∗)|2 = 0.
Since g0 is continuous on [x∗− δ1, x∗+ δ1]and g0(x∗) = 0,∃ δ with 0 < δ < δ1 and k ∈ (0, 1) such that
|g0(x)| ≤ k, ∀ x ∈ [x∗− δ, x∗+ δ].
師大
Since f0 is continuous and f0(x∗) 6= 0, it implies that ∃ δ1 > 0 such that f0(x) 6= 0 ∀ x ∈ [x∗− δ1, x∗+ δ1] ⊆ [a, b]. Thus, g is defined and continuous on [x∗− δ1, x∗+ δ1]. Also
g0(x) = 1 − f0(x)f0(x) − f (x)f00(x)
[f0(x)]2 = f (x)f00(x) [f0(x)]2 , for x ∈ [x∗− δ1, x∗+ δ1]. Since f00 is continuous on [a, b], we have g0 is continuous on [x∗− δ1, x∗+ δ1].
By assumption f (x∗) = 0, so
g0(x∗) = f (x∗)f00(x∗)
|f0(x∗)|2 = 0.
Since g0 is continuous on [x∗− δ1, x∗+ δ1]and g0(x∗) = 0, ∃ δ with 0 < δ < δ1 and k ∈ (0, 1) such that
|g0(x)| ≤ k, ∀ x ∈ [x∗− δ, x∗+ δ].
師大
Since f0 is continuous and f0(x∗) 6= 0, it implies that ∃ δ1 > 0 such that f0(x) 6= 0 ∀ x ∈ [x∗− δ1, x∗+ δ1] ⊆ [a, b]. Thus, g is defined and continuous on [x∗− δ1, x∗+ δ1]. Also
g0(x) = 1 − f0(x)f0(x) − f (x)f00(x)
[f0(x)]2 = f (x)f00(x) [f0(x)]2 , for x ∈ [x∗− δ1, x∗+ δ1]. Since f00 is continuous on [a, b], we have g0 is continuous on [x∗− δ1, x∗+ δ1].
By assumption f (x∗) = 0, so
g0(x∗) = f (x∗)f00(x∗)
|f0(x∗)|2 = 0.
Since g0 is continuous on [x∗− δ1, x∗+ δ1]and g0(x∗) = 0,∃ δ with 0 < δ < δ1 and k ∈ (0, 1) such that
|g0(x)| ≤ k, ∀ x ∈ [x∗− δ, x∗+ δ].
師大
Since f0 is continuous and f0(x∗) 6= 0, it implies that ∃ δ1 > 0 such that f0(x) 6= 0 ∀ x ∈ [x∗− δ1, x∗+ δ1] ⊆ [a, b]. Thus, g is defined and continuous on [x∗− δ1, x∗+ δ1]. Also
g0(x) = 1 − f0(x)f0(x) − f (x)f00(x)
[f0(x)]2 = f (x)f00(x) [f0(x)]2 , for x ∈ [x∗− δ1, x∗+ δ1]. Since f00 is continuous on [a, b], we have g0 is continuous on [x∗− δ1, x∗+ δ1].
By assumption f (x∗) = 0, so
g0(x∗) = f (x∗)f00(x∗)
|f0(x∗)|2 = 0.
Since g0 is continuous on [x∗− δ1, x∗+ δ1]and g0(x∗) = 0, ∃ δ with 0 < δ < δ1 and k ∈ (0, 1) such that
|g0(x)| ≤ k, ∀ x ∈ [x∗− δ, x∗+ δ].
師大
Claim: g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
If x ∈ [x∗− δ, x∗+ δ], then, by the Mean Value Theorem, ∃ ξ between x and x∗ such that
|g(x) − g(x∗)| = |g0(ξ)||x − x∗|.
It implies that
|g(x) − x∗| = |g(x) − g(x∗)| = |g0(ξ)||x − x∗|
≤ k|x − x∗| < |x − x∗| < δ.
Hence, g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
By the Fixed-Point Theorem, the sequence {xn}∞n=0defined by xn= g(xn−1) = xn−1− f (xn−1)
f0(xn−1), for n ≥ 1, converges to x∗ for any x0 ∈ [x∗− δ, x∗+ δ].
師大
Claim: g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
If x ∈ [x∗− δ, x∗+ δ], then, by the Mean Value Theorem, ∃ ξ between x and x∗ such that
|g(x) − g(x∗)| = |g0(ξ)||x − x∗|.
It implies that
|g(x) − x∗| = |g(x) − g(x∗)| = |g0(ξ)||x − x∗|
≤ k|x − x∗| < |x − x∗| < δ.
Hence, g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
By the Fixed-Point Theorem, the sequence {xn}∞n=0defined by xn= g(xn−1) = xn−1− f (xn−1)
f0(xn−1), for n ≥ 1, converges to x∗ for any x0 ∈ [x∗− δ, x∗+ δ].
師大
Claim: g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
If x ∈ [x∗− δ, x∗+ δ], then, by the Mean Value Theorem, ∃ ξ between x and x∗ such that
|g(x) − g(x∗)| = |g0(ξ)||x − x∗|.
It implies that
|g(x) − x∗| = |g(x) − g(x∗)| = |g0(ξ)||x − x∗|
≤ k|x − x∗| < |x − x∗| < δ.
Hence, g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
By the Fixed-Point Theorem, the sequence {xn}∞n=0defined by xn= g(xn−1) = xn−1− f (xn−1)
f0(xn−1), for n ≥ 1, converges to x∗ for any x0 ∈ [x∗− δ, x∗+ δ].
師大
Claim: g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
If x ∈ [x∗− δ, x∗+ δ], then, by the Mean Value Theorem, ∃ ξ between x and x∗ such that
|g(x) − g(x∗)| = |g0(ξ)||x − x∗|.
It implies that
|g(x) − x∗| = |g(x) − g(x∗)| = |g0(ξ)||x − x∗|
≤ k|x − x∗| < |x − x∗| < δ.
Hence, g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
By the Fixed-Point Theorem, the sequence {xn}∞n=0defined by xn= g(xn−1) = xn−1− f (xn−1)
f0(xn−1), for n ≥ 1, converges to x∗ for any x0 ∈ [x∗− δ, x∗+ δ].
師大
Claim: g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
If x ∈ [x∗− δ, x∗+ δ], then, by the Mean Value Theorem, ∃ ξ between x and x∗ such that
|g(x) − g(x∗)| = |g0(ξ)||x − x∗|.
It implies that
|g(x) − x∗| = |g(x) − g(x∗)| = |g0(ξ)||x − x∗|
≤ k|x − x∗| < |x − x∗| < δ.
Hence, g([x∗− δ, x∗+ δ]) ⊆ [x∗− δ, x∗+ δ].
By the Fixed-Point Theorem, the sequence {xn}∞n=0defined by xn= g(xn−1) = xn−1− f (xn−1)
f0(xn−1), for n ≥ 1, converges to x∗ for any x0 ∈ [x∗− δ, x∗+ δ].
師大
Example 13
When Newton’s method applied to f (x) = cos x with starting point x0 = 3, which is close to the root π2 of f , it produces x1 = −4.01525, x2= −4.8526, · · · ,which converges to another root −3π2 .
5 4 3 2 1 0 1 2 3 4 5
1. 5 0 1.5
x0 y = c os ( x)
x*
師大