The Proof: Negative Examples

Exponential Circuit Complexity for NP-Complete Problems

• We shall prove exponential lower bounds for NP-complete problems using monotone circuits.

– Monotone circuits are circuits without ¬ gates.

• Note that this does not settle the P vs. NP problem or any of the conjectures on p. 544.

The Power of Monotone Circuits

• Monotone circuits can only compute monotone boolean functions.

• They are powerful enough to solve a P-complete problem, monotone circuit value (p. 266).

• There are NP-complete problems that are not monotone;

they cannot be computed by monotone circuits at all.

• There are NP-complete problems that are monotone;

they can be computed by monotone circuits.

– hamiltonian path and clique.

clique

• clique_n,k is the boolean function deciding whether a graph G = (V, E) with n nodes has a clique of size k.

• The input gates are the ¡_n

2

¢ entries of the adjacency matrix of G.

– Gate g_ij is set to true if the associated undirected edge { i, j } exists.

• clique_n,k is a monotone function.

• Thus it can be computed by a monotone circuit.

Crude Circuits

• One possible circuit for clique_n,k does the following.

1. For each S ⊆ V with |S| = k, there is a circuit with O(k²) ∧-gates testing whether S forms a clique.

2. We then take an or of the outcomes of all the ¡_n

k

¢ subsets S₁, S₂, . . . , S(ⁿ_k).

• This is a monotone circuit with O(k²¡_n

k

¢) gates, which is exponentially large unless k or n − k is a constant.

• A crude circuit CC(X₁, X₂, . . . , X_m) tests if any of X_i ⊆ V forms a clique.

– The above-mentioned circuit is CC(S₁, S₂, . . . , S(ⁿ_k)).

The Proof: Positive Examples

• Analysis will be applied to only positive examples and negative examples as inputs.

• A positive example is a graph that has ¡_k

2

¢ edges connecting k nodes in all possible ways.

• There are ¡_n

k

¢ such graphs.

• They all should elicit a true output from clique_n,k.

The Proof: Negative Examples

• Color the nodes with k − 1 different colors and join by an edge any two nodes that are colored differently.

• There are (k − 1)ⁿ such graphs.

• They all should elicit a false output from clique_n,k. – Each set of k nodes must have 2 identically colored

nodes; hence there is no edge between them.

Positive and Negative Examples with k = 5

$SRVLWLYHH[DPSOH $QHJDWLYHH[DPSOH

Sunflowers

• Fix p ∈ Z⁺ and ` ∈ Z⁺.

• A sunflower is a family of p sets {P₁, P₂, . . . , P_p}, called petals, each of cardinality at most `.

• Furthermore, all pairs of sets in the family must have the same intersection (called the core of the sunflower).

FRUH

A Sample Sunflower

{{1, 2, 3, 5}, {1, 2, 6, 9}, {0, 1, 2, 11}, {1, 2, 12, 13}, {1, 2, 8, 10}, {1, 2, 4, 7}}.



Æ¿³È

É¿³Ì

Ë¿³Äà ǿ³Ê

ÿ³ÄÄ ÄÅ¿³ÄÆ

The Erd˝os-Rado Lemma

Lemma 83 Let Z be a family of more than M = (p − 1)<sup>`</sup>`!

nonempty sets, each of cardinality ` or less. Then Z must contain a sunflower (with p petals).

• Induction on `.

• For ` = 1, p different singletons form a sunflower (with an empty core).

• Suppose ` > 1.

• Consider a maximal subset D ⊆ Z of disjoint sets.

– Every set in Z − D intersects some set in D.

The Proof of the Erd˝os-Rado Lemma (continued)

For example,

Z = {{1, 2, 3, 5}, {1, 3, 6, 9}, {0, 4, 8, 11}, {4, 5, 6, 7}, {5, 8, 9, 10}, {6, 7, 9, 11}}, D = {{1, 2, 3, 5}, {0, 4, 8, 11}}.

The Proof of the Erd˝os-Rado Lemma (continued)

• Suppose D contains at least p sets.

– D constitutes a sunflower with an empty core.

• Suppose D contains fewer than p sets.

– Let C be the union of all sets in D.

– | C | ≤ (p − 1)`.

– C intersects every set in Z by D’s maximality.

– There is a d ∈ C that intersects more than

M

(p−1)` = (p − 1)<sup>`−1</sup>(` − 1)! sets in Z.

– Consider Z⁰ = {Z − {d} : Z ∈ Z, d ∈ Z}.

The Proof of the Erd˝os-Rado Lemma (concluded)

• (continued)

– Z⁰ has more than M⁰ = (p − 1)<sup>`−1</sup>(` − 1)! sets.

– M⁰ is just M with ` replaced with ` − 1.

– Z⁰ contains a sunflower by induction, say {P₁, P₂, . . . , P_p}.

– Now,

{P₁ ∪ {d}, P₂ ∪ {d}, . . . , P_p ∪ {d}}

is a sunflower in Z.

Comments on the Erd˝os-Rado Lemma

• A family of more than M sets must contain a sunflower.

• Plucking a sunflower means replacing the sets in the sunflower by its core.

• By repeatedly finding a sunflower and plucking it, we can reduce a family with more than M sets to a family with at most M sets.

• If Z is a family of sets, the above result is denoted by pluck(Z).

• Note: pluck(Z) is not unique.

An Example of Plucking

• Recall the sunflower on p. 700:

Z = {{1, 2, 3, 5}, {1, 2, 6, 9}, {0, 1, 2, 11}, {1, 2, 12, 13}, {1, 2, 8, 10}, {1, 2, 4, 7}}

• Then

pluck(Z) = {{1, 2}}.

Razborov’s Theorem

Theorem 84 (Razborov (1985)) There is a constant c such that for large enough n, all monotone circuits for clique_n,k with k = n^1/4 have size at least n^cn1/8.

• We shall approximate any monotone circuit for clique_n,k by a restricted kind of crude circuit.

• The approximation will proceed in steps: one step for each gate of the monotone circuit.

• Each step introduces few errors (false positives and false negatives).

• But the final crude circuit has exponentially many errors.

The Proof

• Fix k = n^1/4.

• Fix ` = n^1/8.

• Note that^a

2 µ`

2

¶

≤ k − 1.

• p will be fixed later to be n^1/8 log n.

• Fix M = (p − 1)<sup>`</sup>`!.

– Recall the Erd˝os-Rado lemma (p. 701).

aCorrected by Mr. Moustapha Bande (D98922042) on January 05,

The Proof (continued)

• Each crude circuit used in the approximation process is of the form CC(X₁, X₂, . . . , X_m), where:

– X_i ⊆ V . – |X_i| ≤ `.

– m ≤ M .

• It answers true if any X_i is a clique.

• We shall show how to approximate any circuit for clique_n,k by such a crude circuit, inductively.

• The induction basis is straightforward:

– Input gate g_ij is the crude circuit CC({i, j}).

The Proof (continued)

• Any monotone circuit can be considered the or or and of two subcircuits.

• We shall show how to build approximators of the overall circuit from the approximators of the two subcircuits.

– We are given two crude circuits CC(X ) and CC(Y).

– X and Y are two families of at most M sets of nodes, each set containing at most ` nodes.

– We construct the approximate or and the approximate and of these subcircuits.

– Then show both approximations introduce few errors.

The Proof: or

• CC(X ∪ Y) is equivalent to the or of CC(X ) and CC(Y).

– A set of nodes C ∈ X ∪ Y is a clique if and only if C ∈ X is a clique or C ∈ Y is a clique.

• Violations in using CC(X ∪ Y) occur when |X ∪ Y| > M .

• Such violations can be eliminated by using CC(pluck(X ∪ Y))

as the approximate or of CC(X ) and CC(Y).

The Proof: or

• If CC(Z) is true, then CC(pluck(Z)) must be true.

– The quick reason: If Y is a clique, then a subset of Y must also be a clique.

– For each Y ∈ X ∪ Y, there must exist at least one X ∈ pluck(X ∪ Y) such that X ⊆ Y .

– If Y is a clique, then this X is also a clique.

• We now bound the number of errors this approximate or makes on the positive and negative examples.

The Number of False Negatives (concluded)

Y

X

The Proof: or (concluded)

• CC(pluck(X ∪ Y)) introduces a false positive if a

negative example makes both CC(X ) and CC(Y) return false but makes CC(pluck(X ∪ Y)) return true.

• CC(pluck(X ∪ Y)) introduces a false negative if a positive example makes either CC(X ) or CC(Y) return true but makes CC(pluck(X ∪ Y)) return false.

• How many false positives and false negatives are introduced by CC(pluck(X ∪ Y))?

The Number of False Positives

Lemma 85 CC(pluck(X ∪ Y)) introduces at most

M

p−1 2^−p(k − 1)ⁿ false positives.

• A plucking replaces the sunflower {Z₁, Z₂, . . . , Z_p} with its core Z.

• A false positive is necessarily a coloring such that:

– There is a pair of identically colored nodes in each petal Z_i (and so both crude circuits return false).

– But the core contains distinctly colored nodes.

∗ This implies at least one node from each same-color pair was plucked away.

• We now count the number of such colorings.

Proof of Lemma 85 (continued)

Proof of Lemma 85 (continued)

• Color nodes V at random with k − 1 colors and let R(X) denote the event that there are repeated colors in set X.

• Now prob[R(Z₁) ∧ · · · ∧ R(Z_p) ∧ ¬R(Z)] is at most prob[R(Z₁) ∧ · · · ∧ R(Z_p)|¬R(Z)]

=

Yp i=1

prob[R(Z_i)|¬R(Z)] ≤ Yp i=1

prob[R(Z_i)]. (12)

– First equality holds because R(Z_i) are independent given ¬R(Z) as Z contains their only common nodes.

– Last inequality holds as the likelihood of repetitions in Z_i decreases given no repetitions in Z ⊆ Z_i.

Proof of Lemma 85 (continued)

• Consider two nodes in Z_i.

• The probability that they have identical color is _k−1¹ .

• Now prob[ R(Z_i) ] ≤ (^|Zi|₂ )

k−1 ≤ (2^`)

k−1 ≤ ¹₂.

• So the probability^a that a random coloring is a new false positive is at most 2^−p by inequality (12).

• As there are (k − 1)ⁿ different colorings, each plucking introduces at most 2^−p(k − 1)ⁿ false positives.

aProportion, i.e.

Proof of Lemma 85 (concluded)

• Recall that | X ∪ Y | ≤ 2M .

• pluck(X ∪ Y) ends the moment the set system contains

≤ M sets.

• Each plucking reduces the number of sets by p − 1.

• Hence at most _p−1^M pluckings occur in pluck(X ∪ Y).

• At most

M

p − 1 2^−p(k − 1)ⁿ false positives are introduced.^a

aNote that the numbers of errors are added not multiplied. Recall that we count how many new errors are introduced by each approximation step. Contributed by Mr. Ren-Shuo Liu (D98922016) on January 5, 2010.

The Number of False Negatives

Lemma 86 CC(pluck(X ∪ Y)) introduces no false negatives.

• A plucking replaces sets in a crude circuit by their (common) subset.

• This makes the test for cliqueness less stringent (p. 712).

The Proof: and

• The approximate and of crude circuits CC(X ) and CC(Y) is

CC(pluck({X_i ∪ Y_j : X_i ∈ X , Y_j ∈ Y, |X_i ∪ Y_j| ≤ `})).

• We now count the number of errors this approximate and makes on the positive and negative examples.

The Proof: and (concluded)

• The approximate and introduces a false positive if a negative example makes either CC(X ) or CC(Y) return false but makes the approximate and return true.

• The approximate and introduces a false negative if a positive example makes both CC(X ) and CC(Y) return true but makes the approximate and return false.

• How many false positives and false negatives are introduced by the approximate and?

The Number of False Positives

Lemma 87 The approximate and introduces at most M²2^−p(k − 1)ⁿ false positives.

• We prove this claim in stages.

• CC({X_i ∪ Y_j : X_i ∈ X , Y_j ∈ Y}) introduces no false positives.

– If X_i ∪ Y_j is a clique, both X_i and Y_j must be

cliques, making both CC(X ) and CC(Y) return true.

• CC({X_i ∪ Y_j : X_i ∈ X , Y_j ∈ Y, |X_i ∪ Y_j| ≤ `}) introduces no additional false positives because we are testing fewer sets for cliqueness.

Proof of Lemma 87 (concluded)

• | {X_i ∪ Y_j : X_i ∈ X , Y_j ∈ Y, |X_i ∪ Y_j| ≤ `} | ≤ M².

• Each plucking reduces the number of sets by p − 1.

• So pluck({X_i ∪ Y_j : X_i ∈ X , Y_j ∈ Y, |X_i ∪ Y_j| ≤ `}) involves ≤ M²/(p − 1) pluckings.

• Each plucking introduces at most 2^−p(k − 1)ⁿ false positives by the proof of Lemma 85 (p. 715).

• The desired upper bound is

[ M²/(p − 1) ] 2^−p(k − 1)ⁿ ≤ M²2^−p(k − 1)ⁿ.

The Number of False Negatives

Lemma 88 The approximate and introduces at most M²¡_n−`−1

k−`−1

¢ false negatives.

• We again prove this claim in stages.

• CC({X_i ∪ Y_j : X_i ∈ X , Y_j ∈ Y}) introduces no false negatives.

– Suppose both CC(X ) and CC(Y) accept a positive example with a clique of size k.

– This clique must contain an X_i ∈ X and a Y_j ∈ Y.

∗ This is why both CC(X ) and CC(Y) return true.

– As the clique contains X_i ∪ Y_j, the new circuit returns true.

Proof of Lemma 88 (continued)

Y_j X_i

Clique of size k

Proof of Lemma 88 (continued)

• CC({X_i ∪ Y_j : X_i ∈ X , Y_j ∈ Y, |X_i ∪ Y_j| ≤ `}) introduces

≤ M²¡_n−`−1

k−`−1

¢ false negatives.

– Deletion of set Z = X_i ∪ Y_j larger than ` introduces false negatives only if Z is part of a clique.

– There are ¡_n−|Z|

k−|Z|

¢ such cliques.

∗ It is the number of positive examples whose clique contains Z.

– ¡_n−|Z|

k−|Z|

¢ ≤ ¡_n−`−1

k−`−1

¢ as |Z| > `.

– There are at most M² such Zs.

Proof of Lemma 88 (concluded)

• Plucking introduces no false negatives.

– Recall that if CC(Z) is true, then CC(pluck(Z)) must be true (p. 712).

Two Summarizing Lemmas

From Lemmas 85 (p. 715) and 87 (p. 723), we have:

Lemma 89 Each approximation step introduces at most M²2^−p(k − 1)ⁿ false positives.

From Lemmas 86 (p. 720) and 88 (p. 725), we have:

Lemma 90 Each approximation step introduces at most M²¡_n−`−1

k−`−1

¢ false negatives.

The Proof (continued)

• The above two lemmas show that each approximation step introduces “few” false positives and false negatives.

• We next show that the resulting crude circuit has “a lot” of false positives or false negatives.

The Final Crude Circuit

Lemma 91 Every final crude circuit is:

1. Identically false—thus wrong on all positive examples.

2. Or outputs true on at least half of the negative examples.

• Suppose it is not identically false.

• By construction, it accepts at least those graphs that have a clique on some set X of nodes, with | X | ≤ `, which at n^1/8 is less than k = n^1/4.

• The proof of Lemma 85 (p. 715ff) shows that at least half of the colorings assign different colors to nodes in X.

• So half of the negative examples have a clique in X and are accepted.

The Proof (continued)

• Recall the constants on p. 708: k = n^1/4, ` = n<sup>1/8</sup>, p = n<sup>1/8</sup> log n, M = (p − 1)<sup>`</sup>`! < n^(1/3)n1/8 for large n.

• Suppose the final crude circuit is identically false.

– By Lemma 90 (p. 729), each approximation step introduces at most M²¡_n−`−1

k−`−1

¢ false negatives.

– There are ¡_n

k

¢ positive examples.

– The original monotone circuit for clique_n,k has at least

¡_n

k

¢ M²¡_n−`−1

k−`−1

¢ ≥ 1 M²

µn − ` k

¶_`

≥ n^(1/12)n1/8

The Proof (concluded)

• Suppose the final crude circuit is not identically false.

– Lemma 91 (p. 731) says that there are at least (k − 1)ⁿ/2 false positives.

– By Lemma 89 (p. 729), each approximation step introduces at most M²2^−p(k − 1)ⁿ false positives – The original monotone circuit for clique_n,k has at

least

(k − 1)ⁿ/2

M²2^−p(k − 1)ⁿ = 2^p−1

M² ≥ n^(1/3)n1/8 gates.

Alexander Razborov (1963–)

P 6= NP Proved?

• Razborov’s theorem says that there is a monotone language in NP that has no polynomial monotone circuits.

• If we can prove that all monotone languages in P have polynomial monotone circuits, then P 6= NP.

• But Razborov proved in 1985 that some monotone languages in P have no polynomial monotone circuits!

Finis