### Logic, Language, and Computation

### ─ A Historic Journey

Yuh-Dauh Lyuu (呂育道) Department of Computer Science & Information

Engineering Department of Finance National Taiwan University July 13, 2007

### I have never done anything “useful.”

### ─ Godfrey Harold Hardy (1877–1947),

*A Mathematician’s Apology (1940)*

## Language

### Whereof one cannot speak, thereof one must be silent.

### ─ Ludwig Wittgenstein (1889–1951),

*Tractatus Logico-Philosophicus (1918)*

### Language

### z The characteristics of language.

### { Syntax.

### { Semantics.

### { Pronunciation.

### { Evolutionary theories.

### { …

### Examples

All animals are equal but some are more equal than others.

─ *George Orwell (1903–1950), Animal Farm (1945)*
z What does it mean?

z What is the context?

z Can’t it be more precise?

z Do you even want it to be precise?

### Examples (cont.)

### I'm not a woman you can trust.

### ─ Sharon Stone to Sylvester Stallone on the phone,

*The Specialist (1994)*

z

### What does it convey?

z

### Self-loops?

### Examples (cont.)

If I am I because you are you, and if you are you because I am I, then I am not I, and you are not you.

─ Hassidic rabbi z It is syntactic.

z What can it possibly mean?

z Is it nonsense?

### Examples (cont.)

“If the king of Taiwan is a man, then he is not a woman.”

z True formally?

z This sentence seems meaningful.

z But does it convey any knowledge?

z Do you need to assume such a king exists?

z Must a sentence’s components correspond to entities in the physical world?

### Examples (concluded)

It is, I own, not uncommon to be wrong in theory and right in practice[.]

─ Edmund Burke (1729–1797),

*A Philosophical Enquiry into the Origin of Our Ideas of the Sublime *
*and Beautiful (1757)*

z What does it mean for a statement to be right or wrong?

z How do you verify a sentence?

z What is truth?

z Must truth correspond to facts?

{What is fact? What is correspondence?

### Ordinary Language vs. the Language of Science

### z Precision (no ambiguities?).

### z Clarity (no metaphysics?)

### z Denotation (existence in the external world?).

### z Intention.

### z Consistency (freedom from internal contradictions).

### z Completeness (no indeterminancy).

### z Decidability (finitely computable in principle).

## Symbolic Logic

### Formal Language and Symbolic Logic

z Start with a formal language.

z *Equip it with sound inference rules.*

z Phrase every mathematical (even philosophical and scientific) questions in this language.

z Deduce all valid sentences.

z If your basic axioms are complete and verified by experiences, then you have solved all problems in principle.

z Logical positivism postulates that all other approaches to philosophy are meaningless.

### It is wrong to think that the task of

### physics is to find out how Nature is.

### Physics concerns what we can say about Nature.

### ─ Niels Bohr (1885–1962)

### Symbolic Logic

z Start with logic for mathematics (“investigates the logical components of mathematics” ─ Zermelo (1908)).

{It is easier.

{Exact sciences have been mathematized for hundreds of years, maybe starting with Galileo (1564–1642).

{If mathematics does not have a solid foundation, modern science might be shaky.

{The logicism of Frege (1848–1925) and Russell (1872–1970) posited mathematics can be reduced to logic.

The fact that all Mathematics is Symbolic Logic is one of the greatest discoveries of our age; and when this fact has been established, the remainder of the principles of mathematics consists in the analysis of Symbolic Logic itself.

─ *Bertrand Russell, The Principles of Mathematics (1903)*

[Russell's] philosophical influence,

directly and indirect, over his long period has been unequaled.

─ Willard Van Orman Quine (1908–2000),
*Theory and Things (1981)*

### Modern Mathematical Logic

z Invented by Gottlob Frege’s

*(1848–1925) Begriffsschrift (1879).*

z Goal: A system that axiomatizes arithmetic and deduces all

theorems of integers.

### Modern Mathematical Logic (concluded)

z Need

{*Constants and variables (¯, x, y, z,…).*

{A set of logical connectives (∀,$,ﬂ,⁄,¤,Ÿ, (, ),

### œ,¢

^{).}

{*Predicates (P, Q, …)*

{A precise language syntax to state mathematical results.

{A mechanism for valid inferences.

### Requirements of a Formal System

z Consistency (Hilbert (1900)).

z Completeness (Hilbert (1918)).

{*For every formula A, either A or ŸA is provable.*

{Every provable formula is valid, and conversely (Bernays (1918)).

z Independence of axioms (Huntington (1902) and Veblen (1904)).

z Decidability (Hilbert (1918)).

{Given a mathematical statement, “decide” in a finite number of steps whether it is true or not from the axiom system.

{*Entscheidungsproblem (the decision problem) is the term by *
Behmann (1921).

### Russell’s Paradox (May 1901)

z Consider the set

{*If RœR, then R–R by definition.*

{*If R–R, then RœR also by definition.*

{In either case, we have a “contradiction.”

z Russell sent the paradox to Frege on June 16, 1902.

z Frege’s system collapsed.

### {

^{:}

### }

^{.}

*R* = *A A*∉ *A*

### Russell’s Angst

*In his Autobiography, vol. 1 (1967), Russell wrote,*

It seemed unworthy of a grown man to spend his time on such trivialities, but what was I to do?

### Implications of Russell’s Paradox

z Perhaps the most fundamental paradox in modern mathematics.

z The “problem” comes from naïve set theory of Georg Cantor (1845–1918).

{Axiom of abstraction (comprehension) postulates that any
*proposition P(x) defines a set {x: P(x)}.*

### Implications of Russell’s Paradox (concluded)

z An intensive search for the sound foundations of mathematics (thus supposedly anything above it) followed.

{Three schools: Hilbert’s formalism, Russell & Whitehead’s logicism, and Brouwer’s intuitionism.

z Most attempt to restrict what constitutes a set.

z Whitehead and Russell created a massive 3-volume work,

*Principia Mathematica (1910, 1912, 1913), that attempts to be the *
new foundation for mathematics, free of contradictions.

{It proves 1+1=2 on p. 362.

z If a contradiction shatters existing believes that one is unwilling to give up, then it is a paradox (Kuhn (1962)).

### Self-Loops in Ordinary Languages

z Ordinary languages are “universal,” allowing self-references (Tarski (1933)).

z Eubulides: The Cretan says, “All Cretans are liars.”

z Liar's paradox: “This sentence is false.”

z “My covenant will I not break, nor alter the thing that is gone
*out of my lips.” (Psalms 89:34)*

z “Moses was the most humble person in all the world[…]”

*(Numbers 12:3).*

z “For the LORD your God is God of gods, and Lord of
*lords[…]” (Deuteronomy 10:17)*

z “Thou, O king [Nebuchadnezzar], art a king of kings[…]”

*(Daniel 2:37)*

我必不背棄我的約、也不改變我口中所出的。

王阿[尼布甲尼撒]、你是諸王之王

因為耶和華你們的神他是萬神之神、萬主之主

### Self-Loops in Formal Languages

z Russell’s paradox contains self-loops:

z Naturally, one way to avoid it is to define sets in a hierarchy.

z In the most popular axiomatic set theory Zermelo-Fraenkel-
*Skolem (ZFS), Russell’s R is not a set any more.*

### .

*A* ∉ *A*

### Self-Loops in M.C. Escher (1898–1972)

### Hilbert’s Program

z David Hilbert (1862–1943) in 1900 and 1921 proposed to found mathematics on axiomatic systems (Zach (2003)).

{Geometry, analysis, number theory, etc.

z He asked for “proof” for the consistency of the axioms.

{No paradoxes or contradictions.

{Proof is purely symbolic (no direct intuitive meaning).

{Proof must be “finitary,” to answer intuitionism.

z He believed all meaningful mathematical problems are solvable:

There is the problem. Seek its solution. You can find it by pure
*reason, for in mathematics, there is no ignorabimus.*

### Hilbert’s Program (concluded)

z Hilbert’s proof-theoretical philosophy for the foundation of mathematics is called formalism.

z Since 1914, his school started to be influenced by the logic
*system of Principia Mathematica.*

z Some concrete problems for any axiomatic system of mathematics:

{Are the axioms complete?

{Are the axioms consistent?

{Are the validities in first-order logic decidable?

### Wir müssen wissen, wir werden wissen.

### (We must know, we shall know.)

### ─ David Hilbert (1900)

### Gödel’s Completeness Theorem

z In 1929, Kurt Gödel (1906–1978) proved that the first-order logic is “complete.”

{His Ph.D. thesis (1930).

{Every valid formula admits of a finite formal proof.

{Truth is thus equivalent to provability.

The Completeness Theorem, mathematically, is indeed an almost trivial consequence of Skolem 1923. […] It lies in the widespread lack, at that time, of the required epistemological attitude toward metamathematics and toward non-finitary reasoning.

─ Kurt Gödel (1967)

Such completeness was expected. […]

But an actual proof of completeness was less expected, and a notable

accomplishment.

─ *Willard Van Orman Quine, Theory *
*and Things (1981)*

### Gödel’s Incompleteness Theorems

z In 1930, Gödel proved two incompleteness theorems.

z Elementary arithmetic is incomplete.

{There are undecidable propositions in any sufficiently strong formal system involving only + and ä.

z *Consistency of number theory cannot be proved within the *
system.

{Independently by von Neumann, according to Wang (1996).

{A full 70-page proof was given by Hilbert and Bernays (1939).

z Every sufficiently strong formal system is either inconsistent or incomplete.

### Gödel’s Proof

z *The proof uses self-loops: liar's paradox.*

z *Gödel constructed an arithmetic statement G that says*

*“G cannot be proved.”*

{We skip the details that avoid paradoxes.

{Gödel called it a “parlor trick” (Kreisel (1980)).

z *G can be proved if and only if it is false.*

z *Hence G must be true but unprovable.*

z *The incompleteness result sealed Gödel’s immortality.*

### Why the Proof?

z The proof seemed to “confuse” many people: Zermelo (1931), Wittgenstein (1983), Russell (1963), Chaitin (2005), etc.

z There is an indirect proof, that truth about propositions must be expressed in a metalanguage according to Tarski (1933).

{To avoid liar’s paradox.

z Gödel did not take that shorter route even though he was aware of it as early as 1931 (Kennedy (2007)).

{The dominant thinking at that time was that truth equals provability.

{So his paper might have been rejected otherwise (Feferman (1983))?

{Philosophical inclinations (Krajewski (2004))?

### Far-Reaching Consequences

z Mathematical truth may not be founded upon provability.

{How about philosophical truths, political truths, legal truths, economic truths, theological truths?

z *There is no absolute consistency proof of all of mathematics.*

{Relative consistency proof of elementary arithmetic is given by Gentzen in 1936.

z Hilbert’s original goals were dashed.

{John von Neumann saw it in 1931.

{Gödel was convinced of it after Turing’s (1937) work on computing machines.

### Impacts on Mathematics

z So Gödel proved that certain formalized systems are incomplete.

z *But are there absolutely undecidable statements?*

z Gödel agreed with “Hilbert’s original rationalistic conception”

that there is none.

z Do Gödel’s results impact working mathematicians?

z No famous mathematical statement conjectured to be true has been proved undecidable in axiomatic set theory (Feferman (2006))?

### It was anti-Platotic prejudice which prevented people from obtaining my results.

### ─ Gödel to Wang (1976)

### I represent this very crude, naïve kind of anti-Platonism[.]

### ─ Alfred Tarski (1902–1983) in 1965

### I would have proved Gödel’s

### Theorem in 1921 ─ had I been Gödel.

### ─ Emil Post (1897–1954) to Gödel

### (1938)

## Computation

It is unworthy of excellent men to lose hours like slaves in the labor of computation.

─ Gottfried Wilhelm von Leibniz (1646-1716)

### What Is Computation?

z *Entscheidungsproblem: As first-order logic is complete, is there an *
algorithm that tells you if a statement is true (provable) or not?

z To answer it, we need a rigorous definition of computation.

z *Intuitively, an algorithm is a finite mechanical procedure that ends *
with the right answer.

{Multiplication.

{Euclid’s algorithm for the greatest common divisor (GCD).

{Polynomial multiplication.

{Primality testing.

z It is a “mental” proces (with the help of paper and pencil).

### What Is Computation? (concluded)

z But how do you formalize this notion?

z What are the essential elements of computation?

{What are the primitive operations, for example?

z This is a philosophical question.

z We approach a “mental” phenomenon in a scientific way.

z We will never hope to prove a formalism is correct.

z A counterexample can convince us of its inadequacy.

z But what constitutes a counterexample anyway?

### Tarski has stressed in his lecture (and I think justly) the great importance of the concept of general recursiveness (or Turing's computability).

### ─ *Kurt Gödel, Princeton Lectures (1946)*

### Computation Models

z In 1930–6 (and later), various models have been proposed for computation.

{Church (1903–1995), Gödel in 1934, Kleene (1909–1994), Post (1897–1954), and Turing (1912–1954).

{The most famous is the Turing machine.

{They are all shown to be equivalent.

z Nowadays, we call them “computer programs.”

### A Turing Machine

1000110000111001110001110

### Church’s Thesis

z Church’s thesis (1935) states:

To be computable is to be Turing machine-computable.

{This term is due to Kleene.

z Once the notion of computation is defined, computability follows.

z This is the birth of computer science.

If you ask who is the greatest logician of this century, no question it's

Gödel, but Church was really pre- eminent among American

logicians.

─ Simon B. Kochen

Alan Turing. Stephen Kleene.

*Entscheidungsproblem*

z *Entscheidungsproblem is now shown to be unsolvable.*

{Church (1935), Kleene (1936), Post (1936), and Turing (1936).

{Turing (1936) is independent of Church (1935).

z In other words, first-order logic is (computably) undecidable.

z This is known as Church’s theorem.

z Gödel’s completeness theorem is nonconstructive.

z A proof for validity may exist, but there is no program that can verify it in finite time.

The ancient world takes its

stand upon the drama of the Universe, the modern world upon the inward drama of the Soul.

─ Alfred North Whitehead (1861–1947)

### Minds, Formal Systems, Computers

z According to Quine (1981),

[Gödel] thought it possible for the mind to transcend formal proof procedures and thus not be bound by his

incompleteness theorem.

z Gödel believed mind is separate from matter.

z Mathematicians choose the axioms that are “truths.”

z It is a mathematician’s intuition that gives the axioms.

z Turing also did not think mental process is purely mechanical (Sieg (2006)).

### Conclusions

z We started with very innocent questions: is mathematics consistent, complete, true, decidable, etc.?

z Gödel destroyed all hopes of positive answers.

z Working mathematicians probably do not care (that much).

z Is truth lost?

z We also ended up with a machine and a revolution.

z We are asking if minds are basically computers.

### Bibliography

z *Boolos, George S. and Richard C. Jeffrey. Computability and Logic. *

3rd ed. Cambridge: Cambridge University Press, 1989.

z *Chaitin, Gregory. Meta Math! The Quest for Omega. New York: *

Vintage, 2005.

z *Davis, Martin. (Ed.) The Undecidable: Basic Papers on Undecidable*

*Propositions, Unsolvable Problems and Computable Functions. New York: *

Raven Press, 1965.

z *Davis, Martin. “The Incompleteness Theorem.” Notices of the *
*AMS, 53, No. 4 (April 2006), 414–418.*

z *Dawson, John W., Jr. Logical Dilemmas: The life and Work of Kurt *
*Gödel. Wellesley, MA: AK Peters, 1997.*

z *Edmonds, David and John Eidinow. Wittgenstein's Poker: The Story *
*of a Ten-Minute Argument Between Two Great Philosophers. New York: *

HarperCollins, 2001.

z Feferman, Solomon. “Kurt Gödel: Conviction and Caution.” In
*P. Weingartner and Ch. Puhringer (Eds.), Philosophy of Science *─
*History of Science, A Selection of Contributed Papers of the Seventh *

*International Congress of Logic, Methodology and Philosophy of Science, *
Salzburg, 1983.

z *Feferman, Anita and Solomon Feferman. Alfred Tarski: Life and *
*Logic. Cambridge: Cambridge University Press, 2005.*

z Feferman, Solomon. “The Impact of the Incompleteness

*Theorems on Mathematics.” Notices of the AMS, 53, No. 4 (April *
2006), 434–439.

z *Frazén, Torkel. Gödel’s Theorem: An Incomplete Guide to Its Use and *
*Abuse. Wellesley, MA: AK Peters, 2005. *

z *Frazén, Torkel. “The Popular Impact of Gödel’s Incompleteness *
*Theorem.” Notices of the AMS, 53, No. 4 (April 2006), 440–443.*

z *Hamilton, A. G. Logic for Mathematicians. Revised ed. Cambridge: *

Cambridge University Press, 1988.

z Hartmanis, Juris. “Turing Award Lecture: On Computational
*Complexity and the Nature of Computer Science.” ACM *

*Computing Surveys, 27, No. 1 (March 1995), 7–16.*

z *Herken, Rolf. (Ed.) The Universal Turing Machine: A Half-Century *
*Survey. Oxford: Oxford University Press, 1988.*

z Hilbert, David. “Mathematical Problems.” Lecture delivered at the World Congress of Mathematicians in Paris, 1900.

z *Hodger, A. Alan Turing: The Enigma. New York: Simon & *

Schuster, 1983.

z *Hofstadter, Douglas R. Gödel, Escher, Bach: An Eternal Golden *
*Braid. New York: Vintage Books, 1980.*

z *Hook, Syndey. Out of Step: An Unquiet Life in the 20th Century. *

New York: HarperCollins, 1987.

z *Hughes, Patrick and George Brecht. Vicious Circles and infinity: An *
*Anthology of Paradoxes. Middlesex, UK: Penguin, 1978.*

z *Kennedy, Juliette. “Kurt Gödel.” Stanford Encyclepedia of Philosophy, *
2007.

z *Krajewski, Stanisław. “Gödel on Tarski.” Annals of Pure and *
*Applied Logic, Vol. 127 (2004), 303–323.*

z *Kleene, Stephen Cole. Mathematical Logic. New York: John Wiley, *
1967.

z *Knuth, Donald E. The Art of Computer Programming. 3 volumes. *

Reading, MA: Addison-Wesley.

z *Kreisel, Georg. “Kurt Gödel: 1906-1978.” Biographical Memoirs of *
*Fellows of the Royal Society, Vol. 26 (1980), 148–224.*

z *Kuhn, Thomas. The Structure of Scientific Revolutions. Chicago: *

University of Chicago Press, 1962.

z *Lewis, Harry R. and Christos H. Papadimitriou. Elements of the *

*Theory of Computation. 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, *
1998.

z Mancosu, Paolo, Richard Zach, and Calixto Badesa. “The Development of Mathematical Logic from Russell to Tarski:

*1900–1935.” In Leila Haaparanta (Ed.), The Development of Modern *
*Logic, Oxford: Oxford University Press, 2004.*

z *Morison, Samuel Eliot. Three Centuries of Harvard, 1636-1936. *

Cambridge, MA: Belknap Press, 2006.

z *Nagel, Ernest and James R. Newman. Gödel's Proof. New York: *

New York University Press, 1958.

z *Papadimitriou, Christos H. Computational Complexity. Reading, *
MA: Addison-Wesley, 1995.

z *Popper, Karl R. The Logic of Scientific Discovery. First published in *
1934. New York: Harper & Row, 1968.

z *Quine, Willard Van Orman. The Ways of Paradox and Other Essays. *

New York: Random House, 1966.

z *Quine, Willard Van Orman. Theory and Things. Cambridge, MA: *

Harvard University Press, 1981.

z *Quine, Willard Van Orman. Methods of Logic. 4th ed. Cambridge, *
MA: Harvard University Press, 1982.

z *Quine, Willard Van Orman. Philosophy of Logic. 2nd ed. *

Cambridge, MA: Harvard University Press, 1986.

z *Rogers, Hartley, Jr. Theory of Recursive Functions and Effective *
*Computability. Cambridge, MA: MIT Press, 1988.*

z *Russell, Bertrand. The Principles of Mathematics. Cambridge: *

Cambridge University Press, 1903.

z *Russell, Bertrand. Introduction to Mathematical Philosophy. London: *

George Allen and Unwin, 1919.

z *Russell, Bertrand. The Problems of Philosophy. London: Williams *
and Norgate, 1912.

z Russell, Bertrand. Autobiography. 3 volumes. London: George Allen and Unwin and New York: Simon and Schuster, 1967–

1969.

z Russell, Bertrand. “My Mental Development.” 1944. In Schilpp (1989).

z *Schilpp, Paul Arthur. (Ed.) The Philosophy of Bertrand Russell. 5th ed. *

First published in 1951. LaSalle, IL: Open Court, 1989.

z *Shoenfield, Joseph R. Mathematical Logic. Reading, MA: Addison-*
Wesley, 1967.

z *Sieg, Wilfried. “Gödel on Computability.” Philosophia Mathematica, *
*14, No. 2 (2006), 189–207. *

z *Stoll, Robert R. Set Theory and Logic. New York: Dover, 1979.*

z *Tarski, Alfred. Logic, Semantics, Metamathematics, Papers from 1923 to *
*1938. 2nd ed. Oxford: Oxford University Press, 1983.*

z Turing, Alan. “On Computable Numbers, with an Application to
*the Entscheidungsproblem.” Proc. London Math. Soc., Vol. 42 *

(1936), 230–265.

z *Turing, Alan. “Intelligent machinery.” 1948. Machine Intelligence, *
Vol. 5 (1969), 3–23.

z *van Heijenoort, Jean. (Ed.) From Frege to Gödel: A Source Book in *
*Mathematical Logic, 1879–1931. Cambridge, MA: Harvard *

University Press, 1967.

z *Wang, Hao. From Mathematics to Philosophy. London: Routledge & *

Kegan Paul, 1974.

z *Wang, Hao. A Logical Journey. Cambridge, MA: MIT Press, 1996. *

z *Whitehead, Alfred North. Science and the Modern World. First *
published in 1925. New York: Free Press, 1967.

z *Wittgenstein, Ludwig. Remarks on the Foundations of Mathematics. *

Revised ed. Edited by G. H. von Wright, R. Rhees, and G. E. M.

Anscombe. Cambridge, MA: MIT Press, 1983.

z *Zach, Richard. “Hilbert’s Program.” Stanford Encyclepedia of *
*Philosophy, 2003.*