(New page: = Induction = by: Robert Hansen, proud member of the math squad. <pre> keyword: tutorial, induction, strong induction, weak induction </pre> ---- == The...)
 
Line 2: Line 2:
  
 
by: [[user:Hansen12 | Robert Hansen]], proud member of [[Math squad|the math squad]].
 
by: [[user:Hansen12 | Robert Hansen]], proud member of [[Math squad|the math squad]].
<pre> keyword: tutorial, induction, strong induction, weak induction </pre>
+
<pre> keyword: tutorial, induction </pre>
 
----
 
----
 
== The Natural Numbers ==
 
== The Natural Numbers ==
Line 8: Line 8:
 
Before we can talk about induction, we must first talk about the natural numbers, and their properties.
 
Before we can talk about induction, we must first talk about the natural numbers, and their properties.
  
I'm certain the reader is familiar with standard definitions of the natural numbers.  A common one is defining them as the positive integers: {1, 2, 3, 4, ...} and so on.
+
I'm certain the reader is familiar with the natural numbers.  A common one way of defining them as the positive integers: {1, 2, 3, 4, ...}.
  
For the purposes of this article, however, I'd like to introduce a new, equivalent definition of the natural numbers. Consider a set of numbers, S, that follows the following two axioms:
+
For the purposes of induction, however, it is much more convenient to define them in a different way.
  
1) 1 is contained in S
+
Consider the following two statements about a set S:
  
2) if k is in S, then k + 1 is also in S
+
(1) 1 is contained in S
 +
 
 +
(2) if k is in S, then k + 1 is also in S
  
 
In more mathematical notation, we have:
 
In more mathematical notation, we have:
  
 
<math> 1\in S</math>
 
<math> 1\in S</math>
<math> k \in S \Rightarrow </math>
 
  
An equivalent definition of the natural numbers is that it is the smallest set S that follows the two axioms given above.
+
<math> k \in S \Rightarrow k + 1 \in S</math>
  
For the readers familiar with mathematical induction, one may notice that these two axioms are the two things that need to be proven in a proof by induction.
+
The natural numbers can be defined as the smallest set that satisfy both (1) and (2).
  
----
+
Here, what smallest means is that if A is a set that satisfies (1) and (2), then <math>N \subset A</math>.
== Mathematical Induction ==
+
  
Now that we have the natural numbers defined in a convenient package, let us continue to mathematical induction.
+
We can see this intuitively.  The elements of the natural numbers are {1, 1 + 1, 1 + 1 + 1, ...} and can be defined recursively
 
+
by defining each element as one plus the element before it.  Therefore, if a set were to contain 1, and follow property (2), then
Let f(k) be a statement that is either true or false, and let S be the set of all k for which it is trueBy the above construction of the natural numbers, we can see that if S follows the two axioms described above,  
+
the natural numbers must be contained within it.
S must contain the natural numbers.
+
  
 
----
 
----
== Example ==
+
== Mathematical Induction ==
  
On first sight, the above definition may be a little hard to grasp and use, so let us consider an example:
+
To formalize it, let us state what we stated above as a theorem:
  
Let A be a set or order nShow that the number of subsets of A is <math>2^n</math>
+
Theorem (Induction Principle):  Let S be a set of numbersIf S satisfies (1) and (2), then S must contain the natural numbers.
  
Proof by induction:
+
This is mathematical induction.  
 
+
Before we begin, let's first define some terms.  The set of the subsets of a set A is called the power set of A, and
+
can be denoted as <math>mathcal{P}(A)</math>.  It is also often denoted as <math>2^A</math>, but as we have yet to prove
+
that its order is <math>2^{|A|}</math>, that should probably be avoided.
+
 
+
Using the above terms, we can rephrase our example into proving the following:
+
 
+
<math>|mathcal{P}(A)| = 2^{|A|}</math>
+
 
+
Now that we have definitions and terms out of the way, let us begin induction:
+
 
+
Let S be the set of numbers k such that <math>|mathcal{P}(A)| = 2^{|A|}</math>, where
+
|A| = k.
+
 
+
Let us begin by proving that the first axiom holds on S:
+
 
+
Consider a set of order 1:
+
 
+
<math>A = \{a\}</math>
+
 
+
We know that therefore:
+
 
+
<math>mathcal{P}(A) = \{\{a\}, \{\}\}</math>
+
 
+
or alternatively:
+
 
+
<math>mathcal{P}(A) = \{A, /varnothing\}</math>
+
 
+
the two trivial subsets.
+
 
+
Therefore, we have that <math>|mathcal{A}(S)| = 2^{|A|}</math>.
+
 
+
Therefore, the first axiom holds.
+
 
+
Next, we wish to show that the second axiom also holds on S:
+
 
+
Suppose we know that k is in S.  Prove that k + 1 is also in S.
+
 
+
Let <math>A</math> be a set of order k. 
+
 
+
 
+
are such that:
+
 
+
<math>mathcal{P}(A) = 2^{|A|}</math>
+
 
+
We need to show that <math>|mathcal{P}(A \cup b)| = 2^{|A| + 1} = 2^{|A \cut b|}</math>, where b is some element not
+
in A.
+
  
 +
However, as it may not be immediately clear why, let us consider an example.
  
 +
----
 +
== Example ==
  
The common notation for the set of subsets of a set A is <math>2^A</math>.
+
Proposition:  Let A be a set.  The number of subsets of A is <math>2^{\|A\|}</math>
  
Therefore, what we wish to  
+
Before we begin trying to prove this with the induction principle stated above, let us first define some terms. 
 +
The set of the subsets of a set A is called the power set of A, and
 +
can be denoted as <math>P(A)</math>.
  
Let S be the numbers for which the following statement is true:
+
Using this new terminology and notation, the above proposition can be rewritten in the following way:
  
Let A be a set of order kThe number of subsets of A is <math>2^k</math>
+
Proposition:  Let A be a set.  <math> \|P(A)\| = 2 ^ {\|A\|} </math>
  
To begin, let us consider a set of order 1, let's say
+
To prove that this is true for all natural numbers, let S be the set of k for which the above holds, where k
 +
is the order of the set A.
  
<math>A_1 = \{a\}</math>
+
Keep in mind that since we are only working with sets in this proposition, we needn't worry about different sets of the same order.
 +
They're all going to have the same number of subsets.
  
This set has two subsets:
+
The first thing to notice about this proposition is that it is true for a set of order 1.  Such a set has only two subsets: the whole set
 +
and the empty set.  Because <math>2 = 2^1</math> (clearly), the proposition must hold.
  
<math>\{a\}, \{ \}</math>
+
Therefore, 1 is contained in S.
  
Or alternatively:
+
The next thing we'd like to notice is that if we have two sets A and A', where the only difference between the two is that A' has one extra
 +
element a', which is not in A, then the number of subsets of A' we should be able to divide into two groups: subsets of A' which contain a'
 +
and subsets of A' which do not.
  
<math> A_1, /varnothing</math>
+
The subsets of A' that do not contain a' must simply be the subsets of A, and those that do are simply the subsets of A union a'.  Therefore,
 +
we have that <math>\|P(A')\| = 2*\|P(A)\|</math>.
  
Which the reader may recognize as the two trivial subsets.
+
From this, we see that S satisfies property (2).  Therefore, by the induction principle S must hold for all natural numbers, and therefore
 +
our proposition holds for all natural numbers.
  
Therefore, we have that S contains 1, as the set with one element has <math>2^1</math> elements.
+
The last thing to check is the empty set, which has order 0, but it can be easily shown that its power set is the empty set (a single element), and
 +
therefore our proposition holds for all sets.
  
Now, let us suppose that S contains k.  We wish to show that S also contains k + 1.
+
= Conclusion =
  
We know that the fact that S contains k means that
+
Although the above is simply another way to look at the idea of mathematical induction, I've found that it has helped me quite a bit in intuitively comprehending
 +
the concepts behind mathematical induction.

Revision as of 08:38, 15 May 2014

Induction

by: Robert Hansen, proud member of the math squad.

 keyword: tutorial, induction 

The Natural Numbers

Before we can talk about induction, we must first talk about the natural numbers, and their properties.

I'm certain the reader is familiar with the natural numbers. A common one way of defining them as the positive integers: {1, 2, 3, 4, ...}.

For the purposes of induction, however, it is much more convenient to define them in a different way.

Consider the following two statements about a set S:

(1) 1 is contained in S

(2) if k is in S, then k + 1 is also in S

In more mathematical notation, we have:

$ 1\in S $

$ k \in S \Rightarrow k + 1 \in S $

The natural numbers can be defined as the smallest set that satisfy both (1) and (2).

Here, what smallest means is that if A is a set that satisfies (1) and (2), then $ N \subset A $.

We can see this intuitively. The elements of the natural numbers are {1, 1 + 1, 1 + 1 + 1, ...} and can be defined recursively by defining each element as one plus the element before it. Therefore, if a set were to contain 1, and follow property (2), then the natural numbers must be contained within it.


Mathematical Induction

To formalize it, let us state what we stated above as a theorem:

Theorem (Induction Principle): Let S be a set of numbers. If S satisfies (1) and (2), then S must contain the natural numbers.

This is mathematical induction.

However, as it may not be immediately clear why, let us consider an example.


Example

Proposition: Let A be a set. The number of subsets of A is $ 2^{\|A\|} $

Before we begin trying to prove this with the induction principle stated above, let us first define some terms. The set of the subsets of a set A is called the power set of A, and can be denoted as $ P(A) $.

Using this new terminology and notation, the above proposition can be rewritten in the following way:

Proposition: Let A be a set. $ \|P(A)\| = 2 ^ {\|A\|} $

To prove that this is true for all natural numbers, let S be the set of k for which the above holds, where k is the order of the set A.

Keep in mind that since we are only working with sets in this proposition, we needn't worry about different sets of the same order. They're all going to have the same number of subsets.

The first thing to notice about this proposition is that it is true for a set of order 1. Such a set has only two subsets: the whole set and the empty set. Because $ 2 = 2^1 $ (clearly), the proposition must hold.

Therefore, 1 is contained in S.

The next thing we'd like to notice is that if we have two sets A and A', where the only difference between the two is that A' has one extra element a', which is not in A, then the number of subsets of A' we should be able to divide into two groups: subsets of A' which contain a' and subsets of A' which do not.

The subsets of A' that do not contain a' must simply be the subsets of A, and those that do are simply the subsets of A union a'. Therefore, we have that $ \|P(A')\| = 2*\|P(A)\| $.

From this, we see that S satisfies property (2). Therefore, by the induction principle S must hold for all natural numbers, and therefore our proposition holds for all natural numbers.

The last thing to check is the empty set, which has order 0, but it can be easily shown that its power set is the empty set (a single element), and therefore our proposition holds for all sets.

Conclusion

Although the above is simply another way to look at the idea of mathematical induction, I've found that it has helped me quite a bit in intuitively comprehending the concepts behind mathematical induction.

Alumni Liaison

BSEE 2004, current Ph.D. student researching signal and image processing.

Landis Huffman