(New page: The class of the data is written as the second co-ordinate. <math>{\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}=0 </math> **3 inequalities**: <math>1.w+b\leq-1 </math> <math>2.w+b\leq+1 </...) |
|||
| (2 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
| + | [[Image:svm_Old Kiwi.jpg]] | ||
| + | |||
| + | |||
The class of the data is written as the second co-ordinate. | The class of the data is written as the second co-ordinate. | ||
<math>{\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}=0 </math> | <math>{\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}=0 </math> | ||
| Line 13: | Line 16: | ||
Formulating the Dual Problem: | Formulating the Dual Problem: | ||
| − | |||
| − | < | + | <math>Q(\alpha )= {\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}-[0.5{{\alpha }_{1}}^{2}+2{{\alpha }_{2}}^{2}+4.5{{\alpha }_{3}}^{2}-2{\alpha }_{1}{\alpha }_{2}-3{\alpha }_{1}{\alpha }_{3}-6{\alpha }_{2}{\alpha }_{3}] |
| − | + | </math> | |
Subject to constraints | Subject to constraints | ||
| − | < | + | <math>{\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}=0 </math> |
and | and | ||
| − | < | + | <math>{\alpha }_{1}\geq 0; {\alpha }_{2}\geq 0;{\alpha }_{3}\geq 0</math> |
| − | Differentiating partially with respect to < | + | Differentiating partially with respect to <math>{\alpha }_{1},{\alpha }_{2}, {\alpha }_{3}</math> |
| − | < | + | <math>{\alpha }_{1}+2{\alpha }_{2}+3{\alpha }_{3}=0 </math> |
| − | < | + | <math>1+2{\alpha }_{1}-4{\alpha }_{2}-6{\alpha }_{3}=0 </math> |
| − | < | + | <math>1+3{\alpha }_{1}-6{\alpha }_{2}-9{\alpha }_{3}=0 </math> |
On Solving, we get | On Solving, we get | ||
| − | < | + | <math>{\alpha }_{1}=2</math> |
| − | < | + | <math>{\alpha }_{2}=2</math> |
| − | < | + | <math>{\alpha }_{3}=0</math> |
This yields w = 2, b = -3. | This yields w = 2, b = -3. | ||
Latest revision as of 16:35, 30 March 2008
The class of the data is written as the second co-ordinate.
$ {\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}=0 $
- 3 inequalities**:
$ 1.w+b\leq-1 $
$ 2.w+b\leq+1 $
$ 3.w+b\leq+1 $
$ J=\frac{{w}^{2}}{2}-{\alpha }_{1}\left(-w-b-1 \right)-{\alpha }_{2}(2w+b-1)-{\alpha }_{3}(3w+b-1) $
Formulating the Dual Problem:
$ Q(\alpha )= {\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}-[0.5{{\alpha }_{1}}^{2}+2{{\alpha }_{2}}^{2}+4.5{{\alpha }_{3}}^{2}-2{\alpha }_{1}{\alpha }_{2}-3{\alpha }_{1}{\alpha }_{3}-6{\alpha }_{2}{\alpha }_{3}] $
Subject to constraints
$ {\alpha }_{1}+{\alpha }_{2}+{\alpha }_{3}=0 $ and
$ {\alpha }_{1}\geq 0; {\alpha }_{2}\geq 0;{\alpha }_{3}\geq 0 $
Differentiating partially with respect to $ {\alpha }_{1},{\alpha }_{2}, {\alpha }_{3} $
$ {\alpha }_{1}+2{\alpha }_{2}+3{\alpha }_{3}=0 $
$ 1+2{\alpha }_{1}-4{\alpha }_{2}-6{\alpha }_{3}=0 $
$ 1+3{\alpha }_{1}-6{\alpha }_{2}-9{\alpha }_{3}=0 $
On Solving, we get
$ {\alpha }_{1}=2 $
$ {\alpha }_{2}=2 $
$ {\alpha }_{3}=0 $
This yields w = 2, b = -3. Hence the solution of decision boundary is: 2x - 3 = 0. or x = 1.5 This is shown as the dash line in above figure.
