(245 intermediate revisions by 43 users not shown) | |||
Line 8: | Line 8: | ||
<div style="border-bottom: rgb(68,68,136) 1px solid; border-left: rgb(51,51,136) 4px solid; padding-bottom: 2em; margin: auto; padding-left: 2em; width: 30em; padding-right: 2em; background: rgb(238,238,255); border-top: rgb(68,68,136) 1px solid; border-right: rgb(68,68,136) 1px solid; padding-top: 2em"> | <div style="border-bottom: rgb(68,68,136) 1px solid; border-left: rgb(51,51,136) 4px solid; padding-bottom: 2em; margin: auto; padding-left: 2em; width: 30em; padding-right: 2em; background: rgb(238,238,255); border-top: rgb(68,68,136) 1px solid; border-right: rgb(68,68,136) 1px solid; padding-top: 2em"> | ||
== '''Welcome to ECE662!''' == | == '''Welcome to ECE662!''' == | ||
− | + | * The cleaned up version of the slectures is [[2014_Spring_ECE_662_Boutin_Statistical_Pattern_recognition_slectures|here]]. | |
− | * | + | |
− | + | ||
− | + | ||
</div> | </div> | ||
---- | ---- | ||
Line 33: | Line 30: | ||
== [https://www.projectrhea.org/learning/slectures.php Slectures] == | == [https://www.projectrhea.org/learning/slectures.php Slectures] == | ||
+ | The cleaned up version of these slectures is [[2014_Spring_ECE_662_Boutin_Statistical_Pattern_recognition_slectures|HERE]] | ||
Please use this [[Slecture template ECE662S14|template for text slectures]] or this [[Slecture template video ECE662S14|template for video slectures]] | Please use this [[Slecture template ECE662S14|template for text slectures]] or this [[Slecture template video ECE662S14|template for video slectures]] | ||
*Slectures on Probability and Statistics | *Slectures on Probability and Statistics | ||
− | **[[ECE662 Whitening and Coloring Transforms S14 MH|Whitening and Coloring Transforms]], by [[User:Mhossain|Maliha Hossain]] | + | **[[ECE662 Whitening and Coloring Transforms S14 MH|Whitening and Coloring Transforms]], by [[User:Mhossain|Maliha Hossain]] <span style="color:GREEN">OK</span> |
− | **[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Kim ECE662 Spring 2014|How to generate n | + | **How to generate random n dimensional data from two categories with different priors |
− | **[[ | + | ***[[Generating random data with controlled prior probabilities slecture ECE662S14 Gheith|Video slecture in English]] by Alex Gheith <span style="color:GREEN">OK</span> |
− | *Slectures on Curse of Dimensionality | + | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Kim ECE662 Spring 2014|Video slecture in Korean ]], by Minwoong Kim <span style="color:GREEN">OK</span> |
− | **[[Curse of Dimensionality|Text slecture in English]], | + | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Cho ECE662 Spring 2014|Video slecture in Korean ]], by Hyun Dok Cho <span style="color:GREEN">OK</span> |
− | + | ***[[The principles for how to generate random samples from a Gaussian distribution|Text slecture in English]] by Joonsoo Kim <span style="color:GREEN">OK</span> | |
+ | ***[[Generation of N-dimensional normally distributed random numbers from two categories with different priors|Text slecture in English]] by Jonghoon Jin <span style="color:GREEN">OK</span> | ||
+ | **Principal Component Analysis (PCA) | ||
+ | ***[[PCA|Text slecture in English]], by [http://web.ics.purdue.edu/~zhou338/ Tian Zhou] <span style="color:GREEN">OK</span> | ||
+ | ***[[PCA Theory Examples|Text slecture in English]], by Sujin Jang <span style="color:GREEN">OK</span> | ||
+ | ***[[Kernel PCA|Video slecture in English, and Chinese]], by Tsung Tai Yeh <span style="color:GREEN">OK</span> | ||
+ | ***[[Pca khalid|Video slecture in English]], by Khalid Tahboub <span style="color:GREEN" /> | ||
+ | *Slectures on Curse of Dimensionality | ||
+ | **[[Curse of Dimensionality|Text slecture in English]], and [[Curse of Dimensionality Chinese|in Chinese]] by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION | ||
*Slectures on Bayes Rule | *Slectures on Bayes Rule | ||
− | **Derivation of Bayes Rule | + | **Bayes Rule in Layman's Terms |
− | ***[[From Bayes Theorem to Pattern Recognition via Bayes Rule|Text slecture in English]] by [http://varunvasudevan.com/ Varun Vasudevan] | + | ***[[Introduction to Bayes' Rule|Video slecture in Spanish]] by Francis Phillip <span style="color:GREEN">OK</span> |
− | ***[[Derivation of Bayes' Rule from Bayes' Theorem|Video slecture in English]] by Nadra Guizani | + | **Derivation of Bayes Rule |
− | **Upper Bounds for Bayes Error | + | ***[[Derivation of Bayes rule Anonymous7|Text slecture in English]] By Anonymous7 <span style="color:GREEN">OK</span> |
− | ***[[Upper Bounds for Bayes Error|Text slecture in English]] by G. M. Dilshan Godaliyadda | + | ***[[From Bayes Theorem to Pattern Recognition via Bayes Rule|Text slecture in English]] by [http://varunvasudevan.com/ Varun Vasudevan] <span style="color:GREEN">OK</span> |
− | + | ***[[Derivation of Bayes' Rule from Bayes' Theorem|Video slecture in English]] by Nadra Guizani <span style="color:GREEN">OK</span> | |
− | ***[[Test|Text slecture in English (includes the derivation of Chernoff Distance)]] by Jeehyun Choe | + | ***[[Derivation Bayes Rule slecture ECE662 Spring2014 Kim|Video slecture in English]] by Jieun Kim <span style="color:GREEN">OK</span> |
− | **Bayes Rule to Minimize Risk | + | ***[[Derivation of Bayes rule In Greek|Text slecture in Greek]] by Stylianos Chatzidakis <span style="color:GREEN">OK</span> |
− | ***[[Slecture Bayes rule to minimize risk Andy Park ECE662 Spring 2014| | + | ***[[Derivation of Bayes rule In Chinese|Text slecture in Chinese]] by Weibao Wang <span style="color:GREEN">OK</span> |
− | ***[[Bayes Rule Minimize Risk Dennis Lee|Bayes Rule for | + | **Optimality of Bayes Rule |
− | **[[Bayes rule in practice]] by Lu Wang | + | ***[[Slecture optimality bayes decision rule michaux ECE662S14|Video slecture in English]] by Aaron Michaux <span style="color:GREEN">OK</span> |
+ | ***[[Kjw810313|Video slecture in Korean]] by Jeong-wan Kim <span style="color:GREEN">OK</span> | ||
+ | **Upper Bounds for Bayes Error | ||
+ | ***[[Upper Bounds for Bayes Error|Text slecture in English]] by G. M. Dilshan Godaliyadda | ||
+ | ***[[Test|Text slecture in English (includes the derivation of Chernoff Distance)]] by Jeehyun Choe <span style="color:GREEN">OK</span> | ||
+ | **Bayes Rule to Minimize Risk | ||
+ | ***[[Slecture Bayes rule to minimize risk Andy Park ECE662 Spring 2014|Video slectures in English]], by Andy Park <span style="color:GREEN">OK</span> | ||
+ | ***[[Ness slecture 2014|Text slecture in Chinese]] by Robert Ness <span style="color:GREEN">OK</span> | ||
+ | ***[[Bayes Rule Minimize Risk Dennis Lee|Text slecture in English]] by Dennis Lee <span style="color:GREEN">OK</span> | ||
+ | **Bayes Rule for Normally Distributed Features | ||
+ | ***[[Discussion about Discriminant Functions for the Multivariate Normal Density|Text slecture in English]] by Yanzhe Cui | ||
+ | ***[[Bayes Rule for 1-dimensional and N-dimensional feature spaces|Text slecture in English]] by Jihwan Lee <span style="color:GREEN">OK</span> | ||
+ | **Bayes rule in practice | ||
+ | ***[[Bayes rule in practice|Text slecture in English]] by Lu Wang <span style="color:GREEN">OK</span> | ||
+ | ***[[662slecture tang|Text slecture in English]] by Chuohao Tang <span style="color:GREEN">OK</span> | ||
*Slectures on Neyman-Pearson test and ROC curves | *Slectures on Neyman-Pearson test and ROC curves | ||
− | **[[ | + | **[[Neyman-Pearson Lemma and Receiver Operating Characteristic Curve|Text slecture in English]] by [https://engineering.purdue.edu/~lee714/ Soonam Lee] <span style="color:GREEN">OK</span> |
+ | **[[ROC curve analysis slecture ECE662 Spring0214 Sun|Video slecture in English]] by Jianxin Sun <span style="color:GREEN">OK</span> | ||
*Slectures on Density Estimation | *Slectures on Density Estimation | ||
− | **Maximum Likelihood Estimation (MLE) | + | **Maximum Likelihood Estimation (MLE) |
− | ***[[Mle tutorial| | + | ***[[Mle tutorial|Text slecture in English]] by Sudhir Kylasa <span style="color:GREEN">OK</span> |
− | **Bayesian Estimation (BPE) | + | ***[[Maximum Likelihood Estimation Analysis for various Probability Distributions|Text slecture in English]] by Hariharan Seshadri <span style="color:GREEN">OK</span> |
− | *** | + | ***[[Video slecture in English: Introduction to Maximum Likelihood Estimation|Video slecture in English]] by Anantha Raghuraman <span style="color:GREEN">OK</span> |
− | **Introduction to Local density Estimation Techniques (so-called "non-parametric") | + | ***[[Convergence of the Maximum Likelihood Estimator over Multiple Trials|Video slecture in English]] by [http://web.ics.purdue.edu/~scarver/ Spencer Carver] <span style="color:GREEN">OK</span> |
− | ***[[Introduction to local density estimation methods|Introduction to local | + | ***[[Maximum Likelihood Estimators and Examples|Text slecture in English]] by Lu Zhang <span style="color:GREEN">OK</span> |
− | **Density Estimation with Parzen Windows | + | ***[[SlectureKeehwanECE662Spring14|Video slecture in English]] by Keehwan Park <span style="color:GREEN">OK</span> |
− | *** | + | ***[[MLEforGMM|Text slecture in English]] by Wen Yi |
− | **Density Estimation with K-Nearest Neighbors (KNN) | + | ***[[ECE662Selecture zhenpengMLE|Text slecture in English]] by Zhenpeng Zhao |
− | *** | + | **Bayesian Estimation (BPE) |
− | **The Nearest Neighbor Decision Rule | + | ***[[Bayes Parameter Estimation|Text slecture in English]] by Haiguang Wen <span style="color:GREEN">OK</span> |
− | *** | + | ***[[Bayersian Parameter Estimation: Gaussian Case|Text slecture in English]], by Shaobo Fang |
− | *Slectures on Linear Classifiers | + | ***[[Bayes Parameter Estimation with examples|Text slecture in English]] by Yu Wang |
+ | **Introduction to Local density Estimation Techniques (so-called "non-parametric") | ||
+ | ***[[Introduction to local density estimation methods|Text slecture in English]] by Yu Liu <span style="color:GREEN">OK</span> | ||
+ | ***[[Slecture Introduction local density estimation methods ECE662 Spring2014 Aziza|Video slecture in Russian]] by Aziza Satkhozhina | ||
+ | ***[[Introduction to local density estimation methods ECE662 Spring2014 Nusaybah|Video slecture in English]] by Nusaybah Abu-Mulaweh | ||
+ | ***[[Intro local non parametric density estimation methods ECE662 Spring2014 Yuan|Video slecture in English]] by Chenxi Yuan <span style="color:GREEN">OK</span> | ||
+ | **Density Estimation with Parzen Windows | ||
+ | ***[[ParzenWindow|Text slecture in English]] by Chiho Choi <span style="color:GREEN">OK</span> | ||
+ | ***[[Parzen Window Density Estimation|Text slecture in English]] by Ben Foster <span style="color:GREEN">OK</span> | ||
+ | ***[[Parzen Windows|Text slecture in English]] by Abdullah Alshaibani <span style="color:GREEN">OK</span> | ||
+ | **Density Estimation with K-Nearest Neighbors (KNN) | ||
+ | ***[[KnnDensityEstimation|Text slecture in English]] by Raj Praveen Selvaraj <span style="color:GREEN">OK</span> | ||
+ | ***[[Knearestneighbors|Text slecture in English]] by Dan Barrett QUESTION PAGE | ||
+ | ***[[K-Nearest Neighbors Density Estimation|Video slecture in English]] by Qi Wang <span style="color:GREEN">OK</span> | ||
+ | **The Nearest Neighbor Decision Rule | ||
+ | ***[[Estimation Using Nearest Neighbor|Text slecture in English]] by Sang Ho Yoon | ||
+ | ***[[Slecture from KNN to nearest neighbor|Text slecture in English]] by Jonathan Manring <span style="color:GREEN">OK</span> | ||
+ | *Slectures on Linear Classifiers | ||
+ | **[[JMSLinearClassifierSlecture|Text slecture in English]] by John Mulcahy-Stanislawczyk | ||
+ | **[[CBR_logistic_regression|Text slecture in English]] by Borui Chen | ||
+ | *Slectures on Support Vector Machines (SVM) | ||
+ | **[https://kiwi.ecn.purdue.edu/rhea/index.php/Least_Squares_Support_Vector_Machine_and_its_Applications_in_Solving_Linear_Regression_Problems Text slecture in English] by Xing Liu | ||
+ | **[[Support Vector Machine|Video slecture in English]] by Tao Jiang | ||
+ | *Slectures on Clustering Algorithms (supplemental material) | ||
+ | **[[SlectureDavidRunyanCS662Spring14|text slecture in English]] by David Runyan | ||
---- | ---- |
Latest revision as of 19:50, 2 May 2016
Contents
ECE662: Statistical Pattern Recognition and Decision Making Processes, Spring 2014 (cross-listed with CS662)
Welcome to ECE662!
- The cleaned up version of the slectures is here.
Course Information
Instructor:
- Office: MSEE342
- Office hours
- Assignment Drop Box
Lecture:
- When? TuTh, 10:30 - 11:45
- Where? EE117 (subject to change)
Slectures
The cleaned up version of these slectures is HERE
Please use this template for text slectures or this template for video slectures
- Slectures on Probability and Statistics
- Whitening and Coloring Transforms, by Maliha Hossain OK
- How to generate random n dimensional data from two categories with different priors
- Video slecture in English by Alex Gheith OK
- Video slecture in Korean , by Minwoong Kim OK
- Video slecture in Korean , by Hyun Dok Cho OK
- Text slecture in English by Joonsoo Kim OK
- Text slecture in English by Jonghoon Jin OK
- Principal Component Analysis (PCA)
- Text slecture in English, by Tian Zhou OK
- Text slecture in English, by Sujin Jang OK
- Video slecture in English, and Chinese, by Tsung Tai Yeh OK
- Video slecture in English, by Khalid Tahboub <span style="color:GREEN" />
- Slectures on Curse of Dimensionality
- Text slecture in English, and in Chinese by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION
- Slectures on Bayes Rule
- Bayes Rule in Layman's Terms
- Video slecture in Spanish by Francis Phillip OK
- Derivation of Bayes Rule
- Text slecture in English By Anonymous7 OK
- Text slecture in English by Varun Vasudevan OK
- Video slecture in English by Nadra Guizani OK
- Video slecture in English by Jieun Kim OK
- Text slecture in Greek by Stylianos Chatzidakis OK
- Text slecture in Chinese by Weibao Wang OK
- Optimality of Bayes Rule
- Video slecture in English by Aaron Michaux OK
- Video slecture in Korean by Jeong-wan Kim OK
- Upper Bounds for Bayes Error
- Text slecture in English by G. M. Dilshan Godaliyadda
- Text slecture in English (includes the derivation of Chernoff Distance) by Jeehyun Choe OK
- Bayes Rule to Minimize Risk
- Video slectures in English, by Andy Park OK
- Text slecture in Chinese by Robert Ness OK
- Text slecture in English by Dennis Lee OK
- Bayes Rule for Normally Distributed Features
- Text slecture in English by Yanzhe Cui
- Text slecture in English by Jihwan Lee OK
- Bayes rule in practice
- Text slecture in English by Lu Wang OK
- Text slecture in English by Chuohao Tang OK
- Bayes Rule in Layman's Terms
- Slectures on Neyman-Pearson test and ROC curves
- Text slecture in English by Soonam Lee OK
- Video slecture in English by Jianxin Sun OK
- Slectures on Density Estimation
- Maximum Likelihood Estimation (MLE)
- Text slecture in English by Sudhir Kylasa OK
- Text slecture in English by Hariharan Seshadri OK
- Video slecture in English by Anantha Raghuraman OK
- Video slecture in English by Spencer Carver OK
- Text slecture in English by Lu Zhang OK
- Video slecture in English by Keehwan Park OK
- Text slecture in English by Wen Yi
- Text slecture in English by Zhenpeng Zhao
- Bayesian Estimation (BPE)
- Text slecture in English by Haiguang Wen OK
- Text slecture in English, by Shaobo Fang
- Text slecture in English by Yu Wang
- Introduction to Local density Estimation Techniques (so-called "non-parametric")
- Text slecture in English by Yu Liu OK
- Video slecture in Russian by Aziza Satkhozhina
- Video slecture in English by Nusaybah Abu-Mulaweh
- Video slecture in English by Chenxi Yuan OK
- Density Estimation with Parzen Windows
- Text slecture in English by Chiho Choi OK
- Text slecture in English by Ben Foster OK
- Text slecture in English by Abdullah Alshaibani OK
- Density Estimation with K-Nearest Neighbors (KNN)
- Text slecture in English by Raj Praveen Selvaraj OK
- Text slecture in English by Dan Barrett QUESTION PAGE
- Video slecture in English by Qi Wang OK
- The Nearest Neighbor Decision Rule
- Text slecture in English by Sang Ho Yoon
- Text slecture in English by Jonathan Manring OK
- Maximum Likelihood Estimation (MLE)
- Slectures on Linear Classifiers
- Text slecture in English by John Mulcahy-Stanislawczyk
- Text slecture in English by Borui Chen
- Slectures on Support Vector Machines (SVM)
- Text slecture in English by Xing Liu
- Video slecture in English by Tao Jiang
- Slectures on Clustering Algorithms (supplemental material)
- text slecture in English by David Runyan
Peer Reviews
- Instruction for peer reviewing HW1
- Instruction for peer reviewing HW2 (due before class on April 29)
Discussion
Feel free to use the space below for discussion, or create a page for discussion and link it below.
- Where to find data for HW1
- Possible Real-world data to use for class
- Programming help!
- New Discussion