| (280 intermediate revisions by 49 users not shown) | |||
| Line 1: | Line 1: | ||
| − | + | <br> | |
| − | + | ||
| − | + | ||
| − | + | ||
| + | <br> | ||
| − | + | == [[ECE662]]: '''Statistical Pattern Recognition and Decision Making Processes, Spring 2014''' (cross-listed with CS662) == | |
| − | == [[ECE662]]: '''Statistical Pattern Recognition and Decision Making Processes, Spring 2014''' | + | |
---- | ---- | ||
<div style="border-bottom: rgb(68,68,136) 1px solid; border-left: rgb(51,51,136) 4px solid; padding-bottom: 2em; margin: auto; padding-left: 2em; width: 30em; padding-right: 2em; background: rgb(238,238,255); border-top: rgb(68,68,136) 1px solid; border-right: rgb(68,68,136) 1px solid; padding-top: 2em"> | <div style="border-bottom: rgb(68,68,136) 1px solid; border-left: rgb(51,51,136) 4px solid; padding-bottom: 2em; margin: auto; padding-left: 2em; width: 30em; padding-right: 2em; background: rgb(238,238,255); border-top: rgb(68,68,136) 1px solid; border-right: rgb(68,68,136) 1px solid; padding-top: 2em"> | ||
== '''Welcome to ECE662!''' == | == '''Welcome to ECE662!''' == | ||
| − | * | + | * The cleaned up version of the slectures is [[2014_Spring_ECE_662_Boutin_Statistical_Pattern_recognition_slectures|here]]. |
</div> | </div> | ||
---- | ---- | ||
== '''Course Information''' == | == '''Course Information''' == | ||
| + | |||
Instructor: | Instructor: | ||
| − | *[[User:Mboutin|Professor Mimi Boutin]] | + | |
| − | ::Office: MSEE342 | + | *[[User:Mboutin|Professor Mimi Boutin]] |
| − | ::[[ | + | |
| + | ::Office: MSEE342 | ||
| + | ::[[Open office hours mboutin|Office hours]] | ||
::[https://www.projectrhea.org/rhea/index.php/Special:DropBox?forUser=mboutin&assn=true Assignment Drop Box] | ::[https://www.projectrhea.org/rhea/index.php/Special:DropBox?forUser=mboutin&assn=true Assignment Drop Box] | ||
| + | |||
Lecture: | Lecture: | ||
| + | |||
*'''When?''' TuTh, 10:30 - 11:45 | *'''When?''' TuTh, 10:30 - 11:45 | ||
*'''Where?''' EE117 (subject to change) | *'''Where?''' EE117 (subject to change) | ||
| + | |||
---- | ---- | ||
| − | ==[https://www.projectrhea.org/learning/slectures.php Slectures]== | + | |
| − | Please use this [[ | + | == [https://www.projectrhea.org/learning/slectures.php Slectures] == |
| − | *Slectures on Probability and Statistics | + | The cleaned up version of these slectures is [[2014_Spring_ECE_662_Boutin_Statistical_Pattern_recognition_slectures|HERE]] |
| − | **[[ | + | |
| − | **[[ | + | Please use this [[Slecture template ECE662S14|template for text slectures]] or this [[Slecture template video ECE662S14|template for video slectures]] |
| − | **[[ | + | |
| − | *Slectures on Bayes Rule | + | *Slectures on Probability and Statistics |
| − | **[[ | + | **[[ECE662 Whitening and Coloring Transforms S14 MH|Whitening and Coloring Transforms]], by [[User:Mhossain|Maliha Hossain]] <span style="color:GREEN">OK</span> |
| − | **[[ | + | **How to generate random n dimensional data from two categories with different priors |
| − | **[[ | + | ***[[Generating random data with controlled prior probabilities slecture ECE662S14 Gheith|Video slecture in English]] by Alex Gheith <span style="color:GREEN">OK</span> |
| − | **[[ | + | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Kim ECE662 Spring 2014|Video slecture in Korean ]], by Minwoong Kim <span style="color:GREEN">OK</span> |
| − | ** | + | ***[[How to generate random n dimensional data from two categories with different priors slecture Minwoong Cho ECE662 Spring 2014|Video slecture in Korean ]], by Hyun Dok Cho <span style="color:GREEN">OK</span> |
| − | *Slectures on | + | ***[[The principles for how to generate random samples from a Gaussian distribution|Text slecture in English]] by Joonsoo Kim <span style="color:GREEN">OK</span> |
| − | **[[ | + | ***[[Generation of N-dimensional normally distributed random numbers from two categories with different priors|Text slecture in English]] by Jonghoon Jin <span style="color:GREEN">OK</span> |
| − | *Slectures on Linear Classifiers | + | **Principal Component Analysis (PCA) |
| + | ***[[PCA|Text slecture in English]], by [http://web.ics.purdue.edu/~zhou338/ Tian Zhou] <span style="color:GREEN">OK</span> | ||
| + | ***[[PCA Theory Examples|Text slecture in English]], by Sujin Jang <span style="color:GREEN">OK</span> | ||
| + | ***[[Kernel PCA|Video slecture in English, and Chinese]], by Tsung Tai Yeh <span style="color:GREEN">OK</span> | ||
| + | ***[[Pca khalid|Video slecture in English]], by Khalid Tahboub <span style="color:GREEN" /> | ||
| + | *Slectures on Curse of Dimensionality | ||
| + | **[[Curse of Dimensionality|Text slecture in English]], and [[Curse of Dimensionality Chinese|in Chinese]] by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION | ||
| + | *Slectures on Bayes Rule | ||
| + | **Bayes Rule in Layman's Terms | ||
| + | ***[[Introduction to Bayes' Rule|Video slecture in Spanish]] by Francis Phillip <span style="color:GREEN">OK</span> | ||
| + | **Derivation of Bayes Rule | ||
| + | ***[[Derivation of Bayes rule Anonymous7|Text slecture in English]] By Anonymous7 <span style="color:GREEN">OK</span> | ||
| + | ***[[From Bayes Theorem to Pattern Recognition via Bayes Rule|Text slecture in English]] by [http://varunvasudevan.com/ Varun Vasudevan] <span style="color:GREEN">OK</span> | ||
| + | ***[[Derivation of Bayes' Rule from Bayes' Theorem|Video slecture in English]] by Nadra Guizani <span style="color:GREEN">OK</span> | ||
| + | ***[[Derivation Bayes Rule slecture ECE662 Spring2014 Kim|Video slecture in English]] by Jieun Kim <span style="color:GREEN">OK</span> | ||
| + | ***[[Derivation of Bayes rule In Greek|Text slecture in Greek]] by Stylianos Chatzidakis <span style="color:GREEN">OK</span> | ||
| + | ***[[Derivation of Bayes rule In Chinese|Text slecture in Chinese]] by Weibao Wang <span style="color:GREEN">OK</span> | ||
| + | **Optimality of Bayes Rule | ||
| + | ***[[Slecture optimality bayes decision rule michaux ECE662S14|Video slecture in English]] by Aaron Michaux <span style="color:GREEN">OK</span> | ||
| + | ***[[Kjw810313|Video slecture in Korean]] by Jeong-wan Kim <span style="color:GREEN">OK</span> | ||
| + | **Upper Bounds for Bayes Error | ||
| + | ***[[Upper Bounds for Bayes Error|Text slecture in English]] by G. M. Dilshan Godaliyadda | ||
| + | ***[[Test|Text slecture in English (includes the derivation of Chernoff Distance)]] by Jeehyun Choe <span style="color:GREEN">OK</span> | ||
| + | **Bayes Rule to Minimize Risk | ||
| + | ***[[Slecture Bayes rule to minimize risk Andy Park ECE662 Spring 2014|Video slectures in English]], by Andy Park <span style="color:GREEN">OK</span> | ||
| + | ***[[Ness slecture 2014|Text slecture in Chinese]] by Robert Ness <span style="color:GREEN">OK</span> | ||
| + | ***[[Bayes Rule Minimize Risk Dennis Lee|Text slecture in English]] by Dennis Lee <span style="color:GREEN">OK</span> | ||
| + | **Bayes Rule for Normally Distributed Features | ||
| + | ***[[Discussion about Discriminant Functions for the Multivariate Normal Density|Text slecture in English]] by Yanzhe Cui | ||
| + | ***[[Bayes Rule for 1-dimensional and N-dimensional feature spaces|Text slecture in English]] by Jihwan Lee <span style="color:GREEN">OK</span> | ||
| + | **Bayes rule in practice | ||
| + | ***[[Bayes rule in practice|Text slecture in English]] by Lu Wang <span style="color:GREEN">OK</span> | ||
| + | ***[[662slecture tang|Text slecture in English]] by Chuohao Tang <span style="color:GREEN">OK</span> | ||
| + | *Slectures on Neyman-Pearson test and ROC curves | ||
| + | **[[Neyman-Pearson Lemma and Receiver Operating Characteristic Curve|Text slecture in English]] by [https://engineering.purdue.edu/~lee714/ Soonam Lee] <span style="color:GREEN">OK</span> | ||
| + | **[[ROC curve analysis slecture ECE662 Spring0214 Sun|Video slecture in English]] by Jianxin Sun <span style="color:GREEN">OK</span> | ||
| + | *Slectures on Density Estimation | ||
| + | **Maximum Likelihood Estimation (MLE) | ||
| + | ***[[Mle tutorial|Text slecture in English]] by Sudhir Kylasa <span style="color:GREEN">OK</span> | ||
| + | ***[[Maximum Likelihood Estimation Analysis for various Probability Distributions|Text slecture in English]] by Hariharan Seshadri <span style="color:GREEN">OK</span> | ||
| + | ***[[Video slecture in English: Introduction to Maximum Likelihood Estimation|Video slecture in English]] by Anantha Raghuraman <span style="color:GREEN">OK</span> | ||
| + | ***[[Convergence of the Maximum Likelihood Estimator over Multiple Trials|Video slecture in English]] by [http://web.ics.purdue.edu/~scarver/ Spencer Carver] <span style="color:GREEN">OK</span> | ||
| + | ***[[Maximum Likelihood Estimators and Examples|Text slecture in English]] by Lu Zhang <span style="color:GREEN">OK</span> | ||
| + | ***[[SlectureKeehwanECE662Spring14|Video slecture in English]] by Keehwan Park <span style="color:GREEN">OK</span> | ||
| + | ***[[MLEforGMM|Text slecture in English]] by Wen Yi | ||
| + | ***[[ECE662Selecture zhenpengMLE|Text slecture in English]] by Zhenpeng Zhao | ||
| + | **Bayesian Estimation (BPE) | ||
| + | ***[[Bayes Parameter Estimation|Text slecture in English]] by Haiguang Wen <span style="color:GREEN">OK</span> | ||
| + | ***[[Bayersian Parameter Estimation: Gaussian Case|Text slecture in English]], by Shaobo Fang | ||
| + | ***[[Bayes Parameter Estimation with examples|Text slecture in English]] by Yu Wang | ||
| + | **Introduction to Local density Estimation Techniques (so-called "non-parametric") | ||
| + | ***[[Introduction to local density estimation methods|Text slecture in English]] by Yu Liu <span style="color:GREEN">OK</span> | ||
| + | ***[[Slecture Introduction local density estimation methods ECE662 Spring2014 Aziza|Video slecture in Russian]] by Aziza Satkhozhina | ||
| + | ***[[Introduction to local density estimation methods ECE662 Spring2014 Nusaybah|Video slecture in English]] by Nusaybah Abu-Mulaweh | ||
| + | ***[[Intro local non parametric density estimation methods ECE662 Spring2014 Yuan|Video slecture in English]] by Chenxi Yuan <span style="color:GREEN">OK</span> | ||
| + | **Density Estimation with Parzen Windows | ||
| + | ***[[ParzenWindow|Text slecture in English]] by Chiho Choi <span style="color:GREEN">OK</span> | ||
| + | ***[[Parzen Window Density Estimation|Text slecture in English]] by Ben Foster <span style="color:GREEN">OK</span> | ||
| + | ***[[Parzen Windows|Text slecture in English]] by Abdullah Alshaibani <span style="color:GREEN">OK</span> | ||
| + | **Density Estimation with K-Nearest Neighbors (KNN) | ||
| + | ***[[KnnDensityEstimation|Text slecture in English]] by Raj Praveen Selvaraj <span style="color:GREEN">OK</span> | ||
| + | ***[[Knearestneighbors|Text slecture in English]] by Dan Barrett QUESTION PAGE | ||
| + | ***[[K-Nearest Neighbors Density Estimation|Video slecture in English]] by Qi Wang <span style="color:GREEN">OK</span> | ||
| + | **The Nearest Neighbor Decision Rule | ||
| + | ***[[Estimation Using Nearest Neighbor|Text slecture in English]] by Sang Ho Yoon | ||
| + | ***[[Slecture from KNN to nearest neighbor|Text slecture in English]] by Jonathan Manring <span style="color:GREEN">OK</span> | ||
| + | *Slectures on Linear Classifiers | ||
| + | **[[JMSLinearClassifierSlecture|Text slecture in English]] by John Mulcahy-Stanislawczyk | ||
| + | **[[CBR_logistic_regression|Text slecture in English]] by Borui Chen | ||
| + | *Slectures on Support Vector Machines (SVM) | ||
| + | **[https://kiwi.ecn.purdue.edu/rhea/index.php/Least_Squares_Support_Vector_Machine_and_its_Applications_in_Solving_Linear_Regression_Problems Text slecture in English] by Xing Liu | ||
| + | **[[Support Vector Machine|Video slecture in English]] by Tao Jiang | ||
| + | *Slectures on Clustering Algorithms (supplemental material) | ||
| + | **[[SlectureDavidRunyanCS662Spring14|text slecture in English]] by David Runyan | ||
---- | ---- | ||
| − | ==Peer Reviews== | + | |
| − | *[[ | + | == Peer Reviews == |
| − | * | + | |
| + | *[[Instructions peer review hw1|Instruction for peer reviewing HW1]] | ||
| + | *[[Instructions peer review hw2|Instruction for peer reviewing HW2]] (due before class on April 29) | ||
| + | |||
---- | ---- | ||
| − | == Discussion | + | |
| + | == Discussion == | ||
| + | |||
Feel free to use the space below for discussion, or create a page for discussion and link it below. | Feel free to use the space below for discussion, or create a page for discussion and link it below. | ||
| − | *[[ | + | |
| − | *[[ | + | *[[Data discussion HW1 ECE662 S14 Boutin|Where to find data for HW1]] |
| − | *[[ | + | *[[Yelp Dataset|Possible Real-world data to use for class]] |
| + | *[[Programming help ECE662S14|Programming help!]] | ||
*New Discussion | *New Discussion | ||
| + | |||
---- | ---- | ||
| − | [[ECE662|Back to main ECE662 page]] | + | |
| + | [[ECE662|Back to main ECE662 page]] | ||
| + | |||
| + | [[Category:ECE662Spring2014Boutin]] [[Category:ECE]] [[Category:ECE662]] [[Category:Pattern_recognition]] | ||
Latest revision as of 19:50, 2 May 2016
Contents
ECE662: Statistical Pattern Recognition and Decision Making Processes, Spring 2014 (cross-listed with CS662)
Welcome to ECE662!
- The cleaned up version of the slectures is here.
Course Information
Instructor:
- Office: MSEE342
- Office hours
- Assignment Drop Box
Lecture:
- When? TuTh, 10:30 - 11:45
- Where? EE117 (subject to change)
Slectures
The cleaned up version of these slectures is HERE
Please use this template for text slectures or this template for video slectures
- Slectures on Probability and Statistics
- Whitening and Coloring Transforms, by Maliha Hossain OK
- How to generate random n dimensional data from two categories with different priors
- Video slecture in English by Alex Gheith OK
- Video slecture in Korean , by Minwoong Kim OK
- Video slecture in Korean , by Hyun Dok Cho OK
- Text slecture in English by Joonsoo Kim OK
- Text slecture in English by Jonghoon Jin OK
- Principal Component Analysis (PCA)
- Text slecture in English, by Tian Zhou OK
- Text slecture in English, by Sujin Jang OK
- Video slecture in English, and Chinese, by Tsung Tai Yeh OK
- Video slecture in English, by Khalid Tahboub <span style="color:GREEN" />
- Slectures on Curse of Dimensionality
- Text slecture in English, and in Chinese by Haonan Yu USE SAME COMMENT PAGE FOR BOTH ENGLISH AND CHINESE VERSION
- Slectures on Bayes Rule
- Bayes Rule in Layman's Terms
- Video slecture in Spanish by Francis Phillip OK
- Derivation of Bayes Rule
- Text slecture in English By Anonymous7 OK
- Text slecture in English by Varun Vasudevan OK
- Video slecture in English by Nadra Guizani OK
- Video slecture in English by Jieun Kim OK
- Text slecture in Greek by Stylianos Chatzidakis OK
- Text slecture in Chinese by Weibao Wang OK
- Optimality of Bayes Rule
- Video slecture in English by Aaron Michaux OK
- Video slecture in Korean by Jeong-wan Kim OK
- Upper Bounds for Bayes Error
- Text slecture in English by G. M. Dilshan Godaliyadda
- Text slecture in English (includes the derivation of Chernoff Distance) by Jeehyun Choe OK
- Bayes Rule to Minimize Risk
- Video slectures in English, by Andy Park OK
- Text slecture in Chinese by Robert Ness OK
- Text slecture in English by Dennis Lee OK
- Bayes Rule for Normally Distributed Features
- Text slecture in English by Yanzhe Cui
- Text slecture in English by Jihwan Lee OK
- Bayes rule in practice
- Text slecture in English by Lu Wang OK
- Text slecture in English by Chuohao Tang OK
- Bayes Rule in Layman's Terms
- Slectures on Neyman-Pearson test and ROC curves
- Text slecture in English by Soonam Lee OK
- Video slecture in English by Jianxin Sun OK
- Slectures on Density Estimation
- Maximum Likelihood Estimation (MLE)
- Text slecture in English by Sudhir Kylasa OK
- Text slecture in English by Hariharan Seshadri OK
- Video slecture in English by Anantha Raghuraman OK
- Video slecture in English by Spencer Carver OK
- Text slecture in English by Lu Zhang OK
- Video slecture in English by Keehwan Park OK
- Text slecture in English by Wen Yi
- Text slecture in English by Zhenpeng Zhao
- Bayesian Estimation (BPE)
- Text slecture in English by Haiguang Wen OK
- Text slecture in English, by Shaobo Fang
- Text slecture in English by Yu Wang
- Introduction to Local density Estimation Techniques (so-called "non-parametric")
- Text slecture in English by Yu Liu OK
- Video slecture in Russian by Aziza Satkhozhina
- Video slecture in English by Nusaybah Abu-Mulaweh
- Video slecture in English by Chenxi Yuan OK
- Density Estimation with Parzen Windows
- Text slecture in English by Chiho Choi OK
- Text slecture in English by Ben Foster OK
- Text slecture in English by Abdullah Alshaibani OK
- Density Estimation with K-Nearest Neighbors (KNN)
- Text slecture in English by Raj Praveen Selvaraj OK
- Text slecture in English by Dan Barrett QUESTION PAGE
- Video slecture in English by Qi Wang OK
- The Nearest Neighbor Decision Rule
- Text slecture in English by Sang Ho Yoon
- Text slecture in English by Jonathan Manring OK
- Maximum Likelihood Estimation (MLE)
- Slectures on Linear Classifiers
- Text slecture in English by John Mulcahy-Stanislawczyk
- Text slecture in English by Borui Chen
- Slectures on Support Vector Machines (SVM)
- Text slecture in English by Xing Liu
- Video slecture in English by Tao Jiang
- Slectures on Clustering Algorithms (supplemental material)
- text slecture in English by David Runyan
Peer Reviews
- Instruction for peer reviewing HW1
- Instruction for peer reviewing HW2 (due before class on April 29)
Discussion
Feel free to use the space below for discussion, or create a page for discussion and link it below.
- Where to find data for HW1
- Possible Real-world data to use for class
- Programming help!
- New Discussion
