This lecture overviews Hypothesis Testing that has many applications in statistics and pattern recognition. It covers the following topics in detail: Elementary Principles, NSHT & BHT, Tests: Tests comparing mean values (T-test, Z-test), Tests detecting normal distribution (Chi-Squared test, Mardia’s test), Tests determining distribution type (Anderson-Darling Test, Kolmogorov-Smirnov Test).
This lecture overviews Kernel Methods that have many applications in classification and clustering. It covers the following topics in detail: Kernel Trick. Kernel Matrix. Kernel PCA. Kernel correlation and its use in object tracking. Kernel k-means.
This lecture overviews Dimensionality Reduction that has many applications in object clusring and object recognition. It covers the following topics in detail: Feature selection. Principal Component Analysis. Linear Discriminant Analysis. SVD Data Compression. Multidimensional Scaling. Non-negative matrix factorization, Learning Vector Quantization.
This lecture overviews Graph-Based Pattern Recognition that has many applications in data clustering and dimensionality reduction. It covers the following topics in detail: Graph-based Clustering, Locality Preserving Projections, Locally Linear Embedding, ISOMAP, Laplacian Embedding, Linear Discriminant Analysis, Marginal Fisher Analysis, Local Fisher Discriminant Analysis, Semi-supervised Discriminant Analysis, Laplacian Support Vector Machines.
This lecture overviews Decision Surfaces and, in particular, Support Vector Machines that have many applications in Machine Learning and Pattern Recognition. It covers the following topics in detail: Decision surfaces. Hyperplanes. Non-linear Decision Surfaces. Quadratic (2nd degree polynomial) surfaces, Hyperellipsoid/Hyperparaboloid. Support Vector Machines, Margin Maximization, Lagrangian Primal/Dual Problem, Kernel SVM.
This lecture overviews Label Propagation that has many applications in pattern recognition (semi-supervised learning) and in the study of diffusion processes. It covers the following topics in detail: Graph construction approaches (Adjacency Matrix Construction, Graph Weighting, Simultaneous Graph Construction and Weighting). Label Inference Methods (Graph Min-cut, Markov Random Fields, Gaussian Random Fields, Local and Global… Continue reading Label Propagation