Differences

This shows you the differences between two versions of the page.

--- course_outline [2016/08/29 19:12] – hj
+++ course_outline [2016/09/12 21:11] (current) – hj
@@ Line 4: / Line 4: @@
 ===== Weeks 1 and 2 =====
+**Machine Learning** (basic concepts)
 **Math Background**: probabilities; Bayes theorem; statistics; estimation; regression; hypothesis testing; entropy; mutual information; decision tree; optimization theory and convex optimization; matrix decomposition
@@ Line 9: / Line 11: @@
 ===== Week 3 =====
-**Data, Feature and Model**:  Feature engineering, feature extraction (PCA, LDA, etc), data virtualization
+**Data, Feature and Model**:  Feature Engineering, Feature Extraction (PCA, LDA, etc), Data Virtualization
 ===== Week 4 =====
-**Machine Learning Basics**:  Learnability; Basic concepts; Bayesian decision theory
+**Machine Learning (ML) Basics**:  Learnability; Some basic ML Concepts; Bayesian decision theory
 ===== Week 5 =====
-**Generative Models (I)**: model estimation: maximum likelihood, Bayesian learning, EM algorithm; multivariate Gaussian, Gaussian mixture model, Multinomial, Markov Chain model, etc.
+**Generative Models (I)**: model estimation: maximum likelihood, Bayesian learning, multivariate Gaussian, Multinomial, Markov Chain model, etc.
 ===== Week 6 =====
@@ Line 24: / Line 26: @@
+===== Week 7 =====
-===== Week 6 =====
+**Discriminative Models (II) **:  Neural Networks and Deep Learning
-**Hidden Markov Model (HMM)**: HMM vs. Markov chains; HMM concepts; Three algorithms: forward-backward; Viterbi decoding; Baum-Welch learning.
+===== Week 8  =====
-===== Week 7  =====
-midterm presentation
+**Generative Models (II)**: EM algorithm; Finite Mixture models, e.g. Gaussian mixture model
-===== Week 8 =====
+===== Week 9  =====
-**Automatic Speech Recognition (ASR) (I)**: Acoustic and Language Modeling:
+**Generative Models (III)**:  graphical models, directed vs. indirected graphical models, exact inference, approximate inference (loopy belief propagation, variational inference, Monte Carlo methods)
-HMM for ASR;  ASR as an example of pattern classification;
-Acoustic modeling: HMM learning (ML, MAP, DT); parameter tying (decision tree based state tying); n-gram models: smoothing, learning, perplexity, class-based.
-===== Week 9 =====
+===== Week 10  =====
-**Automatic Speech Recognition (ASR) (II)**: Search - why search; Viterbi decoding in a large HMM; beam search; tree-based lexicon; dynamic decoding; static decoding; weighted finite state transducer (WFST)
+**Selected Advanced Topics**: Hidden Markov Model (HMM), HMM concepts; Three algorithms: forward-backward; Viterbi decoding; Baum-Welch learning.
-===== Week 10 =====
+===== Weeks 11-12 =====
-**Spoken Language Processing (I)**: text categorization
-classify text documents: call/email routing, topic detection, etc.
-vector-based approach, Naïve Bayes classifier; Bayesian networks, etc.
-(2) HMM applications: Statistical Part-of-Speech (POS) tagging;
- Language understanding: hidden concept models.
-===== Week 11 =====
-**Spoken Language Processing (II)**: statistical machine translation
- IBM’s models for machine translation: lexicon model, alignment model, language model
- training process, generation & search
-===== Week 12 =====
 student presentation