Is this what we'll learn to do in this class? Or is this what we'll learn not to do? 🤔🤔🤔
The chief objective of this course is to introduce standard statistical machine learning methods, including but not limited to various methods for supervised and unsupervised learning problems. Particular focus is on the conceptual understanding of these methods, their applications, and hands-on experience.| Date | Topics | Lecture notes | Homework/ Practice problems |
|---|---|---|---|
| 1/16 | Lecture 1: Introduction, Linear regression; Optimization algorithms Discussion: Linear algebra review |
Lecture slides, Discussion slides | Linear algebra questions I |
| 1/23 | Lecture 2: Linear classifiers; Perceptron; Logistic regression Discussion: Linear algebra review | Lecture slides, Optimization Colab, Perceptron Colab Discussion slides | Linear algebra questions II, HW1 |
| 1/30 | Lecture 3: Generalization; Nonlinear basis; Regularization Discussion: Probability review |
Lecture slides, Non-linear functions Colab, Discussion slides |
|
| 2/6 | Lecture 4: Review, problem solving, pytorch | Calculus, Problem set 1, Problem set 2, Pytorch Colab | |
| 2/13 | Lecture 5: L1 regularization, Kernel methods Discussion: HW1 review | Lecture slides, L1 regularization Colab | HW2 |
| 2/20 | Lecture 6: SVM, Multiclass classification Discussion: Problem discussion for Exam 1 | Lecture slides, SVM Colab | |
| 2/27 | Lecture 7: Multiclass classification, Neural Networks Discussion: SVM problem solving | Lecture slides | |
| 3/6 | Lecture: Exam 1 📝 No Discussion session | ||
| 3/13 | Lecture 8: Optimization for neural networks, CNNs Discussion: Project overview | Lecture slides | HW3 |
| 3/20 | Spring break ☀️ | ||
| 3/27 | Lecture 9: Language modelling, Markov models, RNNs, Attention Discussion: Evaluation metrics (precision, recall etc.) | Lecture slides, Discussion slides | |
| 4/3 | Lecture 10: Transformers; Decision trees; Ensemble methods Discussion: HW3 review and related problem solving | Lecture slides, Discussion slides | HW4 |
| 4/10 | Lecture 11: Boosting; Dimensionality reduction and visualization; PCA Discussion: Reading research papers | Lecture slides, Discussion slides | |
| 4/17 | Lecture 12: Clustering; k-means; Gaussian mixture models; EM Discussion: HW4 review and related problem solving | ||
| 4/24 | Lecture 13: Density estimation; Generative models & Naive Bayes; Responsible ML, Fairness, Robustness, Privacy Discussion: Problem solving for Exam 2 | ||
| 5/1 | Lecture: Exam 2 📝 No Discussion session | ||
| TBD | Project report due 📕 |
Collaboration policy and academic integrity: Our goal is to maintain an optimal learning environment. You can discuss the homework problems at a high level with other groups, but you should not look at any other group's solutions. Trying to find solutions online or from any other sources for any homework or project is prohibited, will result in zero grade and will be reported. To prevent any future plagiarism, uploading any material from the course (your solutions, exams etc.) on the internet is prohibited, and any violations will also be reported. Please be considerate, and help us help everyone get the best out of this course.
Please remember the Student Conduct Code (Section 11.00 of the USC Student Guidebook). General principles of academic honesty include the concept of respect for the intellectual property of others, the expectation that individual work will be submitted unless otherwise allowed by an instructor, and the obligations both to protect one's own academic work from misuse by others as well as to avoid using another's work as one's own. All students are expected to understand and abide by these principles. Students will be referred to the Office of Student Judicial Affairs and Community Standards for further review, should there be any suspicion of academic dishonesty.
Students with disabilities: Any student requesting academic accommodations based on a disability is required to register with Disability Services and Programs (DSP) each semester. A letter of verification for approved accommodations can be obtained from DSP. Please be sure the letter is delivered to the instructor as early in the semester as possible.