AI & ML
Unsupervised Learning
Part of Classical ML, level 2. About 13 hours of study across the topics below.
Clustering
- Clustering FramingGroups without labels: what clustering promises, and its honest ambiguity.1–2 h
- k-MeansAssign, then move: the alternating loop that carves clouds into k groups.1–2 h
- Mixture Models IntuitionSoft assignment: points belong by degree, and the EM idea alternates softly too.1–2 h
- Hierarchical ClusteringNested clusterings as a tree: agglomerative merging and choosing where to cut the dendrogram.1–2 h
- Density-Based ClusteringClusters as dense regions: DBSCAN finds arbitrary shapes and labels outliers as noise.1–2 h
- Gaussian Mixture ModelsSoft clustering with Gaussian components fitted by EM: responsibilities, ellipses, and likelihood.1–2 h
Reduction
- Dimensionality Reduction FramingWhy fewer dimensions: visualization, compression, and the information price.1–2 h
- Principal Component AnalysisThe directions that carry variance: projection geometry plus variance accounting.1–2 h
- Latent RepresentationsCompressed codes that reconstruct: bottlenecks, codes, and reconstruction loss.1–2 h
- Matrix Factorization and the SVDLow-rank structure: the SVD as the best rank-k approximation, the engine behind PCA, recommenders, and LoRA.1–2 h
- Probabilistic PCA and Factor AnalysisPCA as a latent-variable model: a low-dimensional Gaussian cause plus noise, the ancestor of the VAE.1–2 h
- Manifold Learning and Nonlinear Embeddingst-SNE, UMAP, and friends: neighbourhood-preserving maps and how to avoid over-reading them.1–2 h
Anomalies
- Anomaly DetectionRare by density: normal regions, thresholds, and the cost of crying wolf.1–2 h