High Level:
- How to compute gradients/how gradient descent works
- How foundation ML models (MLP, trees/forests, boosting/bagging, KNN) work
- How does back propagation work
- The difference between core neural network layers (MLP, CNN, RNN, Transformer/Attention)
- How to perform data processing (balance labeled data)
- How to train models (avoid overfitting/underfitting)
- DSA (data structures & algorithms)
Application:
- How to use key modules like sklearn, pytorch/tensorflow, etc
- How to build neural networks
- When to use each technique (classical ML vs deep learning vs algorithms)
- Intermediate comfort with using Python (and programming in general)