SSU vanishing gradients
- What causes them?
- How to initialize network just right?
- which activation function can help and what other problem does it cause?
Xavier initialization
- What is variance of equal to?
- How to choose variance of weights?
Regularization
- Name 5 regularization methods
MAP estimate