Deep Learning / 11
Initialization
Study weight initialization choices, their relationship to activations, and common failure modes.
This is a knowledge index. Published titles open their articles; the remaining entries outline planned coverage.
Subtopics
- 11.01
Why Initialization Matters
Planned guide: Why Initialization Matters. Focus on intuition, assumptions, and a worked example.
- 11.02
Zero Initialization
Planned guide: Zero Initialization. Focus on intuition, assumptions, and a worked example.
- 11.03
Random Initialization
Planned guide: Random Initialization. Focus on intuition, assumptions, and a worked example.
- 11.04
Xavier / Glorot Initialization
Planned guide: Xavier / Glorot Initialization. Focus on intuition, assumptions, and a worked example.
- 11.05
He Initialization
Planned guide: He Initialization. Focus on intuition, assumptions, and a worked example.
- 11.06
Orthogonal Initialization
Planned guide: Orthogonal Initialization. Focus on intuition, assumptions, and a worked example.
- 11.07
Initialization and Activations
Planned guide: Initialization and Activations. Focus on intuition, assumptions, and a worked example.
- 11.08
Initialization Failure Modes
Planned guide: Initialization Failure Modes. Focus on intuition, assumptions, and a worked example.