Deep Learning / 10
Normalization
Compare normalization methods and their placement in neural network architectures.
This is a knowledge index. Published titles open their articles; the remaining entries outline planned coverage.
Subtopics
- 10.01
Why Normalize Activations?
Planned guide: Why Normalize Activations. Focus on intuition, assumptions, and a worked example.
- 10.02
Batch Normalization
Planned guide: Batch Normalization. Focus on intuition, assumptions, and a worked example.
- 10.03
Layer Normalization
Planned guide: Layer Normalization. Focus on intuition, assumptions, and a worked example.
- 10.04
Instance Normalization
Planned guide: Instance Normalization. Focus on intuition, assumptions, and a worked example.
- 10.05
Group Normalization
Planned guide: Group Normalization. Focus on intuition, assumptions, and a worked example.
- 10.06
RMS Normalization
Planned guide: RMS Normalization. Focus on intuition, assumptions, and a worked example.
- 10.07
Pre-Norm vs Post-Norm
Planned guide: Pre-Norm vs Post-Norm. Focus on intuition, assumptions, and a worked example.
- 10.08
Normalization in CNNs
Planned guide: Normalization in CNNs. Focus on intuition, assumptions, and a worked example.
- 10.09
Normalization in Transformers
Planned guide: Normalization in Transformers. Focus on intuition, assumptions, and a worked example.