Deep Learning / 17
Transformers
Connect attention to Transformer blocks, embeddings, position, training, and inference.
Attention changed how information moves. Transformers changed how models scale that movement.
This is a knowledge index. Published titles open their articles; the remaining entries outline planned coverage.
Subtopics
- 17.01
Why Transformers?
Planned guide: Why Transformers. Focus on intuition, assumptions, and a worked example.
- 17.02
Transformer Architecture
Planned guide: Transformer Architecture. Focus on intuition, assumptions, and a worked example.
- 17.03
Token Embeddings
Planned guide: Token Embeddings. Focus on intuition, assumptions, and a worked example.
- 17.04
Positional Information
Planned guide: Positional Information. Focus on intuition, assumptions, and a worked example.
- 17.05
Positional Encoding
Planned guide: Positional Encoding. Focus on intuition, assumptions, and a worked example.
- 17.06
Self-Attention Layer
Planned guide: Self-Attention Layer. Focus on intuition, assumptions, and a worked example.
- 17.07
Feedforward Network
Planned guide: Feedforward Network. Focus on intuition, assumptions, and a worked example.
- 17.08
Residual Connections
Planned guide: Residual Connections. Focus on intuition, assumptions, and a worked example.
- 17.09
Layer Normalization
Planned guide: Layer Normalization. Focus on intuition, assumptions, and a worked example.
- 17.10
Encoder
Planned guide: Encoder. Focus on intuition, assumptions, and a worked example.
- 17.11
Decoder
Planned guide: Decoder. Focus on intuition, assumptions, and a worked example.
- 17.12
Encoder-Decoder Transformer
Planned guide: Encoder-Decoder Transformer. Focus on intuition, assumptions, and a worked example.
- 17.13
Decoder-Only Transformer
Planned guide: Decoder-Only Transformer. Focus on intuition, assumptions, and a worked example.
- 17.14
Encoder-Only Transformer
Planned guide: Encoder-Only Transformer. Focus on intuition, assumptions, and a worked example.
- 17.15
Causal Masking
Planned guide: Causal Masking. Focus on intuition, assumptions, and a worked example.
- 17.16
Multi-Head Attention
Planned guide: Multi-Head Attention. Focus on intuition, assumptions, and a worked example.
- 17.17
Transformer Block
Planned guide: Transformer Block. Focus on intuition, assumptions, and a worked example.
- 17.18
Context Length
Planned guide: Context Length. Focus on intuition, assumptions, and a worked example.
- 17.19
KV Cache
Planned guide: KV Cache. Focus on intuition, assumptions, and a worked example.
- 17.20
Transformer Training
Planned guide: Transformer Training. Focus on intuition, assumptions, and a worked example.
- 17.21
Transformer Inference
Planned guide: Transformer Inference. Focus on intuition, assumptions, and a worked example.


