Deep Learning / 31
Advanced Architectures
Survey advanced network families and define the evidence needed to assess new architectural ideas.
This is a knowledge index. Published titles open their articles; the remaining entries outline planned coverage.
Architectures in this chapter evolve quickly. Future articles should state their review date, identify the model or paper version, and distinguish reported evidence from interpretation.
Subtopics
- 31.01
Residual Networks
Planned guide: Residual Networks. Focus on intuition, assumptions, and a worked example.
- 31.02
Dense Networks
Planned guide: Dense Networks. Focus on intuition, assumptions, and a worked example.
- 31.03
Mixture of Experts
Planned guide: Mixture of Experts. Focus on intuition, assumptions, and a worked example.
- 31.04
Sparse Neural Networks
Planned guide: Sparse Neural Networks. Focus on intuition, assumptions, and a worked example.
- 31.05
Memory Networks
Planned guide: Memory Networks. Focus on intuition, assumptions, and a worked example.
- 31.06
Neural ODEs
Planned guide: Neural ODEs. Focus on intuition, assumptions, and a worked example.
- 31.07
Capsule Networks
Planned guide: Capsule Networks. Focus on intuition, assumptions, and a worked example.
- 31.08
State Space Models
Planned guide: State Space Models. Focus on intuition, assumptions, and a worked example.
- 31.09
Mamba-Style Architectures
Planned guide: Mamba-Style Architectures. Focus on intuition, assumptions, and a worked example.
- 31.10
Retrieval-Augmented Neural Systems
Planned guide: Retrieval-Augmented Neural Systems. Focus on intuition, assumptions, and a worked example.
- 31.11
Modular Neural Networks
Planned guide: Modular Neural Networks. Focus on intuition, assumptions, and a worked example.
- 31.12
Neuro-Symbolic Systems
Planned guide: Neuro-Symbolic Systems. Focus on intuition, assumptions, and a worked example.
- 31.13
Foundation Models
Planned guide: Foundation Models. Focus on intuition, assumptions, and a worked example.
- 31.14
Scaling Laws
Planned guide: Scaling Laws. Focus on intuition, assumptions, and a worked example.
- 31.15
Emerging Architectures
Planned guide: Emerging Architectures. Focus on intuition, assumptions, and a worked example.


