Deep Learning / 24
Multimodal Deep Learning
Connect text, images, and audio through embeddings, fusion, cross-attention, and evaluation.
This is a knowledge index. Published titles open their articles; the remaining entries outline planned coverage.
Subtopics
- 24.01
What is Multimodal Learning?
Planned guide: What is Multimodal Learning. Focus on intuition, assumptions, and a worked example.
- 24.02
Text + Image
Planned guide: Text + Image. Focus on intuition, assumptions, and a worked example.
- 24.03
Text + Audio
Planned guide: Text + Audio. Focus on intuition, assumptions, and a worked example.
- 24.04
Image + Audio
Planned guide: Image + Audio. Focus on intuition, assumptions, and a worked example.
- 24.05
Multimodal Embeddings
Planned guide: Multimodal Embeddings. Focus on intuition, assumptions, and a worked example.
- 24.06
Contrastive Multimodal Learning
Planned guide: Contrastive Multimodal Learning. Focus on intuition, assumptions, and a worked example.
- 24.07
CLIP
Planned guide: CLIP. Focus on intuition, assumptions, and a worked example.
- 24.08
Vision-Language Models
Planned guide: Vision-Language Models. Focus on intuition, assumptions, and a worked example.
- 24.09
Multimodal Fusion
Planned guide: Multimodal Fusion. Focus on intuition, assumptions, and a worked example.
- 24.10
Cross-Attention
Planned guide: Cross-Attention. Focus on intuition, assumptions, and a worked example.
- 24.11
Multimodal Generation
Planned guide: Multimodal Generation. Focus on intuition, assumptions, and a worked example.
- 24.12
Multimodal Evaluation
Planned guide: Multimodal Evaluation. Focus on intuition, assumptions, and a worked example.