TheJobPoolConsultants Blogs Knowledge HubTheJobPoolConsultants Blogs Knowledge HubTheJobPoolConsultantsBlogs · Knowledge HubTheJobPoolConsultants · Blogs · Knowledge Hub

Machine Learning / 10

Model Evaluation

Compare classification and regression metrics, validation strategies, and probability calibration.

Section 10 of 22 · 31 subtopics

Section / Insight

A demo shows what worked once. Evaluation shows whether it works again.

This is a knowledge index. Published titles open their articles; the remaining entries outline planned coverage.

Classification

  1. 10.01

    Confusion Matrix

    Planned guide: Confusion Matrix. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  2. 10.02

    True Positive

    Planned guide: True Positive. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  3. 10.03

    True Negative

    Planned guide: True Negative. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  4. 10.04

    False Positive

    Planned guide: False Positive. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  5. 10.05

    False Negative

    Planned guide: False Negative. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  6. 10.06

    Accuracy

    Planned guide: Accuracy. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  7. 10.07

    Precision

    Planned guide: Precision. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  8. 10.08

    Recall / Sensitivity

    Planned guide: Recall / Sensitivity. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  9. 10.09

    Specificity

    Planned guide: Specificity. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  10. 10.10

    F1 Score

    Planned guide: F1 Score. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  11. 10.11

    Fβ Score

    Planned guide: Fβ Score. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  12. 10.12

    ROC Curve

    Planned guide: ROC Curve. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  13. 10.13

    AUC

    Planned guide: AUC. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  14. 10.14

    Precision-Recall Curve

    Planned guide: Precision-Recall Curve. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  15. 10.15

    PR-AUC

    Planned guide: PR-AUC. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  16. 10.16

    Log Loss

    Planned guide: Log Loss. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation

Regression

  1. 10.17

    MAE

    Planned guide: MAE. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  2. 10.18

    MSE

    Planned guide: MSE. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  3. 10.19

    RMSE

    Planned guide: RMSE. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  4. 10.20

    R²

    Planned guide: R². Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  5. 10.21

    Adjusted R²

    Planned guide: Adjusted R². Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation

Validation

  1. 10.22

    Holdout Validation

    Planned guide: Holdout Validation. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  2. 10.23

    Cross-Validation

    Planned guide: Cross-Validation. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  3. 10.24

    K-Fold

    Planned guide: K-Fold. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  4. 10.25

    Stratified K-Fold

    Planned guide: Stratified K-Fold. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  5. 10.26

    Leave-One-Out

    Planned guide: Leave-One-Out. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  6. 10.27

    Time-Series Cross Validation

    Planned guide: Time-Series Cross Validation. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation

Calibration

  1. 10.28

    Probability Calibration

    Planned guide: Probability Calibration. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  2. 10.29

    Calibration Curves

    Planned guide: Calibration Curves. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  3. 10.30

    Brier Score

    Planned guide: Brier Score. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation
  4. 10.31

    Threshold Selection

    Planned guide: Threshold Selection. Focus on intuition, assumptions, and a worked example.

    intermediateArticle in preparation