Stats 7.1The video for this lesson is on its way.
Everything else is ready: study the parts, the key terms and the quiz below.
Stats 7.1Concept6 parts
Entropy
Measure uncertainty in bits, and see why a pure node has zero entropy.
Loading your progress…Next: 7.2 Cross-Entropy and Log Loss
In this lesson6 parts
- 01Count what the node contains
- 02Derive entropy from class probability
- 03Work one recorded-code threshold
- 04Check a second impurity criterion
- 05Sweep candidate thresholds in one feature
- 06Reproduce and challenge