Trade false alarms for missed alternatives
AdvancedIT 07 · Statistical Evidence, Maximum Entropy and GrowthInteractive plot
Description
Slide a decision threshold across two exact binomial distributions and compute both error probabilities.
Try this: Try thresholds that always accept or always reject H₀. Then increase n while keeping the threshold near n/2.
Hints
The chapter section that uses this lab:
Lab · Trade false alarms for missed alternatives
- False alarm
- 0.04735
- Miss
- 0.15027
- Detection probability
- 0.84973
Reject H₀ for k ≥ 6. Changing a threshold changes both errors; increasing evidence can improve their tradeoff.
Try this: Try thresholds that always accept or always reject H₀. Then increase n while keeping the threshold near n/2.
n independent binary observations. H₀:p=0.3, H₁:p=0.7; reject H₀ if number of ones k≥threshold. Curves show exact finite-sample probability masses. False alarm is conditional on H₀, miss on H₁; neither is a posterior probability.