PR 07 · Watch soft assignments move the means
AdvancedPR 07 · Clustering, Mixtures and EMInteractive plot
Description
Step through Gaussian-mixture EM and observe responsibilities, likelihood and the symmetric-initialization trap.
Try this: Set initial separation to zero and add iterations. Why do the two means remain identical? Restart with a small separation.
Lab · PR 07 · Watch soft assignments move the means
- Component means
- -1.857 / 1.537
- Log likelihood (nats)
- -15.863
- Gain since initialization
- 10.555
The E step recomputes soft memberships; the M step takes responsibility-weighted means. With identical initial means every responsibility is 1/2, so symmetry cannot break on its own.
Try this: Set initial separation to zero and add iterations. Why do the two means remain identical? Restart with a small separation.
A constrained two-component mixture: both weights stay 1/2 and both standard deviations stay at the selected σ. EM updates only the means. Each point is colored by its current responsibility for component 1; these are component memberships, not supervised labels.