Full search page →

PR 07 · Watch soft assignments move the means

AdvancedPR 07 · Clustering, Mixtures and EMInteractive plot

Description

Step through Gaussian-mixture EM and observe responsibilities, likelihood and the symmetric-initialization trap.

Try this: Set initial separation to zero and add iterations. Why do the two means remain identical? Restart with a small separation.

Hints

The chapter section that uses this lab:

Lab · PR 07 · Watch soft assignments move the means

Component means
-1.857 / 1.537
Log likelihood (nats)
-15.863
Gain since initialization
10.555

The E step recomputes soft memberships; the M step takes responsibility-weighted means. With identical initial means every responsibility is 1/2, so symmetry cannot break on its own.

Try this: Set initial separation to zero and add iterations. Why do the two means remain identical? Restart with a small separation.

A constrained two-component mixture: both weights stay 1/2 and both standard deviations stay at the selected σ. EM updates only the means. Each point is colored by its current responsibility for component 1; these are component memberships, not supervised labels.

Method sources

Open in the Playground →