How much rate buys a given error?
AdvancedIT 06 · Rate–Distortion and Lossy RepresentationsInteractive plot
Description
Inspect the Bernoulli rate–distortion curve and an attaining joint distribution under Hamming error.
Try this: Move distortion to its maximum. Why is sending no bits sufficient even though some symbols are wrong?
Lab · How much rate buys a given error?
- D
- 0.12
- R(D)
- 0.352
- P(Y=1)
- 0.237
Orange off-diagonal cells are reconstruction errors. Their total equals D; the joint distribution retains the selected source marginal.
Try this: Move distortion to its maximum. Why is sending no bits sufficient even though some symbols are wrong?
X~Bernoulli(p), p≤0.5, Hamming distortion D≤p. R(D)=h₂(p)−h₂(D). Construct X=Y XOR Z with independent Z~Bernoulli(D) and P(Y=1)=(p−D)/(1−2D). At p=D=0.5 choose constant Y=0. The curve is an asymptotic block-coding limit, not the rate of this single-symbol channel.