Why a proximal step creates exact zeros
AdvancedOPT 08 · Geometric Applications, Splitting and Modern MethodsInteractive plot
Description
Compare soft thresholding with ordinary shrinkage and inspect its nonsmooth objective.
Try this: Keep v=1 and increase λ through 1. Why does the optimum stay at exactly zero afterward?
Hints
The chapter section that uses this lab:
Lab · Why a proximal step creates exact zeros
- Proximal solution
- 0.5
- Objective
- 1
- Residual v − x
- 1
Outside the threshold, the magnitude is reduced by λ.
Try this: Keep v=1 and increase λ through 1. Why does the optimum stay at exactly zero afterward?
Solve minₓ ½(x−v)²+λ|x|. The exact proximal solution is sign(v) max(|v|−λ,0). This scalar identity extends coordinatewise to an L1 penalty; it is not a complete total-variation denoiser.