Quant Toolbox - 24. Bayesian Statistics - Shrinkage

1
Quant Toolbox > 23. Bayesian statistics > Shrinkage Shrinkage The classical-equivalent estimator is also known as Bayes-Stein shrinkage estimator. Classical-equivalent shrinkage ˆ θ classical low confidence ←- θ cl _eq posterior high confidence -→ θpri prior (23.13) Estimation uncertainty shrinkage s 2 θ high confidence -→ 0 (23.14) The MAP classical equivalent (23.9) is a maximum likelihood estimator (22.5), with a shrinkage penalty function ˆ θMAP argmax θ {ln f θ (x)+ φ(θ)} (23.15) where the penalty is given by the prior φ(θ) ln fpri (θ). ARPM - Advanced Risk and Portfolio Management - arpm.co This update: Feb-24-2017 - Last update

Transcript of Quant Toolbox - 24. Bayesian Statistics - Shrinkage

Page 1: Quant Toolbox - 24. Bayesian Statistics - Shrinkage

Quant Toolbox > 23. Bayesian statistics > Shrinkage

Shrinkage

The classical-equivalent estimator is also known as Bayes-Stein shrinkageestimator.

• Classical-equivalent shrinkage

θ̂classical

low confidence←− θcl_eqposterior

high confidence−→ θpriprior

(23.13)

• Estimation uncertainty shrinkage

s2θhigh confidence−→ 0 (23.14)

The MAP classical equivalent (23.9) is a maximum likelihood estimator(22.5), with a shrinkage penalty function

θ̂MAP ≡ argmaxθ{ln fθ(x) + φ(θ)} (23.15)

where the penalty is given by the prior φ(θ) ≡ ln fpri(θ).

ARPM - Advanced Risk and Portfolio Management - arpm.co This update: Feb-24-2017 - Last update