Download - ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Transcript
Page 1: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

Nume

Comp

(1) Ca

(2) Ca

(3) (4) Pl

or Kwon, Sehy

erical app

uting exe

alculate Ba

alculate Ba

ot three Ba

Bayes

yug | Dept. o

roach : D

ercise

yesian esti

yesian esti

ayesian est

ian Inference

of Statistics, H

Discrete pr

mator and

mator with

timators an

e | Chapter 9.

HANNAM Un

rior

95% cred

h Beta (2, 4

nd π in the

. Comparing

niversity

ible interva

4) prior.

same grap

Bayesian and

htt

al with no i

ph.

d Frequentist

p://wolfpack

information

t in the p

| 1

.hnu.ac.kr

n.

Page 2: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

Review

Bayesia

+ our

+ pos

Freque

+ like

Freque

Rando

+ d

+ sa

Sampl

rando

statist

samp

+ m

Likeliho

+ Join

+ fun

+ Fre

+ Bay

Point

Freque

+ ML

+ MV

or Kwon, Sehy

w

an view

r belief on

sterior dist

entist

elihood of

entist inte

m sample

ata is draw

ampling di

ling Distr

om sample

tic : (gs =

ling distrib

measure ho

ood

nt PDF of r

nction of th

quentist : e

yesian : upd

estimatio

entist

LE : The val

VUE : Facto

Bayes

yug | Dept. o

the param

ribution of

random sa

erpretatio

wn from a p

stribution

ibution

: ,..,( 21 yy

,...,,( 21 nyyy

bution : (sf

ow the stati

random sa

he paramet

estimate th

date the p

on

ue of para

orization th

ian Inference

of Statistics, H

meter is upd

f the param

mple = sa

on

population

? conceptu

)., ny

)n

)|θs , θ is

istic varies

mple, data

ter, θ

he θ

rior and ge

meter whic

eorem, Rao

e | Chapter 9.

HANNAM Un

dated by d

meter upda

mpling dis

n distributio

ually, all po

s fixed and

over all po

et posterio

ch maximiz

o Cramer L

. Comparing

niversity

ata

ated by dat

tribution o

on with un

ossible rand

d unknown

ossible sam

r |( datθπ

zes the like

Lower Boun

Bayesian and

htt

ta gives co

of data

known and

dom sampl

mples with

)ta

elihood

nd, Rao-Bla

d Frequentist

p://wolfpack

mplete infe

d fixed p

les

the param

ackwell The

t in the p

| 2

.hnu.ac.kr

erence

eter

eorem

Page 3: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

Bayesia

+ Pos

Evalua

+ pre

+ “wh

- es

- Ba

Unbias

+ Unb

+ Bia

+ Bay

MSE m

+ MS

+ MS

+ MV

Comp

Freque

+ E(

+ MS

Bayesia

+ Uni

+ Con

- po

- Ba

or Kwon, Sehy

an

sterior mea

ating by F

e-data anal

hat if the p

stimation c

ayesian : pr

sed

biased esti

s : θθ =)ˆ(B

yesian don’

mean squar

()ˆ( θθ = ESE

()ˆ( θθ VSE =

VUE : no bi

aring est

entist estim

nyEpf = )()ˆ

ppSE f )ˆ( =

an estimat

iform Prior

njugate Pri

osterior (π

ayesian est

Bayes

yug | Dept. o

an or medi

Frequenti

ysis : samp

parameter h

oncept : m

rior

mator : E

θθ −ˆ

’t care of u

re of error2)ˆ θθ − : m

2)ˆ()ˆ θθ B+

as, (θMSE

imators f

mator pf =ˆ

p=) , pV fˆ(

npp )1( −

tor depend

r ~)(pπ

ior (pπ

~)|( datap

imator : p̂

ian Inference

of Statistics, H

an of post

st criteria

pling dist. i

has the val

max.

θθ =)ˆ( , bia

unbiased

r

measure the

)ˆ()ˆ θθ V= e

or propo

ny

= , ~ By

nyVf )() ==

ding prior

)1,1(~ Beta

,(~) aBeta

*(aBeta =

anaypB ++

+=

e | Chapter 9.

HANNAM Un

erior distri

a

s treated a

ue?”

as = 0

e precision

estimator v

rtion

),( pnB

npp )1( −

=

),b

*,bay =+

any

ba

++=

+

. Comparing

niversity

bution of t

as a random

n of estima

variance

)byn +−

ana

b ++

+

Bayesian and

htt

the θ

m variable.

tors

b+

d Frequentist

p://wolfpack

t in the p

| 3

.hnu.ac.kr

Page 4: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

- M

In R :

or Kwon, Sehy

(

)ˆ( VpMSE b

=

=

(n=10), t

Bayes

yug | Dept. o

2)1(

()ˆ(

ban

pBpV b

++

+

rue p=0.3

ian Inference

of Statistics, H

2

2

)1(

pnp

pb

+−

3

e | Chapter 9.

HANNAM Un

(an

apa++−−

+

. Comparing

niversity

2)bbp

Bayesian and

htt

d Frequentist

p://wolfpack

t in the p

| 4

.hnu.ac.kr

Page 5: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

When

Overal

Unifo

best c

or Kwon, Sehy

n p is betw

l Best

rm prior is

choice is u

Bayes

yug | Dept. o

ween 0.15~0

s the best.

niform prio

ian Inference

of Statistics, H

0.7, Conjug

Therefore,

or.

e | Chapter 9.

HANNAM Un

gate prior i

when no i

. Comparing

niversity

is the best.

nformation

Bayesian and

htt

.

n about p I

d Frequentist

p://wolfpack

I available,

t in the p

| 5

.hnu.ac.kr

the

Page 6: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

Interva

Freque

+ piv

+ sam

+ pY(

+ 100

Bayesia

+ We

+ 100

Bart’s

Hypot

One-si

+ nul

+ alte

+ *y

+ (Fre

+ (Fre

alte

or Kwon, Sehy

al Estimat

entist

ot method

mpling dist

nppnY ~/)1

/−−

0(1-α)% Co

an

e have exac

0(1-α)% Cr

uniform p

thesis test

ded test

l hypothes

ernative hy

is observe

equentist)

equentist)

ernative hy

Bayes

yug | Dept. o

tion

d : get an s

ribution :

z by CLT

onfidence i

ct posterio

edible inte

prior => po

ting

sis : 0 : pH

ypothesis :

ed out of n

p-value=P

(YP ≥≈α

ypothesis,

ian Inference

of Statistics, H

ampling di

),(~ pnBY

T

nterval : ny

r PDF and

rval : ( 12/B−

α

osterior=B

0p=

0: ppHa >

n Bernoulli

|( * YyYP ≥

~|YyCR≥

0pp >

e | Chapter 9.

HANNAM Un

istribution

) the param

yzny /

2/± α

then, exac

*),*,( 12 Bba −−

)75,27(Beta

0 (or pp <

trials

),(~ 0pnBY

)),( 0pnB w

. Comparing

niversity

which has

meter p is

nnyn )/1( −

t CI (called

*)*,(12/ ba−

−α

0p )

))

where CRy

Bayesian and

htt

no parame

in the PDF

d Credible I

)

is the crit

d Frequentist

p://wolfpack

eter in the

F

Interval) ex

tical value

t in the p

| 6

.hnu.ac.kr

PDF

xists

for the

Page 7: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

+ (Ba

+ Nu

+ Alte

The

Two-si

+ nul

+ *y

+ (Fre

+ (Fre

+ (Ba

or Kwon, Sehy

ayesian) P

ll hypothes

ernative hy

re is no str

ded test

l hypothes

is observe

equentist)

equentist)

ayesian) us

Bayes

yug | Dept. o

≤0 :( ppHP

sis : :0 pH

ypothesis :

rong evide

sis : 0 : pH

ed out of n

p-value=P

(2/ P≈α

sing 100(1-

ian Inference

of Statistics, H

∫=0

0

*0 )|

pyp

6.0=

0:0 >pH

ence that p

0p= vs. al

n Bernoulli

|( * YyYP ≥

|( YyY CR≥

-α)% credib

e | Chapter 9.

HANNAM Un

0 * )|( dypπ

6.

6.0>p .

lternative h

trials

,(~ 0pnBY

),(~ 0pnBY

ble interval

. Comparing

niversity

dp is comp

hypothesis

2*)) (whe

)) where y

.

Bayesian and

htt

pared to th

: : ppHa ≠

en * npy >CRy is the

d Frequentist

p://wolfpack

e significan

0p

0p )

critical val

t in the p

| 7

.hnu.ac.kr

nt level.

ue

Page 8: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

Exercis

Exercis

or Kwon, Sehy

se #1

se #2

Bayes

yug | Dept. o

ian Inference

of Statistics, H

e | Chapter 9.

HANNAM Un

. Comparing

niversity

Bayesian and

htt

d Frequentist

p://wolfpack

t in the p

| 8

.hnu.ac.kr

Page 9: ian Inference | Chapter 9. Comparing Bayesian and …wolfpack.hnu.ac.kr/Spring_2011/SKKU/bayes_ch9_compare.pdfian Inference f Statistics, H iscrete pr mator and mator with imators

Professo

Monte

or Kwon, Sehy

e Carlo

Bayes

yug | Dept. o

ian Inference

of Statistics, H

e | Chapter 9.

HANNAM Un

. Comparing

niversity

Bayesian and

htt

d Frequentist

p://wolfpack

t in the p

| 9

.hnu.ac.kr