Pivotal Quantities - Mathematics 47: Lecture...

34
Pivotal Quantities Mathematics 47: Lecture 16 Dan Sloughter Furman University March 30, 2006 Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 1 / 10

Transcript of Pivotal Quantities - Mathematics 47: Lecture...

Page 1: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Pivotal QuantitiesMathematics 47: Lecture 16

Dan Sloughter

Furman University

March 30, 2006

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 1 / 10

Page 2: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Pivotal quantities

Definition

Suppose X1, X2, . . . , Xn is a random sample from a distribution withparameter θ. If Y = g(X1,X2, . . . ,Xn, θ) is a random variable whosedistribution does not depend on θ, then we call Y a pivotal quantity for θ.

Example

In finding confidence intervals for µ given a random sample X1, X2, . . . ,Xn from N(µ, σ2), we used the fact that

X̄ − µS√n

is a pivotal quantity for µ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 2 / 10

Page 3: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Pivotal quantities

Definition

Suppose X1, X2, . . . , Xn is a random sample from a distribution withparameter θ. If Y = g(X1,X2, . . . ,Xn, θ) is a random variable whosedistribution does not depend on θ, then we call Y a pivotal quantity for θ.

Example

In finding confidence intervals for µ given a random sample X1, X2, . . . ,Xn from N(µ, σ2), we used the fact that

X̄ − µS√n

is a pivotal quantity for µ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 2 / 10

Page 4: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Suppose X1, X2, . . . , Xn is a random sample from N(µ, σ2).

I Then(n − 1)S2

σ2

is χ2(n − 1), and so is a pivotal quantity for σ2.

I Let χ2n,α be the α quantile of χ2(n).

I Then

P

(χ2

n−1, α2≤ (n − 1)S2

σ2≤ χ2

n−1,1−α2

)= 1− α.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 3 / 10

Page 5: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Suppose X1, X2, . . . , Xn is a random sample from N(µ, σ2).

I Then(n − 1)S2

σ2

is χ2(n − 1), and so is a pivotal quantity for σ2.

I Let χ2n,α be the α quantile of χ2(n).

I Then

P

(χ2

n−1, α2≤ (n − 1)S2

σ2≤ χ2

n−1,1−α2

)= 1− α.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 3 / 10

Page 6: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Suppose X1, X2, . . . , Xn is a random sample from N(µ, σ2).

I Then(n − 1)S2

σ2

is χ2(n − 1), and so is a pivotal quantity for σ2.

I Let χ2n,α be the α quantile of χ2(n).

I Then

P

(χ2

n−1, α2≤ (n − 1)S2

σ2≤ χ2

n−1,1−α2

)= 1− α.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 3 / 10

Page 7: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Suppose X1, X2, . . . , Xn is a random sample from N(µ, σ2).

I Then(n − 1)S2

σ2

is χ2(n − 1), and so is a pivotal quantity for σ2.

I Let χ2n,α be the α quantile of χ2(n).

I Then

P

(χ2

n−1, α2≤ (n − 1)S2

σ2≤ χ2

n−1,1−α2

)= 1− α.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 3 / 10

Page 8: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Suppose X1, X2, . . . , Xn is a random sample from N(µ, σ2).

I Then(n − 1)S2

σ2

is χ2(n − 1), and so is a pivotal quantity for σ2.

I Let χ2n,α be the α quantile of χ2(n).

I Then

P

(χ2

n−1, α2≤ (n − 1)S2

σ2≤ χ2

n−1,1−α2

)= 1− α.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 3 / 10

Page 9: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I It follows that

P

((n − 1)S2

χ2n−1,1−α

2

≤ σ2 ≤ (n − 1)S2

χ2n−1, α

2

)= 1− α.

I Hence ((n − 1)S2

χ2n−1,1−α

2

,(n − 1)S2

χ2n−1, α

2

)is a 100(1− α)% confidence interal for σ2.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 4 / 10

Page 10: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I It follows that

P

((n − 1)S2

χ2n−1,1−α

2

≤ σ2 ≤ (n − 1)S2

χ2n−1, α

2

)= 1− α.

I Hence ((n − 1)S2

χ2n−1,1−α

2

,(n − 1)S2

χ2n−1, α

2

)is a 100(1− α)% confidence interal for σ2.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 4 / 10

Page 11: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I It follows that

P

((n − 1)S2

χ2n−1,1−α

2

≤ σ2 ≤ (n − 1)S2

χ2n−1, α

2

)= 1− α.

I Hence ((n − 1)S2

χ2n−1,1−α

2

,(n − 1)S2

χ2n−1, α

2

)is a 100(1− α)% confidence interal for σ2.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 4 / 10

Page 12: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I The estimated ages of 19 mineral samples from the Black Forest ofGermany were found to be (in millions of years):

249 253 273 260 304254 269 306 256 283243 287 303 278 310268 241 280 344

I Then s2 = 733.4.

I We find (either with R, or with Table Va) that χ218,.025 = 8.23, and

χ218,.975 = 31.5.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 5 / 10

Page 13: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I The estimated ages of 19 mineral samples from the Black Forest ofGermany were found to be (in millions of years):

249 253 273 260 304254 269 306 256 283243 287 303 278 310268 241 280 344

I Then s2 = 733.4.

I We find (either with R, or with Table Va) that χ218,.025 = 8.23, and

χ218,.975 = 31.5.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 5 / 10

Page 14: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I The estimated ages of 19 mineral samples from the Black Forest ofGermany were found to be (in millions of years):

249 253 273 260 304254 269 306 256 283243 287 303 278 310268 241 280 344

I Then s2 = 733.4.

I We find (either with R, or with Table Va) that χ218,.025 = 8.23, and

χ218,.975 = 31.5.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 5 / 10

Page 15: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I The estimated ages of 19 mineral samples from the Black Forest ofGermany were found to be (in millions of years):

249 253 273 260 304254 269 306 256 283243 287 303 278 310268 241 280 344

I Then s2 = 733.4.

I We find (either with R, or with Table Va) that χ218,.025 = 8.23, and

χ218,.975 = 31.5.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 5 / 10

Page 16: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I So, assuming the sample is from N(µ, σ2), we see that((18)(733.4)

31.5,(18)(733.4)

8.23

)= (419.1, 1604.0)

is a 95% confidence interval for σ2.

I Note: Taking square roots, it follows that (20.47, 40.05) is a 95%confidence interval for σ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 6 / 10

Page 17: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I So, assuming the sample is from N(µ, σ2), we see that((18)(733.4)

31.5,(18)(733.4)

8.23

)= (419.1, 1604.0)

is a 95% confidence interval for σ2.

I Note: Taking square roots, it follows that (20.47, 40.05) is a 95%confidence interval for σ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 6 / 10

Page 18: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I So, assuming the sample is from N(µ, σ2), we see that((18)(733.4)

31.5,(18)(733.4)

8.23

)= (419.1, 1604.0)

is a 95% confidence interval for σ2.

I Note: Taking square roots, it follows that (20.47, 40.05) is a 95%confidence interval for σ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 6 / 10

Page 19: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Let X1, X2, . . . , Xn be a random sample from a uniform distributionon (0, θ).

I Recall: the density of T = X(n) is

fT (t) =

{ n

θntn−1, if 0 < t < θ,

0, otherwise.

I If we let Y = Tθ , then Y has density

fY (y) = θfT (θy) =

{nyn−1, if 0 < y < 1,

0, otherwise.

I Hence Y is a pivotal quantity for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 7 / 10

Page 20: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Let X1, X2, . . . , Xn be a random sample from a uniform distributionon (0, θ).

I Recall: the density of T = X(n) is

fT (t) =

{ n

θntn−1, if 0 < t < θ,

0, otherwise.

I If we let Y = Tθ , then Y has density

fY (y) = θfT (θy) =

{nyn−1, if 0 < y < 1,

0, otherwise.

I Hence Y is a pivotal quantity for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 7 / 10

Page 21: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Let X1, X2, . . . , Xn be a random sample from a uniform distributionon (0, θ).

I Recall: the density of T = X(n) is

fT (t) =

{ n

θntn−1, if 0 < t < θ,

0, otherwise.

I If we let Y = Tθ , then Y has density

fY (y) = θfT (θy) =

{nyn−1, if 0 < y < 1,

0, otherwise.

I Hence Y is a pivotal quantity for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 7 / 10

Page 22: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Let X1, X2, . . . , Xn be a random sample from a uniform distributionon (0, θ).

I Recall: the density of T = X(n) is

fT (t) =

{ n

θntn−1, if 0 < t < θ,

0, otherwise.

I If we let Y = Tθ , then Y has density

fY (y) = θfT (θy) =

{nyn−1, if 0 < y < 1,

0, otherwise.

I Hence Y is a pivotal quantity for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 7 / 10

Page 23: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example

I Let X1, X2, . . . , Xn be a random sample from a uniform distributionon (0, θ).

I Recall: the density of T = X(n) is

fT (t) =

{ n

θntn−1, if 0 < t < θ,

0, otherwise.

I If we let Y = Tθ , then Y has density

fY (y) = θfT (θy) =

{nyn−1, if 0 < y < 1,

0, otherwise.

I Hence Y is a pivotal quantity for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 7 / 10

Page 24: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I Now the distribution function for Y is

FY (y) =

0, if y ≤ 0,

yn, if 0 < y ≤ 1,

1, if y ≥ 1.

I So, in particular,

P(Y ≤ (0.95)

1n

)= FY

((0.95)

1n

)= 0.95.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 8 / 10

Page 25: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I Now the distribution function for Y is

FY (y) =

0, if y ≤ 0,

yn, if 0 < y ≤ 1,

1, if y ≥ 1.

I So, in particular,

P(Y ≤ (0.95)

1n

)= FY

((0.95)

1n

)= 0.95.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 8 / 10

Page 26: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I Now the distribution function for Y is

FY (y) =

0, if y ≤ 0,

yn, if 0 < y ≤ 1,

1, if y ≥ 1.

I So, in particular,

P(Y ≤ (0.95)

1n

)= FY

((0.95)

1n

)= 0.95.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 8 / 10

Page 27: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I Thus

P

(X(n)

(0.95)1n

≤ θ

)= 0.95.

I And so (X(n)

(0.95)1n

,∞

)is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 9 / 10

Page 28: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I Thus

P

(X(n)

(0.95)1n

≤ θ

)= 0.95.

I And so (X(n)

(0.95)1n

,∞

)is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 9 / 10

Page 29: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

Example (cont’d)

I Thus

P

(X(n)

(0.95)1n

≤ θ

)= 0.95.

I And so (X(n)

(0.95)1n

,∞

)is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 9 / 10

Page 30: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

One-sided confidence intervals

I Note: the interval in the previous example is an example of aone-sided confidence interval, as opposed to the two-sided confidenceintervals of our previous examples.

I In particular, we callX(n)

(0.95)1n

a lower confidence bound for θ.

Example

I Suppose in a sample of size 20 from a uniform distribution on theinterval (0, θ), we find x(20) = 945.1132.

I Then(0.95)

120 ≈ 0.9974386,

so (947.5402,∞) is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 10 / 10

Page 31: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

One-sided confidence intervals

I Note: the interval in the previous example is an example of aone-sided confidence interval, as opposed to the two-sided confidenceintervals of our previous examples.

I In particular, we callX(n)

(0.95)1n

a lower confidence bound for θ.

Example

I Suppose in a sample of size 20 from a uniform distribution on theinterval (0, θ), we find x(20) = 945.1132.

I Then(0.95)

120 ≈ 0.9974386,

so (947.5402,∞) is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 10 / 10

Page 32: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

One-sided confidence intervals

I Note: the interval in the previous example is an example of aone-sided confidence interval, as opposed to the two-sided confidenceintervals of our previous examples.

I In particular, we callX(n)

(0.95)1n

a lower confidence bound for θ.

Example

I Suppose in a sample of size 20 from a uniform distribution on theinterval (0, θ), we find x(20) = 945.1132.

I Then(0.95)

120 ≈ 0.9974386,

so (947.5402,∞) is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 10 / 10

Page 33: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

One-sided confidence intervals

I Note: the interval in the previous example is an example of aone-sided confidence interval, as opposed to the two-sided confidenceintervals of our previous examples.

I In particular, we callX(n)

(0.95)1n

a lower confidence bound for θ.

Example

I Suppose in a sample of size 20 from a uniform distribution on theinterval (0, θ), we find x(20) = 945.1132.

I Then(0.95)

120 ≈ 0.9974386,

so (947.5402,∞) is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 10 / 10

Page 34: Pivotal Quantities - Mathematics 47: Lecture 16math.furman.edu/~dcs/courses/math47/lectures/lecture-16.pdf · 2017-03-07 · is a 95% confidence interval for σ2. I Note: Taking

One-sided confidence intervals

I Note: the interval in the previous example is an example of aone-sided confidence interval, as opposed to the two-sided confidenceintervals of our previous examples.

I In particular, we callX(n)

(0.95)1n

a lower confidence bound for θ.

Example

I Suppose in a sample of size 20 from a uniform distribution on theinterval (0, θ), we find x(20) = 945.1132.

I Then(0.95)

120 ≈ 0.9974386,

so (947.5402,∞) is a 95% confidence interval for θ.

Dan Sloughter (Furman University) Pivotal Quantities March 30, 2006 10 / 10