18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440...

52
18.440: Lecture 18 Uniform random variables Scott Sheffield MIT 18.440 Lecture 18

Transcript of 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440...

Page 1: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

18.440: Lecture 18

Uniform random variables

Scott Sheffield

MIT

18.440 Lecture 18

Page 2: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Outline

Uniform random variable on [0, 1]

Uniform random variable on [α, β]

Motivation and examples

18.440 Lecture 18

Page 3: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Outline

Uniform random variable on [0, 1]

Uniform random variable on [α, β]

Motivation and examples

18.440 Lecture 18

Page 4: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Recall continuous random variable definitions

I Say X is a continuous random variable if there exists aprobability density function f = fX on R such thatP{X ∈ B} =

∫B f (x)dx :=

∫1B(x)f (x)dx .

I We may assume∫R f (x)dx =

∫∞−∞ f (x)dx = 1 and f is

non-negative.

I Probability of interval [a, b] is given by∫ ba f (x)dx , the area

under f between a and b.

I Probability of any single point is zero.

I Define cumulative distribution functionF (a) = FX (a) := P{X < a} = P{X ≤ a} =

∫ a−∞ f (x)dx .

18.440 Lecture 18

Page 5: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Recall continuous random variable definitions

I Say X is a continuous random variable if there exists aprobability density function f = fX on R such thatP{X ∈ B} =

∫B f (x)dx :=

∫1B(x)f (x)dx .

I We may assume∫R f (x)dx =

∫∞−∞ f (x)dx = 1 and f is

non-negative.

I Probability of interval [a, b] is given by∫ ba f (x)dx , the area

under f between a and b.

I Probability of any single point is zero.

I Define cumulative distribution functionF (a) = FX (a) := P{X < a} = P{X ≤ a} =

∫ a−∞ f (x)dx .

18.440 Lecture 18

Page 6: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Recall continuous random variable definitions

I Say X is a continuous random variable if there exists aprobability density function f = fX on R such thatP{X ∈ B} =

∫B f (x)dx :=

∫1B(x)f (x)dx .

I We may assume∫R f (x)dx =

∫∞−∞ f (x)dx = 1 and f is

non-negative.

I Probability of interval [a, b] is given by∫ ba f (x)dx , the area

under f between a and b.

I Probability of any single point is zero.

I Define cumulative distribution functionF (a) = FX (a) := P{X < a} = P{X ≤ a} =

∫ a−∞ f (x)dx .

18.440 Lecture 18

Page 7: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Recall continuous random variable definitions

I Say X is a continuous random variable if there exists aprobability density function f = fX on R such thatP{X ∈ B} =

∫B f (x)dx :=

∫1B(x)f (x)dx .

I We may assume∫R f (x)dx =

∫∞−∞ f (x)dx = 1 and f is

non-negative.

I Probability of interval [a, b] is given by∫ ba f (x)dx , the area

under f between a and b.

I Probability of any single point is zero.

I Define cumulative distribution functionF (a) = FX (a) := P{X < a} = P{X ≤ a} =

∫ a−∞ f (x)dx .

18.440 Lecture 18

Page 8: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Recall continuous random variable definitions

I Say X is a continuous random variable if there exists aprobability density function f = fX on R such thatP{X ∈ B} =

∫B f (x)dx :=

∫1B(x)f (x)dx .

I We may assume∫R f (x)dx =

∫∞−∞ f (x)dx = 1 and f is

non-negative.

I Probability of interval [a, b] is given by∫ ba f (x)dx , the area

under f between a and b.

I Probability of any single point is zero.

I Define cumulative distribution functionF (a) = FX (a) := P{X < a} = P{X ≤ a} =

∫ a−∞ f (x)dx .

18.440 Lecture 18

Page 9: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I Then for any 0 ≤ a ≤ b ≤ 1 we have P{X ∈ [a, b]} = b − a.

I Intuition: all locations along the interval [0, 1] equally likely.

I Say that X is a uniform random variable on [0, 1] or that Xis sampled uniformly from [0, 1].

18.440 Lecture 18

Page 10: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I Then for any 0 ≤ a ≤ b ≤ 1 we have P{X ∈ [a, b]} = b − a.

I Intuition: all locations along the interval [0, 1] equally likely.

I Say that X is a uniform random variable on [0, 1] or that Xis sampled uniformly from [0, 1].

18.440 Lecture 18

Page 11: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I Then for any 0 ≤ a ≤ b ≤ 1 we have P{X ∈ [a, b]} = b − a.

I Intuition: all locations along the interval [0, 1] equally likely.

I Say that X is a uniform random variable on [0, 1] or that Xis sampled uniformly from [0, 1].

18.440 Lecture 18

Page 12: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I Then for any 0 ≤ a ≤ b ≤ 1 we have P{X ∈ [a, b]} = b − a.

I Intuition: all locations along the interval [0, 1] equally likely.

I Say that X is a uniform random variable on [0, 1] or that Xis sampled uniformly from [0, 1].

18.440 Lecture 18

Page 13: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 14: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 15: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 16: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 17: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 18: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 19: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 20: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is E [X ]?

I Guess 1/2 (since 1/2 is, you know, in the middle).

I Indeed,∫∞−∞ f (x)xdx =

∫ 10 xdx = x2

2

∣∣∣10

= 1/2.

I What would you guess the variance is? Expected square ofdistance from 1/2?

I It’s obviously less than 1/4, but how much less?

I E [X 2] =∫∞−∞ f (x)x2dx =

∫ 10 x2dx = x3

3

∣∣∣10

= 1/3.

I So Var[X ] = E [X 2]− (E [X ])2 = 1/3− 1/4 = 1/12.

18.440 Lecture 18

Page 21: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is the cumulative distribution functionFX (a) = P{X < a}?

I FX (a) =

0 a < 0

a a ∈ [0, 1]

1 a > 1

.

I What is the general moment E [X k ] for k ≥ 0?

18.440 Lecture 18

Page 22: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is the cumulative distribution functionFX (a) = P{X < a}?

I FX (a) =

0 a < 0

a a ∈ [0, 1]

1 a > 1

.

I What is the general moment E [X k ] for k ≥ 0?

18.440 Lecture 18

Page 23: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is the cumulative distribution functionFX (a) = P{X < a}?

I FX (a) =

0 a < 0

a a ∈ [0, 1]

1 a > 1

.

I What is the general moment E [X k ] for k ≥ 0?

18.440 Lecture 18

Page 24: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1 x ∈ [0, 1]

0 x 6∈ [0, 1].

I What is the cumulative distribution functionFX (a) = P{X < a}?

I FX (a) =

0 a < 0

a a ∈ [0, 1]

1 a > 1

.

I What is the general moment E [X k ] for k ≥ 0?

18.440 Lecture 18

Page 25: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Outline

Uniform random variable on [0, 1]

Uniform random variable on [α, β]

Motivation and examples

18.440 Lecture 18

Page 26: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Outline

Uniform random variable on [0, 1]

Uniform random variable on [α, β]

Motivation and examples

18.440 Lecture 18

Page 27: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [α, β]

I Fix α < β and suppose X is a random variable with

probability density function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I Then for any α ≤ a ≤ b ≤ β we have P{X ∈ [a, b]} = b−aβ−α .

I Intuition: all locations along the interval [α, β] are equallylikely.

I Say that X is a uniform random variable on [α, β] or thatX is sampled uniformly from [α, β].

18.440 Lecture 18

Page 28: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [α, β]

I Fix α < β and suppose X is a random variable with

probability density function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I Then for any α ≤ a ≤ b ≤ β we have P{X ∈ [a, b]} = b−aβ−α .

I Intuition: all locations along the interval [α, β] are equallylikely.

I Say that X is a uniform random variable on [α, β] or thatX is sampled uniformly from [α, β].

18.440 Lecture 18

Page 29: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [α, β]

I Fix α < β and suppose X is a random variable with

probability density function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I Then for any α ≤ a ≤ b ≤ β we have P{X ∈ [a, b]} = b−aβ−α .

I Intuition: all locations along the interval [α, β] are equallylikely.

I Say that X is a uniform random variable on [α, β] or thatX is sampled uniformly from [α, β].

18.440 Lecture 18

Page 30: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables on [α, β]

I Fix α < β and suppose X is a random variable with

probability density function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I Then for any α ≤ a ≤ b ≤ β we have P{X ∈ [a, b]} = b−aβ−α .

I Intuition: all locations along the interval [α, β] are equallylikely.

I Say that X is a uniform random variable on [α, β] or thatX is sampled uniformly from [α, β].

18.440 Lecture 18

Page 31: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 32: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 33: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 34: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 35: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 36: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 37: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 38: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Properties of uniform random variable on [0, 1]

I Suppose X is a random variable with probability density

function f (x) =

{1

β−α x ∈ [α, β]

0 x 6∈ [α, β].

I What is E [X ]?

I Intuitively, we’d guess the midpoint α+β2 .

I What’s the cleanest way to prove this?

I One approach: let Y be uniform on [0, 1] and try to show thatX = (β − α)Y + α is uniform on [α, β].

I Then linearity ofE [X ] = (β − α)E [Y ] + α = (1/2)(β − α) + α = α+β

2 .

I Using similar logic, what is the variance Var[X ]?

I Answer: Var[X ] = Var[(β − α)Y + α] = Var[(β − α)Y ] =(β − α)2Var[Y ] = (β − α)2/12.

18.440 Lecture 18

Page 39: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Outline

Uniform random variable on [0, 1]

Uniform random variable on [α, β]

Motivation and examples

18.440 Lecture 18

Page 40: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Outline

Uniform random variable on [0, 1]

Uniform random variable on [α, β]

Motivation and examples

18.440 Lecture 18

Page 41: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables and percentiles

I Toss n = 300 million Americans into a hat and pull one outuniformly at random.

I Is the height of the person you choose a uniform randomvariable?

I Maybe in an approximate sense?

I No.

I Is the percentile of the person I choose uniformly random? Inother words, let p be the fraction of people left in the hatwhose heights are less than that of the person I choose. Is p,in some approximate sense, a uniform random variable on[0, 1]?

I The way I defined it, p is uniform from the set{0, 1/(n − 1), 2/(n − 1), . . . , (n − 2)/(n − 1), 1}. When n islarge, this is kind of like a uniform random variable on [0, 1].

18.440 Lecture 18

Page 42: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables and percentiles

I Toss n = 300 million Americans into a hat and pull one outuniformly at random.

I Is the height of the person you choose a uniform randomvariable?

I Maybe in an approximate sense?

I No.

I Is the percentile of the person I choose uniformly random? Inother words, let p be the fraction of people left in the hatwhose heights are less than that of the person I choose. Is p,in some approximate sense, a uniform random variable on[0, 1]?

I The way I defined it, p is uniform from the set{0, 1/(n − 1), 2/(n − 1), . . . , (n − 2)/(n − 1), 1}. When n islarge, this is kind of like a uniform random variable on [0, 1].

18.440 Lecture 18

Page 43: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables and percentiles

I Toss n = 300 million Americans into a hat and pull one outuniformly at random.

I Is the height of the person you choose a uniform randomvariable?

I Maybe in an approximate sense?

I No.

I Is the percentile of the person I choose uniformly random? Inother words, let p be the fraction of people left in the hatwhose heights are less than that of the person I choose. Is p,in some approximate sense, a uniform random variable on[0, 1]?

I The way I defined it, p is uniform from the set{0, 1/(n − 1), 2/(n − 1), . . . , (n − 2)/(n − 1), 1}. When n islarge, this is kind of like a uniform random variable on [0, 1].

18.440 Lecture 18

Page 44: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables and percentiles

I Toss n = 300 million Americans into a hat and pull one outuniformly at random.

I Is the height of the person you choose a uniform randomvariable?

I Maybe in an approximate sense?

I No.

I Is the percentile of the person I choose uniformly random? Inother words, let p be the fraction of people left in the hatwhose heights are less than that of the person I choose. Is p,in some approximate sense, a uniform random variable on[0, 1]?

I The way I defined it, p is uniform from the set{0, 1/(n − 1), 2/(n − 1), . . . , (n − 2)/(n − 1), 1}. When n islarge, this is kind of like a uniform random variable on [0, 1].

18.440 Lecture 18

Page 45: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables and percentiles

I Toss n = 300 million Americans into a hat and pull one outuniformly at random.

I Is the height of the person you choose a uniform randomvariable?

I Maybe in an approximate sense?

I No.

I Is the percentile of the person I choose uniformly random? Inother words, let p be the fraction of people left in the hatwhose heights are less than that of the person I choose. Is p,in some approximate sense, a uniform random variable on[0, 1]?

I The way I defined it, p is uniform from the set{0, 1/(n − 1), 2/(n − 1), . . . , (n − 2)/(n − 1), 1}. When n islarge, this is kind of like a uniform random variable on [0, 1].

18.440 Lecture 18

Page 46: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Uniform random variables and percentiles

I Toss n = 300 million Americans into a hat and pull one outuniformly at random.

I Is the height of the person you choose a uniform randomvariable?

I Maybe in an approximate sense?

I No.

I Is the percentile of the person I choose uniformly random? Inother words, let p be the fraction of people left in the hatwhose heights are less than that of the person I choose. Is p,in some approximate sense, a uniform random variable on[0, 1]?

I The way I defined it, p is uniform from the set{0, 1/(n − 1), 2/(n − 1), . . . , (n − 2)/(n − 1), 1}. When n islarge, this is kind of like a uniform random variable on [0, 1].

18.440 Lecture 18

Page 47: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Approximately uniform random variables

I Intuition: which of the following should give approximatelyuniform random variables?

I 1. Toss n = 300 million Americans into a hat, pull one outuniformly at random, and consider that person’s height (incentimeters) modulo one.

I 2. The location of the first raindrop to land on a telephonewire stretched taut between two poles.

I 3. The amount of time you have to wait until the next subwaytrain come (assuming trains come promptly every six minutesand you show up at kind of a random time).

I 4. The amount of time you have to wait until the next subwaytrain (without the parenthetical assumption above).

18.440 Lecture 18

Page 48: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Approximately uniform random variables

I Intuition: which of the following should give approximatelyuniform random variables?

I 1. Toss n = 300 million Americans into a hat, pull one outuniformly at random, and consider that person’s height (incentimeters) modulo one.

I 2. The location of the first raindrop to land on a telephonewire stretched taut between two poles.

I 3. The amount of time you have to wait until the next subwaytrain come (assuming trains come promptly every six minutesand you show up at kind of a random time).

I 4. The amount of time you have to wait until the next subwaytrain (without the parenthetical assumption above).

18.440 Lecture 18

Page 49: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Approximately uniform random variables

I Intuition: which of the following should give approximatelyuniform random variables?

I 1. Toss n = 300 million Americans into a hat, pull one outuniformly at random, and consider that person’s height (incentimeters) modulo one.

I 2. The location of the first raindrop to land on a telephonewire stretched taut between two poles.

I 3. The amount of time you have to wait until the next subwaytrain come (assuming trains come promptly every six minutesand you show up at kind of a random time).

I 4. The amount of time you have to wait until the next subwaytrain (without the parenthetical assumption above).

18.440 Lecture 18

Page 50: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Approximately uniform random variables

I Intuition: which of the following should give approximatelyuniform random variables?

I 1. Toss n = 300 million Americans into a hat, pull one outuniformly at random, and consider that person’s height (incentimeters) modulo one.

I 2. The location of the first raindrop to land on a telephonewire stretched taut between two poles.

I 3. The amount of time you have to wait until the next subwaytrain come (assuming trains come promptly every six minutesand you show up at kind of a random time).

I 4. The amount of time you have to wait until the next subwaytrain (without the parenthetical assumption above).

18.440 Lecture 18

Page 51: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Approximately uniform random variables

I 5. How about the location of the jump between times 0 and 1of λ-Poisson point process (which we condition to haveexactly one jump between [0, 1])?

I 6. The location of the ace of spades within a shuffled deck of52 cards.

18.440 Lecture 18

Page 52: 18.440: Lecture 18 .1in Uniform random variablesmath.mit.edu/~sheffield/440/Lecture18.pdf · 18.440 Lecture 18. Recall continuous random variable de nitions I Say X is a continuous

Approximately uniform random variables

I 5. How about the location of the jump between times 0 and 1of λ-Poisson point process (which we condition to haveexactly one jump between [0, 1])?

I 6. The location of the ace of spades within a shuffled deck of52 cards.

18.440 Lecture 18