ST 361 Normal Distribution - Department of Statistics



Ch 5.5 + Ch 5.6 Sampling Distribution

Topics:

I. What is a Sampling Distribution?

II. Sampling Distribution of a Sample Mean [pic]

(a) X ~ Normal Distribution

(b) X ~ Non-normal Distribution

III. Central Limit Theorem

IV. Sampling Distribution of the Sample Proportion p

----------------------------------------------------------------------------------------------------------------------------

I. Sampling Distribution

• Population vs. Sample:

❖ Population (or process) = The object of interest (for which we would like to make inference

❖ Due to limited resource and time, it is usually impossible to know every aspect of the population

❖ Instead, we obtain a (random) sample from the population

❖ Use the information from the sample to make inference about the population

❖ For example, we naturally use sample mean [pic] to estimate the population mean ([pic])

❖ Since [pic] was obtained from a sample, we are not guaranteed to get the same value for [pic] if we conduct the same experiment (to obtain the data) again.

❖ So [pic] can be viewed as a random variable, thus has a distribution. This distribution is called the sampling distribution of[pic].

• A Statistic is a numerical quantity that is calculated from the sample (for example, the sample mean [pic] is a statistic)

• A Parameter is a population characteristic (fixed) such as the success probability in a Binomial distribution

• The observed value of statistic depends on the particular sample; hence it varies from sample to sample. Such variability is called sampling variability

• The probability distribution of the statistics is called its sampling distribution

• Why do we care about the sampling distribution? The sampling distribution of a statistic tells us what values a statistic is likely to take; we can use the sampling distribution to make inference about the population parameter.

Ex1. A neighborhood has 5 houses A, B, C, D and E. They respectively have 3, 2, 5, 3, and 4 bedrooms. We randomly draw 3 houses at a time and calculate the sample statistics median and mean of bedrooms. What is the sampling distribution of the sample median? What is the sampling distribution of the sample mean?

|Houses drawn in the sample |# of bedrooms |Sample median |Sample mean |Probability |

|ABC |3,2,5 |3 |10/3=3.3 |0.1 |

|ABD |3,2,3 |3 |8/3=2.7 |0.1 |

|ABE |3,2,4 |3 |9/3 = 3 |0.1 |

|ACD |3,5,3 |3 |11/3 = 3.7 |0.1 |

|ACE |3,5,4 |4 |4 |0.1 |

|ADE |3,3,4 |3 |10/3 = 3.3 |0.1 |

|BCD |2,5,3 |3 |3.3 |0.1 |

|BCE |2,5,4 |4 |11/3=3.7 |0.1 |

|BDE |2,3,4 |3 |9/3 = 3 |0.1 |

|CDE |5,3,4 |4 |4 |0.1 |

The sample median takes 2 values: 3 & 4 with probabilities 0.7 and 0.3. So the probability mass function for sample median is

|Sample meadian |3 |4 |

|Probability |0.7 |0.3 |

Similarly, the probability mass function for sample mean is

|Sample mean |2.7 |3 |3.3 |3.7 |4 |

|probability |0.1 |0.2 |0.3 |0.2 |0.2 |

II. Sampling Distribution of a Sample Mean [pic]

Let [pic] be the sample mean of a random sample [pic] from a population with mean [pic] and SD [pic]. (That is, [pic].) We want to know the sampling distribution of [pic].

❖ If X ~ Normal (mean=[pic], SD=[pic]). Then [pic], the mean of a random sample of n observations

• follows a Normal distribution with mean [pic] and standard deviation [pic].

• [pic]= [pic], and[pic] = [pic]

• [pic] is also called standard error (SE) of [pic], or Standard error of the mean

Ex 2. Thousands of boxes contain nuts. The weights are normally distributed with mean [pic]=1 lb and SD [pic]=0.01 lb. We inspect 4 boxes and get their weights [pic]. The sample mean is [pic]

(a) What is the sampling distribution of[pic]? Mean and SE of[pic]?

[pic]

(b) What is the probability that [pic] lies between 0.99 and 1.01 lb?

[pic]

X ~ any non-normal distribution with mean=[pic], SD=[pic]. The sampling distribution of [pic] based on a sample of size n is

(a) If n is small (i.e., < 30 ), then

• Distribution: is determined by the distribution of X

• Mean [pic] and SE [pic]:

[pic], [pic]

(b) If n is large (i.e., [pic]), then

• Distribution of [pic]is approximately normal

• Mean [pic] and SE[pic]:

[pic],[pic]

❖ These results follow from Central Limit Theorem (CLT)

III. Central Limit Theorem

Assume X follows an arbitrary distribution with mean [pic] and SD[pic].

When sample size is sufficiently large (i.e., n[pic]30), the sample distribution of [pic] always follows normal distribution with mean [pic] and SE [pic]

• Usually the less symmetric a distribution is, the larger the sample size will need to ensure normality of [pic]

Ex3. Let X be the number of major defects for each new automobile tested. Suppose the number of such defects for a certain model has some distribution with mean[pic]=3.2 and SD [pic]=2.4. A sample of 100 new cars is collected.

(a) What is the sampling distribution of [pic]based on samples of size 100? What is its center and what is the SE of[pic]?

[pic]

(b) What is the probability that the sample average number of major defects exceeds 4?

[pic]

❖ Comments:

• If [pic] is the sample mean of a random sample [pic] from a population with mean =[pic] and SD =[pic], then regardless of the sample size n and the distribution of X,

[pic]

• The variation of sample means is [pic] (always) than variation of the original dataAs sample size n increases, [pic] (the SE of [pic]) decreases, and the shape of the sampling distribution becomes more and more bell shaped and the mass is more and more concentrated around mean[pic]. This implies higher probability around [pic].

[pic]

Ex4. The heights of college age students (denoted by X) are known to have mean [pic]=115 and SD [pic]=30.

a) Assume that we were told that the heights of college age students are normally distributed. What is the sampling distribution of [pic]based on samples of 9 college age students? What are the mean and SE?

[pic]

b) What is the sampling distribution of[pic]based on samples of 9 college age students without the assumption that the heights have a normal distribution? What are the mean and SE of the sampling distribution of [pic]?

The distribution is determined by the height distribution. But

[pic]

c) What is the sampling distribution of[pic], the average height of 36 college age students? What are the mean and SE of the sampling distribution of[pic]?

[pic]

IV. Sampling Distribution of a Sample Proportion p

Ex. Consider a basket containing 100 balls with 2 colors: Red and White. The proportion of Red balls is denoted by [pic] (and is not known). Assume 30 balls were randomly picked from the basket with replacement, and 14 balls out of the 30 balls were red.

1) In the sample, what is the proportion of red balls?

[pic]

2) We refer such quantity, [pic] as sample proportion and denote it by [pic].

Our question of interest: what is the distribution of the sample proportion [pic]?

Thoughts: we can think a r.v such that X = 1 if “red” and X=0 if “not red”.

Then [pic]can be viewed as the mean of 30 X’s

In general, [pic]from a sample of size n can be written as

[pic]

Thus by CLT , [pic]~ Normal if [pic]large. (However, different criteria for “large [pic]” are needed here.)

Sampling Distribution of p

(a) If _large n ([pic]), then the sample proportion [pic] has

• A ___normal distribution___ ( by CLT)

• Mean (denoted by [pic]) ’ [pic], and SE (denoted by [pic]) [pic]

(b) If _small n (at least one of [pic] does not satisfy), then the sample proportion [pic] has

• An unknown (discrete) distribution

• Mean (denoted by [pic]) ’[pic] , and SE (denoted by [pic]) = [pic]

Ex5. In the population, the proportion of defectives [pic] =12%.

a) What is the sampling distribution of [pic] based on 100 observations? What is the mean? What is the standard error?

Approximate normal with mean=0.12, SD=[pic]0.03

b) What is the probability that [pic] ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download