Statistics 512 Notes 2 - Statistics Department
Statistics 512 Notes 2
Point Estimation Continued
Example: Suppose that an iid sample X1,...,Xn is drawn from the uniform distribution on [0,[pic]] where [pic]is an unknown parameter and the distribution of Xi is
[pic]
Several point estimators:
1. [pic]
2. [pic]. Note: Unlike W1, W2 is unbiased because [pic].
3. W3=2[pic]. Note: W3 is unbiased,
[pic]
[pic]
How to compare the estimators? Mean square error is a natural criterion.
A Formula for Computing Mean Squared Error
Theorem: The mean squared error of an estimator of [pic]
[pic]
can be written as
[pic]Proof:
[pic]where we have used the fact that
[pic] [pic][pic]
Notes:
• The decomposition of the mean-squared error into a bias and variance component is called the bias-variance decomposition.
• For an unbiased estimator h(X1,...,Xn), [pic]
Comparison of three estimators for uniform example using mean squared error criterion
1. [pic]
We found the sampling distribution for W1 in Notes 1 to be
[pic]
Also we found
[pic][pic]
To calculate [pic], we calculate [pic]and use the formula [pic].
[pic]
[pic]
Thus,
[pic].
2. [pic]
Note [pic].
Thus, [pic],
[pic] and
[pic]
Because W2 is unbiased, [pic]
3.[pic]
To find the mean square error, we use the fact that if [pic]iid with mean [pic]and variance [pic], then [pic] has mean [pic]and variance [pic](see Examples 4.1.1 and 4.1.2 in textbook).
We have
[pic]
[pic]
[pic]
Thus, [pic], [pic] and
[pic]
[pic]and [pic].
W3 is unbiased and has mean square error [pic].
The mean square errors of the three estimators are the following:
| |[pic] |
|W1 |[pic] |
|W2 |[pic] |
|W3 |[pic] |
For n=1, the three estimators have the same MSE.
For n>1, [pic]
So W2 is best, W1 is second best and W3 is the worst.
Application: During World War II, the US army was interested in estimating the amount of German production of certain war equipment. Every piece of German equipment, whether it was a V-2 rocket, a tank or just an automobile tire was stamped with a serial number that indicated the order in which it was manufactured. If the total number of, say, Mark I tanks produced by a certain date was N, each would bear one of the integers from 1 to N. As the war progressed, some of these numbers became known to the Allies – either by the direct capture of a tank or from records seized when a command post was overrun. The problem was to estimate N using only the sample of “captured” serial numbers, Y1,...,Yn.
The following model was used to estimate N. It was assumed that the sample of n captured serial numbers was a sample of size n without replacement from the numbers 1,..,N. In our notation, the model is
[pic] where [pic]is the distribution of a simple random sample of size n from 1,...,N.
This application is similar to the above example on estimating [pic]from an iid sample from the uniform distribution on [0, [pic]] except that the uniform distribution is on the positive integers 1,...,N and the sampling is without replacement.
Review of Point Estimation
1. Consistency, meaning that the point estimate converges to the true parameter of interest as the sample size becomes large, is a property that any reasonable point estimator should have.
2. Mean square error is a criterion for judging between reasonable point estimators.
Some open questions that will be addressed later in the course (Chapters 6 and 7):
1. What are general methods for finding point estimators?
2. Is there a best point estimator? For example, in our example, we found that W2 is better than W1 or W3. But is there a better point estimator thanW2?
Review of moment generating functions (mgfs)
To evaluate the properties of point estimators, we often need to find the sampling distribution of a point estimator. A useful tool for doing this for certain families of distributions is the moment generating function (mgf). You should be familiar with these from your probability course. This is a brief review. The book discusses moment generating functions in Chapter 1.9.
Definition: Let X be a random variable such that for some h>0, [pic]exists for –h ................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- pm522a introduction to the theory of statistics
- statistics 512 notes 2 statistics department
- data diagnostics using second order tests of benford s law
- introduction to the practice of statistics
- بسم الله الرحمن الرحيم
- probability math 336 exam 2
- annual meeting northern arizona university
- statistics at uc berkeley department of statistics
- statistics 300 ths mathematics department
- stat 515 chapter 3 probability
Related searches
- a level statistics notes pdf
- biology notes form 2 pdf
- statistics and probability notes pdf
- ap statistics notes pdf
- us treasury notes 2 years rate
- combined science form 2 notes all
- combined science form 2 notes all zimbabwe
- probability and statistics notes pdf
- statistics notes and guides
- statistics notes pdf
- statistics lecture notes pdf
- biology form 2 notes pdf