Statistics 510: Notes 7
Statistics 510: Notes 17
Reading: Sections 5.6, 5.7
Hazard functions, Section 5.5.1 – read for your own interest, I’ll be happy to discuss with you but will not cover this on the exam.
I. Gamma distribution:
Suppose events occur according to a Poisson process, i.e.,
(a) the probability of an event occurring in a given small time period [pic]is approximately proportion to [pic]
(b) the probability of two or more events occurring in a given small time period [pic]is much smaller than [pic]
(c) the number of events occurring in two non-overlapping time periods are independent.
Suppose we start observing the process at some time (which we denote by time 0). The time until the first event occurs has an exponential ([pic]) distribution.
Let X denote the time until the first [pic]events occur. Let W denote the number of occurrences of the event in the interval [pic]. Then W is a Poisson random variable with parameter [pic]. The cdf of X can be obtained using W as follows:
[pic]
Therefore,
[pic]
What we have just derived is a special case of the gamma family of probability distributions. Before examining the gamma in detail, we generalize the above density to include cases in which [pic]is positive but not necessarily an integer. To do this, it is necessary to replace [pic]with a continuous function of (nonnegative) [pic], [pic], the latter reducing to [pic]when [pic]is a positive integer.
For any real number [pic], the gamma function (of [pic]) is given by
[pic].
Let X be a random variable such that
[pic]
Then X is said to have a gamma distribution with parameters [pic] and [pic].
The mean and variance of the gamma distribution are
[pic].
The gamma family of distributions is a flexible family of probability distributions for modeling nonnegative valued random variables. Some gamma densities are shown in the figure below.
Several other families of continuous distributions are given in Chapter 5.6
III. Distribution of a function of a random variable (Chapter 5.7)
It is often the case that we know the probability distribution of a random variable and are interested in determining the distribution of some function of it. Suppose that we know the distribution of X and we want to find the distribution of [pic]. To do so, it is necessary to express the event that [pic]in terms of X being in some set.
Example 1: Suppose that a random variable X has pdf
[pic]
Let [pic]be a random variable that equals [pic]. What is the pdf of [pic]?
Note, first that the random variable [pic]maps the range of X-values (0,1) onto the interval (1,3).
Let [pic]. Then
[pic]
We have
[pic]
Therefore,
[pic]
Differentiating [pic]gives [pic]:
[pic]
In finding the distribution of functions of random variables, extreme care must be exercised in identifying the proper set of x’s that get mapped into the event [pic]. The best approach is to always sketch a diagram.
Example 2: Let [pic]have the uniform density over the interval (-1,2):
[pic]
Find the pdf for Y, where [pic].
IV. Joint distribution functions (Chapter 6.1)
Thus far, we have focused on probability distributions for single random variables. However, we are often interested in probability statements concerning two or more random variables. The following examples are illustrative:
▪ In ecological studies, counts, modeled as random variables, of several species are often made. One species is often the prey of another; clearly, the number of predators will be related to the number of prey.
▪ The joint probability distribution of the x, y and z components of wind velocity can be experimentally measured in studies of atmospheric turbulence.
▪ The joint distribution of the values of various physiological variables in a population of patients is often of interest in medical studies.
▪ A model for the joint distribution of age and length in a population of fish can be used to estimate the age distribution from the length distribution. The age distribution is relevant to the setting of reasonable harvesting policies.
The joint behavior of two random variables X and Y is determined by the joint cumulative distribution function (cdf):
[pic],
where X and Y are continuous or discrete. The joint cdf gives the probability that the point [pic]belongs to a semi-infinite rectangle in the plane, as shown in Figure 3.1 below.
The probability that [pic]belongs to a given rectangle is, from Figure 3.2,
[pic].
In general, if [pic]are jointly distributed random variables, the joint cdf is
[pic].
Two- and higher-dimensional versions of probability distribution functions and probability mass functions exist. We start with a detailed description of joint probability mass functions.
Joint probability mass functions: Let X and Y be discrete random variables defined on the sample space that take on values [pic]and [pic] respectively. The joint probability mass function of [pic] is
[pic].
Example 3: A fair coin is tossed three times independently: let X denote the number of heads on the first toss and Y denote the total number of heads. Find the joint probability mass function of X and Y.
The joint pmf is given in the following table:
| |y | | | |
|x |0 |1 |2 |3 |
|0 |1/8 |2/8 |1/8 |0 |
|1 |0 |1/8 |2/8 |1/8 |
Marginal probability mass functions: Suppose that we wish to find the pmf of Y from the joint pmf of X and Y.
[pic]
In general, to find the frequency function of Y, we simply sum down the appropriate column of the table giving the joint pmf of X and Y. For this reason, [pic]is called the marginal probability mass function of Y. Similarly, summing across the rows gives
[pic]
which is the marginal pmf of X.
The case for several random variables is analogous. If [pic]are discrete random variables defined on the sample space, their joint pmf is
[pic].
The marginal pmf of [pic], for example, is
[pic].
Example 4: One of the most important joint distributions is the multinomial distribution whcih arises when a sequence of n independent and identical experiments is performed, where each experiment can result in any one of r possible outcomes, with respective probabilities [pic], [pic]. If we let [pic]denote the number of the n experiments that result in outcome i, then
[pic]
whenever [pic].
Suppose that a fair die is rolled 9 times. What is the probability that 1 appears three times, 2 and 3 twice each, 4 and 5 once each and 6 not at all?
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.