SIGN TEST (NONPARAMETRIC) - Benedictine University



Sign Test (nonparametric)

Purpose: to test for statistically significant differences between two population means,

paired-difference design.

H0: the population means are equal.

Ha: the population means are not equal (2-sided). 1-sided tests are also possible.

Rejection of H0 means that there is a statistically significant difference between

the sample means, and therefore the population means are probably not equal.

Sign test is based on the binomial distribution where n is the number of pairs.

If H0 is true, the number of times out of n that one group will exceed the other is binomially distributed with p = q = 0.5.

Tied observations are discarded.

Useful to prepare a table with the headings:

"Number of +s" & "p" for determining rejection regions and p-values.

Table is based on the binomial distribution.

Reject H0 if the number of +s is in the rejection region. Reject H0 if p ( α.

Sign test is less powerful than the (parametric) t-test because much information is not used. The sign test uses only the sign of the difference between the items in a pair. The size of the difference is ignored.

H0 rejected:

The p-value is less than or equal to alpha (0.05). The null hypothesis is therefore rejected. The population means are probably not equal.

H0 not rejected:

The p-value is greater than alpha (0.05). The null hypothesis is therefore not rejected. The population means could be equal.

Wilcoxon Signed-Rank Test (nonparametric)

Purpose: to test for statistically significant differences between two population means,

paired-difference design.

H0: the population means are equal.

Ha: the population means are not equal (2-sided). 1-sided tests are also possible.

Rejection of H0 means that there is a statistically significant difference between the

sample means, and therefore the population means are probably not equal.

Procedure:

1. Absolute values of the differences between the observations of each pair are

ranked from lowest (rank 1) to highest (rank n).

Tied observations are discarded.

Tied absolute values of differences are not discarded, but are assigned the

average rank of the tied items.

2. The sum of the rank numbers for each of the two groups is computed.

If H0 is true, the two rank sums will tend to be equal.

3. The test statistic, Tc, is the lower of the two rank sums.

4. Tables give the critical values, Tt.

5. Reject H0 if Tc ( Tt. (!) Because the lower the Tc the stronger the evidence

against H0.

This test is more powerful than the sign test because the sizes of the differences are

Not totally ignored. Yet the differences are not used as fully as they are in the

Paired-difference t-test.

H0 rejected:

The p-value is less than or equal to alpha (0.05). The null hypothesis is therefore rejected. The population means are probably not equal.

H0 not rejected:

The p-value is greater than alpha (0.05). The null hypothesis is therefore not rejected. The population means could be equal.

Mann-Whitney "U" Test (nonparametric)

Purpose: to test for statistically significant differences between two population means,

unpaired design.

H0: the population means are equal.

Ha: the population means are not equal (2-sided). 1-sided tests are also possible.

Rejection of H0 means that there is a statistically significant difference between the sample means, and therefore the population means are probably not equal.

Procedure:

1. All of the (n1 + n2) observations are ranked from lowest (rank 1) to

highest (rank n).

Tied values are assigned the average rank of the tied items.

2. The sum of the rank numbers for each of the two groups is computed.

If H0 is true, the two rank sums will tend to be equal.

3. Compute the following:

U1 = (n1n2) + n1(n1+ 1) / 2 - group 1 rank sum

U2 = (n1n2) + n2(n2+ 1) / 2 - group 2 rank sum

Arithmetic check : U1 + U2 must = (n1*n2).

If H0 is true, U1 & U2 will tend to be equal.

4. The test statistic Uc, is the lower of U1 & U2.

5. Tables give the critical values, Ut.

6. Reject H0 if Uc ( Ut. Because the lower the Uc the stronger the evidence

against H0.

This test is less powerful than the (parametric) unpaired t-test because much information is not used. The test uses only the ranks of the observations, not the observation values themselves.

H0 rejected:

The p-value is less than or equal to alpha (0.05). The null hypothesis is therefore rejected. The population means are probably not equal.

H0 not rejected:

The p-value is greater than alpha (0.05). The null hypothesis is therefore not rejected. The population means could be equal.

=====================================================

Power of a statistical hypothesis test:

Power is a test's ability to detect when H0 is false, and give the correct conclusion

(rejection of H0).

Power is a test's ability to avoid a Type II error.

The power of any test can be increased by increasing the sample size.

The lesser power of nonparametric tests can be offset by using larger samples.

If two different tests are applied to the same data, the more powerful test will

generally produce the lower p-value.

==================================================================

Runs Test (nonparametric)

Purpose: to test for randomness (independence) in a series of binomial-type events.

H0: in the population, events are independent (occur in a random sequence).

Ha: in the population, events are dependent (do not occur in a random sequence).

One- or two-sided tests are possible (for positive or negative dependence).

Rejection of H0 means that there is a statistically significant dependency, which may make better-than-chance forecasts possible.

Procedure:

1. n1 is the number of occurrences of one type of event.

n2 is the number of occurrences of the other type of event.

If n1 ( n2, n1 must be the lower number.

2. A run is a string of like events.

3. The test statistic, rc, is the number of runs in the series.

A very high number of runs is evidence for negative dependency.

A very low number of runs is evidence for positive dependency (streaks).

4. Tables give probabilities of various numbers of runs under independence.

Useful to prepare a table with the headings:

"Number of runs" & "p" for determining rejection regions and p-values.

Reject H0 if the number of runs is in the rejection region. Reject H0 if p ( α.

H0 rejected:

The p-value is less than or equal to alpha (0.05). The null hypothesis is therefore rejected. The sequence of events in the population probably has positive (or negative) dependence.

H0 not rejected:

The p-value is greater than alpha (0.05). The null hypothesis is therefore not rejected. The sequence of events in the population could be independent.

====================================================

A: h h x h x h x h x h x h rc = 11 n1= 5; n2= 7

B: h x x x h h x x h h h h rc = 5

C: h h h h h x x x x x h h rc = 3

r p (r) | r p pos | r p neg

2 .003 | 2 0.003 | 11 0.008

3 .012 | 2,3 0.015 | 10,11 0.045

4 .061 | 2,3,4 0.076 | 9,10,11 0.146

5 .121 | 2,3,4,5 0.197 | 8,9,10,11 0.348

6 .227 | 2,3,4,5,6 0.424 | 7, . . . ,11 0.576

7 .228 | 2, . . . ,7 0.652 | 6, . . . ,11 0.803

8 .202 | 2, . . . ,8 0.854 | 5, . . . ,11 0.924

9 .101 | 2, . . . ,9 0.955 | 4, . . . ,11 0.985

10 .037 | 2, . . . ,10 0.992 | 3, . . . ,11 0.997

11 .008 | 2, . . . ,11 1.000 | 2, . . . ,11 1.000

Kruskal-Wallis Test (nonparametric)

Purpose: the nonparametric version of one-way analysis of variance (ANOVA).

H0: all of the population medians are equal.

Ha: not all of the population medians are equal (2-sided).

Rejection of H0 means that there is a statistically significant difference between the sample medians, and therefore the population medians are probably not equal.

Procedure:

1. All of the observations are ranked from lowest (rank 1) to highest (rank n).

Tied values are assigned the average rank of the tied items.

2. The sum of the rank numbers for each group is computed.

If H0 is true, the rank sums will tend to be equal.

3. The chi-square distribution is used for this test:

χ2c = 12 / (n(n+1)) * (Σ R2 i / n i ) - 3(n+1)

where:

n = the total number of observations

Ri = rank sum for group i

ni = number of observations in group i

χ2t is based on k-1 degrees of freedom where k is the number of groups.

Reject H0 if χ2c >= χ2t.

All sample sizes should equal or exceed 5.

This test is less powerful than the (parametric) ANOVA because much information is not used. The test uses only the ranks of the observations, not the observation values themselves.

H0 rejected:

The χ2c computed from the sample is statistically significant at the 0.05 level.

The population medians are probably not all equal.

H0 not rejected:

The χ2c computed from the sample is statistically significant at the 0.05 level.

The population medians could all be equal.

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download