Development and Evaluation of the 1997 ASVAB Score Scale

[Pages:255]Development and Evaluation of the 1997 ASVAB Score Scale

Daniel O. Segall Defense Manpower Data Center

July 2004

Contents

Executive Summary

xi

1 Introduction

1

1.1 1997 American Youth Population . . . . . . . . . . . . 3

1.2 The Armed Services Vocational Aptitude Battery . . . 3

1.3 Related Work . . . . . . . . . . . . . . . . . . . . . . . 4

1.4 Report Outline . . . . . . . . . . . . . . . . . . . . . . 4

2 `97 Score Scale Development

7

2.1 Relative Performance of `80 and `97 Youth Populations 7

2.2 Subtest Standard Score Conversions . . . . . . . . . . 10

2.3 Verbal and Auto-Shop Composites . . . . . . . . . . . 12

2.4 Armed Forces Qualification Test . . . . . . . . . . . . 13

2.5 Service Classification Composites . . . . . . . . . . . . 16

2.5.1 Air Force . . . . . . . . . . . . . . . . . . . . . 16

2.5.2 Marine Corps . . . . . . . . . . . . . . . . . . . 17

2.5.3 Army . . . . . . . . . . . . . . . . . . . . . . . 18

2.5.4 Navy . . . . . . . . . . . . . . . . . . . . . . . . 21

3 Test Form Equating

23

3.1 Background . . . . . . . . . . . . . . . . . . . . . . . . 23

ii Contents

3.2 Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 3.3 Equating and Standard-Score Transformations . . . . 26

3.3.1 Form 03D . . . . . . . . . . . . . . . . . . . . . 26 3.3.2 Form 01D . . . . . . . . . . . . . . . . . . . . . 28 3.3.3 Form 02D . . . . . . . . . . . . . . . . . . . . . 30 3.3.4 Form 25B . . . . . . . . . . . . . . . . . . . . . 32 3.4 Form Equivalence Analyses . . . . . . . . . . . . . . . 34

4 Enlistment Impact

39

4.1 Samples . . . . . . . . . . . . . . . . . . . . . . . . . . 39

4.1.1 CY2002 Cohort . . . . . . . . . . . . . . . . . . 40

4.1.2 Reserve and Guard Samples . . . . . . . . . . . 41

4.2 Qualification Impact . . . . . . . . . . . . . . . . . . . 41

4.3 Equating Enlistment Standards . . . . . . . . . . . . . 44

4.4 High-Quality Applicants and Educational Attainment 48

4.5 Subgroup Effects . . . . . . . . . . . . . . . . . . . . . 53

4.5.1 Groups Defined by Race . . . . . . . . . . . . . 53

4.5.2 Groups Defined by Gender . . . . . . . . . . . 56

4.6 Maintaining Expected Performance . . . . . . . . . . . 56

5 Occupational Qualification Impact

63

5.1 Background . . . . . . . . . . . . . . . . . . . . . . . . 63

5.2 Classification Composite Distribution Analysis . . . . 65

5.2.1 `80 Standard Impact . . . . . . . . . . . . . . . 67

5.2.2 `97 Standard Determination . . . . . . . . . . . 67

6 Implementation Options

69

6.1 Implementation Option Overview . . . . . . . . . . . . 69

6.2 Effects on Nominal and Predictive Standards . . . . . 70

6.3 Option Examples and Outcomes . . . . . . . . . . . . 71

6.3.1 Option A . . . . . . . . . . . . . . . . . . . . . 71

6.3.2 Option B . . . . . . . . . . . . . . . . . . . . . 72

6.3.3 Option C . . . . . . . . . . . . . . . . . . . . . 73

6.3.4 Option D . . . . . . . . . . . . . . . . . . . . . 73

6.4 Discussion . . . . . . . . . . . . . . . . . . . . . . . . . 74

References

77

A Army Supplement

A-1

B Navy Supplement C Air Force Supplement D Marine Corps Supplement E AFQT `97 to `80 Transformation F Composite Transformation Tables

Contents iii B-1 C-1 D-1 E-1 F-1

iv Contents

List of Tables

1.1 CAT-ASVAB Composition . . . . . . . . . . . . . . . . 5 2.1 Subtest Statistics for PAY80 and PAY97 Samples . . . 8 2.2 AFQT Distributions for PAY80 and PAY97 Samples . 9 2.3 PAY97 Sample Moments (Form 04D) . . . . . . . . . . 10 2.4 Form 04D Standard Score Transformation Parameters 11 2.5 `97 AFQT Percentile Conversion . . . . . . . . . . . . 14 2.5 `97 AFQT Percentile Conversion (continued) . . . . . 15 2.6 Moments of Unstandardized Marine Corps Composite

Distributions . . . . . . . . . . . . . . . . . . . . . . . 18 2.7 Army Composite Weights (`97 Metric) . . . . . . . . . 20 3.1 Data Sources and Sample Sizes for Form Equating . . 26 3.2 IOT&E Sample Subtest Moments . . . . . . . . . . . . 27 3.3 Form 03D Standard Score Transformation Parameters 28 3.4 CY2001 Sample Subtest Moments (Forms 01D and 03D) 29 3.5 Form 01D Standard Score Transformation Parameters 29 3.6 CY2001 Sample Subtest Moments (Forms 02D and 03D) 31 3.7 Form 02D Standard Score Transformation Parameters 31 3.8 Anchoring Study Sample Subtest Moments . . . . . . 33 3.9 Form 25B Standard Score Transformation Parameters 33

vi LIST OF TABLES

3.10 RMSD Indices Between Form Composite Distributions. 37

4.1 Sample Sizes of Regular CY2002 Cohort . . . . . . . . 40 4.2 Reserve and Guard CY2002 Sample Sizes . . . . . . . 41 4.3 Regular CY2002 AFQT Qualification Percentages (Un-

adjusted Cut Scores) . . . . . . . . . . . . . . . . . . . 42 4.4 Reserve CY2002 AFQT Qualification Percentages (Un-

adjusted Cut Scores) . . . . . . . . . . . . . . . . . . . 43 4.5 Guard CY2002 AFQT Qualification Percentages (Un-

adjusted Cut Scores) . . . . . . . . . . . . . . . . . . . 43 4.6 AFQT Distributions for 1980 and 1997 Scales . . . . . 45 4.6 AFQT Distributions for 1980 and 1997 Scales (con-

tinued) . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 4.6 AFQT Distributions for 1980 and 1997 Scales (con-

tinued) . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 4.7 Regular CY2002 AFQT Qualification Percentages (Ad-

justed Cut Scores) . . . . . . . . . . . . . . . . . . . . 48 4.8 Reserve CY2002 AFQT Qualification Percentages (Ad-

justed Cut Scores) . . . . . . . . . . . . . . . . . . . . 48 4.9 Guard CY2002 AFQT Qualification Percentages (Ad-

justed Cut Scores) . . . . . . . . . . . . . . . . . . . . 49 4.10 Distribution of High-Quality Regular Applicants Across

Alternative Score Scales . . . . . . . . . . . . . . . . . 50 4.11 Distribution of High-Quality Reserve Applicants Across

Alternative Score Scales . . . . . . . . . . . . . . . . . 51 4.12 Distribution of High-Quality Guard Applicants Across

Alternative Score Scales . . . . . . . . . . . . . . . . . 52 4.13 Subgroup Qualification Rates (All Services) . . . . . . 54 4.14 Subgroup Qualification Distributions (All Services) . . 57 4.15 Gender Qualification Rates (All Services) . . . . . . . 58 4.16 Gender Qualification Distributions (All Services) . . . 59 4.17 Equated AFQT Category Boundaries . . . . . . . . . . 61

5.1 Integer-Weighted Service Classification Composite Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . 64

5.2 Composite Moments (`80 and `97 Scales) . . . . . . . . 66

6.1 AFQT Reporting, Standards, and Quality-Goal Options 69 6.2 Implementation Option Impact . . . . . . . . . . . . . 71

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download