METHODS TESTS(U) ASSESSMENT SYSTEMS K …

ID-A149 544 UNCLASSIFIED

METHODS FOR 'EQUATING MENTAL TESTS(U) ASSESSMENT SYSTEMS 1/2

CORP ST PAUL MN K A GIRLLUCA ET AL. NOV 84

AFHRL-TR-84-35 F4i689-82-C-0023

F/G 5/10

N

Immmmmmmmm

IImEIEIEIIEIIEIIIIIIIIIIIIIIIIIIIIIIIIIhIIIlIIhIII EEllhEElIIhhIhE

11111_ 12.512

j.6

.1 . 40

*

MICROCOPY RESOLUTION TESTCHART

NATIONALBUREAU Of STANDARDS1-963-A

-I%

AFHRL-TR-84-35

AIR FORCE 0,

H

U

AC.

N

METHODS FOR EQUATING MENTAL TESTS

By

Kathleen A. Gialluca Leslie I. Crichton David Vale

Assessment Systems Corporation 2233 University Avenue, Suite 310

St. Paul, Minnesota 55114

4-

Malcolm James Ree

t.

R MANPOWER AND PERSONNEL DIVISION

,,,,~Brooks Air Force Base, Texas 78235-5000

Interim Report for Period March 1982 -October 1984

ntApprofovredpublc release; d 1str cbuuntlimonted.

E S

LABORATORY

~~~~~~~~~..... -..

---.

.. . -- ...............

%-.--

AIR FORCE SYSTEMS COMMAND

BROOKS AIR FORCE BASE, TEXAS 78235-5000

85 01 02 C23

.......

......... ' .'.,.''..2,

-'..%', ....

J-%.

N,

'% * ,

". ' . .. %-, ,.

**...

*" '""

Lr-r

NOTICE

When Government drawings, specifications, or other data are used for any

purpose other than in connection with a definitely Government-related

procurement, the United States Government incurs no responsibility or any

obligation whatsoever. The fact that the Government may have formulated or

in any way supplied the said drawings, specifications, or other data, is

not to be regarded by implication, or otherwise in any manner construed, as

licensing the holder, or any other person or corporation; or as conveying

any rights or permission to manufacture, use, or sell any patented

invention that may in any way be related thereto.

I,

The Public Affairs Office has reviewed this report, and it is releasable to the National Technical Information Service, where it will be available to the general public, including foreign nationals.

This report has been reviewed and is approved for publication.

NANCY GUINN, Technical Director Manpower and Personnel Division

ANTHONY F. BRONZO, JR., Colonel, USAF Commander

*:.

..

o,.

>. .

.. **

.

.:-:.

r- r r

. - .r

_.: . . .

..

.

. _ .. . .. T - _.

?

. . .. -

- : _ o . ;.

Unclassified

SECURITY CLASSIFICATION OF THIS PAGE

REPORT DOCUMENTATION PAGE

'a, REPORT SECURITY CLASSIFICATION

Unclassified

2a. SECURITY CLASSIFICATION AUTHORITY 2b. DECLASSIFICATION /DOWNGRADING SCHEDULE

lb. RESTRICTIVE MARKINGS

3 DISTRIBUTION /AVAILABILITY OF REPORT

Approved for public release; distribution unlimited.

p

4, PERFORMING ORGANIZATION REPORT NUMBER(S)

S. MONITORING ORGANIZATION REPORT NUMBER(S) AFHRL-TR-84-35

6a. NAME OF PERFORMING ORGANIZATION

6b. OFFICE SYMBOL 7a. NAME OF MONITORING ORGANIZATION

Assessment Systems Corp.

(ifapplicable)

Manpower and Personnel Division

S

6c, ADDRESS (City, State, and ZIP Code) 2233 University Avenue, Suite 310 St Paul, Minnesota 55414

7b. ADDRESS (City, State, and ZIP Code) Air Force Human Resources Laboratory Brooks Air Force Base, Texas 78235-5000

Ba. fIAME OF FUNDING/SPONSORING ORGANIZATION

Air Force Human Resources Laboratory

8b. OFFICE SYMBOL (If applicable)

HQ AFHRL

8c. ADDRESS (City; State, and ZIP Code)

Brooks Air Force Base, Texas 78235-5000

t l TITLE (Include Security Classification) Methods for Equating Mental Tests

9. PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER F41689-82-C-0023

10 SOURCE OF FUNDING NUMBERS

PROGRAM

I PROJECT

ELEMENT NO NO

TASK

NO.

62703F

7719

18

WORK UNIT

ACCESSION NO.

28

12 PERSONAL AUTHOR(S)

Glalluca, Kathleen A.; Crichton, Leslie I.; Vale. C. David; Ree, Malcolm J.

13a. TYPE OF REPORT Interim

13b. TIME COVERED

14 DATE OF REPORT (Year, Month, Day)

FROM Mar 82 TO Oct 84

November 1984

16 SUPPLEMENTARY NOTATION

IS PAGE COUNT 164

17.

COSATI CODES

18. SUBJECT TERMS (Continue on reverse if necessary and identify by block number)

FIELD

GROUP

SUB-GROUP

ASVAB

strong true score theory

05

09

equating

tests and measurement

item response theory

19 ABSTRACT (Continue on reverse if necessary and identify by block number)

The technology for test equating has arisen from the need to make new tests comparable to old ones. The equating of military tests has two objectives: (a) to make scores on different tests forms and on different composites of test forms comparable, and at the same time (b) to solve the norming problem by relating all scores on new tests and composites back to a large sample of talent indicative of an anticipated population of military enlistees. In this study, simulated and actual Air Force test data were used to compare the different procedures for equating mental tests and to delineate those conditions under which each equating procedure performed best. Specific testing-condition manipulations included variations in test length, item difficulty, sample size, and examinee ability distributions. Coventional (equipercentile and linear), Item Response Theory (IRT), and Strong True Score Theory (STST) methods comprised the equating procedures that were studied. The data collection designs that were used included the single-group, equivalent-groups, and anchor-test designs. Equating transformations were evaluated by comparing equated scores with true scores using bias and root-mean-squared-error indices.

20. DISTRIBUTION /AVAILABILITY OF ABSTRACT

21. ABSTRACT SECURITY CLASSIFICATION

MXIUNCLASSIFIEDIUNLIMITED 0 SAME AS RPT. 0 OTIC USERS

Unclassified

22a. NAME OF RESPONSIBLE INDIVIDUAL Nancy A. Perrigo

22b. TELEPHONE (Include Area Code) 22c. OFFICE SYMBOL

Chief. STINFO Office

(512) 536-3877

AFHRL/TSR

O FORM 1473,e4 MAR

63 APR edition may be used until exhausted.

SECURITY CLASSIFICATION OF THIS PAGE

All other editions are obsolete.

Unclassified

-.....................................

... . ... .. . . . . .

. . . . . .. . . .. . . . . . . .. . . . . . . . . . . . . . . . . . .

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download