1EDMS 769A Test Equating, Scaling, and Linking Spring 2007 Room 2228 Tawes Building Instructor: Amy B. Hendrickson, Ph.D. Office: 1230B Benjamin Phone: (301) 405-3627 E-mail: [email protected] Office Hours: By appointment The prerequisites for the course are EDMS 646 – Quantitative Research Methods II and EDMS 623 - Applied Measurement: Issues and Practices. Course Objectives Standardized educational tests typically report scores on various score scales. Equating methods are used to adjust test scores such that examinees are neither advantaged or disadvantaged for taking a relatively easy or difficult test form. Linking procedures are sometimes used to relate scores on different tests. The purposes of this course are to enable students to conduct equating, to construct score scales, to conduct linking studies, and to appreciate a number of practical issues with equating, score scales, and linking educational tests. The objectives for this course include gaining a conceptual understanding of the purposes of equating and the context in which it is conducted as well as the fundamental concepts of constructing score scales. To understand the distinction between scaling, equating, and linking. To identify appropriate and inappropriate uses and interpretations of equating, scaling, and linking results. To conduct equating, scaling, and linking by hand and with computer programs, in realistic testing situations. Course Materials Required Text: Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and practices. 2nd Edition. New York: Springer-Verlag Class notes are available as a Course Pack at the University Book Store Required supplemental articles and chapters are listed later in the syllabus. The readings can be found on 3 hour reserve in the basement of the Benjamin building. Statistical Software Several computer programs will be used in this course. These programs, and the data sets used in the text, are listed in Appendix B of Kolen and Brennan (2004). The programs can be downloaded from the website http://www.education.uiowa.edu/casma/computer_programs.htm2TOPIC SOURCE 1. Introduction and Concepts K & B Chapter 1 Angoff (1971) p 562-568 P, K, & H (1989) p 241-247 2. Randomly Equivalent Groups Equating K & B Chapter 2, p 28-66 Angoff (1971) p 569-571 P, K, & H (1989) p 247-249, 251-252 Braun & Holland (1982) p 9-18 3. Smoothing in Equipercentile Equating w/ Equivalent Groups K & B Chapter 3 P, K, & H (1989) p 249-250 4. Linear Equating with Nonequivalent Groups K & B Chapter 4 Angoff (1971) p 579-582 P, K, & H (1989) p 252-254 5. Equipercentile Equating with Nonequivalent Groups K & B Chapter 5 Angoff (1971) p 581-582 Braun & Holland p 21-31 P, K, & H (1989) p 250 6. IRT Equating Methods K & B Chapter 6 Cook & Eignor (1991) P, K, & H (1989) p 255-258 7. Standard Errors of Equating K & B Chapter 7 Angoff (1971) p 569-582 Braun & Holland p 32-39 P, K, & H (1989) p 251, 255 8. Practical and Applied Issues K & B Chapter 8 9. Score Scales for Tests and Batteries K & B Chapter 9 and Vertical Scaling Kolen, Zeng, and Hanson (1996) Brennan & Kolen (1989) Kolen and Hanson (1989) P, K, & H (1989) p 221-236 K, H, & B (1992) Angoff (1971) p 508-533 10. Score Comparability and Linking K & B Chapter 10 Kolen (1999) Kolen (2001) Feuer et al. (1999) Linn (1993) Mislevy (1992) Segall (1997) Green (1995)3Sources in bold are the primary readings, the others are secondary. Students are responsible for reading assignments prior to lectures. Coverage dates are not given due to the fact that topic presentation time varies from semester to semester. However, topics will be covered in the order given above. There will be NO CLASS on April 11th as I will be out of town at the AERA conference . Class sessions involve lecture, discussion, and student presentations. Lectures and discussion can include computer demonstrations. Each student is expected to attend class, to participate in class, to do assigned readings, to do homework assignments, to complete a Midterm and a Final Exam, to complete a project, and to present the project. Assessments Homework: Homework exercises will be distributed occasionally and sometimes collected for grading purposes. Also, you are encouraged to complete the questions at the end of the book chapters. Exams: There will be a midterm administered probably on March 14th and a final administered probably on May 16th; both consisting of conceptual and calculation problems. Project: The project for this course should involve equating, scaling or linking and some data analysis. The major purpose of this project is to give you the chance to apply equating, scaling, and linking procedures with real data. However, some students may want to conduct original research involving data analysis. You are encouraged to use your own data. However, data can be provided, if necessary. Please discuss your project ideas with the instructor before you proceed. You should have decided on a project topic by the end of March. The project should be written-up in APA-style and each student may present their project to the class on May 9th. Please prepare a handout for each member of the class. Course Grades Homework and exams will be combined according to the percentages shown on the left. Final grades will then be assigned based on the scale to the right. Homework and computer exercises 10% 92.0000 % - 100% A Midterm 30% 90.0000 % - 91.9999 % A- Final Exam 30% 88.0000 % - 89.9999 % B+ Project 30% 82.0000 % - 87.9999 % B 80.0000 % - 81.9999 % B- 78.0000 % - 79.9999 % C+ 72.0000 % - 77.9999 % C 70.0000 % - 71.9999 % C- 65.0000 % - 69.9999 % D+ 60.0000 % - 64.9999 % D 55.0000 % - 59.9999 % D- 9999.54≤ % F4Grades will not be changed unless a computational error has been made. No grades will be dropped. Incompletes Grades of “Incomplete” will not be given unless the student can demonstrate that near catastrophic events have led to a case of extreme hardship. Note that the last day to officially drop this course is April 10th. Accommodations Students with a documented disability who have need for reasonable academic accommodation should contact the instructor by February 14th to discuss your needs. Students