The development process may include the following activities:
Test objectives define the content of each test and are prepared for fields under
development. The objectives are broad statements of knowledge and skills that are
important for performing the job of an educator in Pennsylvania public schools.
The objectives are based on the relevant Pennsylvania Program Framework Guidelines,
national standards, and other Pennsylvania source materials. Test questions ("test
items") are prepared based on the objectives. At a Test Development Review Conference,
draft objectives, test questions, and other test materials are reviewed by committees
of Pennsylvania public school educators and educator preparation faculty. The Test
Development Review Conference is typically a two- to three-day meeting.
A content validation survey is conducted to gather additional information regarding the importance of the knowledge or skills described by the test objectives for performing the job of an educator in Pennsylvania public schools. Public school educators throughout Pennsylvania and faculty in educator preparation programs are asked to participate in the survey.
Test questions are field tested to gather information about the performance of the test questions. The field tests provide educator candidates and those interested in entering an educator preparation program with valuable practice in taking the Pennsylvania Educator Certification Tests and the opportunity to gain insight into the knowledge and skills being assessed by the new tests.
Field-test takers answer constructed-response assignments by composing responses
that will be holistically scored. Content Advisory Committee members will convene
to review field-test responses and to select responses that will serve as "score-point
markers" used to orient scorers during the operational holistic scoring sessions.
The Marker Response Selection Meeting is typically a one-day meeting.
This meeting will occur close to the first administration of the test. At this meeting, educators participate in a process for recommending a scaled score for the test to the Bureau of School Leadership and Teacher Quality. The Standard Setting Conference is typically a one- or two-day meeting.
Educators will convene to review draft test materials, including test objectives and test items, for bias prevention and the inclusion of diversity in test materials. This is typically a one- or two-day meeting held before each test development conference.
Top of Page