The development process may include the following activities:
Test objectives that define the content of each test are prepared for fields under development. The objectives are broad statements of knowledge and skills that are important for performing the job of an educator in California's public school system. The draft objectives are based on sources including California and national standards for each field. Each set of draft test objectives is reviewed and approved by a committee of California educators and candidate preparation faculty. The Objective Review Conference can be a one-to-two-day meeting.
The purpose of the content validation survey is to ensure that the objectives identified for each field represent important aspects of the subject area and are relevant to the job of the educator as authorized by the credential. Practicing educators throughout California and faculty of preparation programs throughout California are asked to participate in this online survey.
Test items ("test questions") are prepared based on the validated objectives and other relevant materials obtained from the Commission on Teacher Credentialing (CTC). Each set of draft test items is reviewed and approved by a committee of California educators and candidate preparation faculty. The Item Review Conference can be a one-to-three-day meeting.
Test items are field tested to gather information about their quality and technical characteristics. The field test provides California educator candidates the opportunity to prepare for future tests and to comment on the test development process.
Committee members convene to review and approve exemplary responses to performance response assignments, such as an essay. These responses will serve as "score-point markers" for training scorers to accurately score test takers' responses. The Marker Response Selection Meeting is typically a one-to-three-day meeting.
A standard setting meeting typically occurs shortly after the first administration of a new test. At this meeting, educators participate in a process to provide the CTC with passing standard recommendations for the test. The CTC has the responsibility of making the final determination of the passing standard for each test. The Standard Setting Conference is typically a one-day meeting.
Educators convene to review draft test materials, including test objectives and test items, for bias prevention and the inclusion of diversity in test materials. These are typically one- or two-day meetings.
Top of Page