Use an independent evaluator to conduct an evaluation of the project. In determining the quality of the project evaluation to be conducted, the following factors will be considered:
- The adequacy of the planned experimental and/or quasi-experimental study
- The degree to which the plan will yield high-quality implementation data and performance feedback
- Whether the project permits periodic assessment of progress toward achieving intended outcomes
- The extent to which the evaluation will provide sufficient information about the key elements and approach of the projects to facilitate replication or testing in other settings
Out of the total 100 points that could be assigned in the selection criteria, the quality of the project evaluation will account for:
- Scale-up grants: 20 points
- Validation grants: 25 points
- Development grants 20 points
CTB consultants have broad experience across testing programs, testing modes, and geographic regions. As an expert in educational measurement, assessment design, and project evaluation, CTB's goal is to facilitate sound policy-making by providing complete, accurate, and unbiased data regarding the scientific implications associated with project effectiveness.
Through the organization's own research and development work, as well as through collaborative research relationships with testing experts throughout the world, CTB has contributed many innovations to the field of testing. Examples include: 1) the first operational implementation of item response theory methods, 2) the detection of bias in test items, and 3) the widely used Bookmark Standard Setting Procedure™.
Since its beginnings in 1926, CTB customers have drawn on many years of experience in K–12 educational measurement and the organization's extensive knowledge related to the design and outcomes of many of the nation's testing programs. CTB custom-designed research studies and technical reports quantify project processes and methodologies and document adherence to the highest psychometric standards. Over half of the first states to pass Peer Review by the U.S. Department of Education worked with CTB in the design and evaluation of their state accountability assessment.
CTB is also a leader in providing consultation and expertise regarding implementation of growth models in assessment programs. The organization's research scientists have worked with a number of states, such as Indiana, Georgia, West Virginia, and Colorado, to assist them in measuring and evaluating student academic growth.
CTB builds its benchmark and interim assessments on solid test development principles, the highest psychometric standards, and leading edge technologies including automated test assembly, secure platforms, speech recognition, and artificial intelligence methods.
Secure matching funds or in-kind donations that account for a percentage of the grant award:
- Scale-up: 5 percent
- Validation: 10 percent
- Development: 15 percent
The matching funds, or in-kind donations, must come from the private, non-governmental sources. CTB/McGraw-Hill qualifies as a matching funds source.