Validating holistic scoring for writing assessment
(Note: PDFs are available through NCTE, or JSTOR for issues prior to Volume 48."The Scoring of Writing Portfolios: Phase 2." CCC 56.4 (2005): 581-600.Analytic scoring examines multiple aspects of writing (e.g., content, structure, mechanics, etc.) and assigns a score for each.This type of evaluation generates several scores useful for guiding instruction.As a result, such people remain unaware of their incompetence and accordingly fail to take any self- improvement measures that might rid them of their incompetence. The study evaluated the reliability and validity of the Writing Assessment Measure (WAM), developed to reflect the skills which children of different abilities are expected to achieve in written expression, as part of the National Curriculum guidelines in England and Wales.Broadly defined, reliability is the consistency with which an instrument/method produces measurements, while validity is the extent to which an instrument/method actually measures what it is meant to measure, or its accuracy.
Raters give one summary score based on their impression of a text without trying to evaluate a specific set of skills.Direct instruction should focus on improving examples of weak writing. Rubric validation is a much-needed historical thinking exercise. The use of scoring rubrics: Reliability, validity and educational consequences. When they have to review more than one student’s writing, they establish a context for evaluating their own writing. A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Class discussions should identify exemplars of strong historical writing.