Rubric Design
Articulating Your Assessment Values
Reading, commenting on, and then assigning a grade to a piece of student writing requires intense attention and difficult judgment calls. Some faculty dread “the stack.” Students may share the faculty’s dim view of writing assessment, perceiving it as highly subjective. They wonder why one faculty member values evidence and correctness before all else, while another seeks a vaguely defined originality.
Writing rubrics can help address the concerns of both faculty and students by making writing assessment more efficient, consistent, and public. Whether it is called a grading rubric, a grading sheet, or a scoring guide, a writing assignment rubric lists criteria by which the writing is graded.
Why create a writing rubric?
- It makes your tacit rhetorical knowledge explicit
- It articulates community- and discipline-specific standards of excellence
- It links the grade you give the assignment to the criteria
- It can make your grading more efficient, consistent, and fair as you can read and comment with your criteria in mind
- It can help you reverse engineer your course: once you have the rubrics created, you can align your readings, activities, and lectures with the rubrics to set your students up for success
- It can help your students produce writing that you look forward to reading
How to create a writing rubric
Create a rubric at the same time you create the assignment. It will help you explain to the students what your goals are for the assignment.
- Consider your purpose: do you need a rubric that addresses the standards for all the writing in the course? Or do you need to address the writing requirements and standards for just one assignment? Task-specific rubrics are written to help teachers assess individual assignments or genres, whereas generic rubrics are written to help teachers assess multiple assignments.
- Begin by listing the important qualities of the writing that will be produced in response to a particular assignment. It may be helpful to have several examples of excellent versions of the assignment in front of you: what writing elements do they all have in common? Among other things, these may include features of the argument, such as a main claim or thesis; use and presentation of sources, including visuals; and formatting guidelines such as the requirement of a works cited.
- Then consider how the criteria will be weighted in grading. Perhaps all criteria are equally important, or perhaps there are two or three that all students must achieve to earn a passing grade. Decide what best fits the class and requirements of the assignment.
Consider involving students in Steps 2 and 3. A class session devoted to developing a rubric can provoke many important discussions about the ways the features of the language serve the purpose of the writing. And when students themselves work to describe the writing they are expected to produce, they are more likely to achieve it.
At this point, you will need to decide if you want to create a holistic or an analytic rubric. There is much debate about these two approaches to assessment.
Comparing Holistic and Analytic Rubrics
Holistic Scoring
Holistic scoring aims to rate overall proficiency in a given student writing sample. It is often used in large-scale writing program assessment and impromptu classroom writing for diagnostic purposes.
General tenets to holistic scoring:
- Responding to drafts is part of evaluation
- Responses do not focus on grammar and mechanics during drafting and there is little correction
- Marginal comments are kept to 2-3 per page with summative comments at end
- End commentary attends to students’ overall performance across learning objectives as articulated in the assignment
- Response language aims to foster students’ self-assessment
Holistic rubrics emphasize what students do well and generally increase efficiency; they may also be more valid because scoring includes authentic, personal reaction of the reader. But holistic sores won’t tell a student how they’ve progressed relative to previous assignments and may be rater-dependent, reducing reliability. (For a summary of advantages and disadvantages of holistic scoring, see Becker, 2011, p. 116.)
Here is an example of a partial holistic rubric:
Summary meets all the criteria. The writer understands the article thoroughly. The main points in the article appear in the summary with all main points proportionately developed. The summary should be as comprehensive as possible and should be as comprehensive as possible and should read smoothly, with appropriate transitions between ideas. Sentences should be clear, without vagueness or ambiguity and without grammatical or mechanical errors.
A complete holistic rubric for a research paper (authored by Jonah Willihnganz) can be downloaded here.
Analytic Scoring
Analytic scoring makes explicit the contribution to the final grade of each element of writing. For example, an instructor may choose to give 30 points for an essay whose ideas are sufficiently complex, that marshals good reasons in support of a thesis, and whose argument is logical; and 20 points for well-constructed sentences and careful copy editing.
General tenets to analytic scoring:
- Reflect emphases in your teaching and communicate the learning goals for the course
- Emphasize student performance across criterion, which are established as central to the assignment in advance, usually on an assignment sheet
- Typically take a quantitative approach, providing a scaled set of points for each criterion
- Make the analytic framework available to students before they write
Advantages of an analytic rubric include ease of training raters and improved reliability. Meanwhile, writers often can more easily diagnose the strengths and weaknesses of their work. But analytic rubrics can be time-consuming to produce, and raters may judge the writing holistically anyway. Moreover, many readers believe that writing traits cannot be separated. (For a summary of the advantages and disadvantages of analytic scoring, see Becker, 2011, p. 115.)
For example, a partial analytic rubric for a single trait, “addresses a significant issue”:
- Excellent: Elegantly establishes the current problem, why it matters, to whom
- Above Average: Identifies the problem; explains why it matters and to whom
- Competent: Describes topic but relevance unclear or cursory
- Developing: Unclear issue and relevance
A complete analytic rubric for a research paper can be downloaded here. In WIM courses, this language should be revised to name specific disciplinary conventions.
Conclusion
Whichever type of rubric you write, your goal is to avoid pushing students into prescriptive formulas and limiting thinking (e.g., “each paragraph has five sentences”). By carefully describing the writing you want to read, you give students a clear target, and, as Ed White puts it, “describe the ongoing work of the class” (75).
Writing rubrics contribute meaningfully to the teaching of writing. Think of them as a coaching aide. In class and in conferences, you can use the language of the rubric to help you move past generic statements about what makes good writing good to statements about what constitutes success on the assignment and in the genre or discourse community. The rubric articulates what you are asking students to produce on the page; once that work is accomplished, you can turn your attention to explaining how students can achieve it.
Works Cited
Becker, Anthony. “Examining Rubrics Used to Measure Writing Performance in U.S. Intensive English Programs.” The CATESOL Journal 22.1 (2010/2011):113-30. Web.
White, Edward M. Teaching and Assessing Writing. Proquest Info and Learning, 1985. Print.
Further Resources
Huot, Brian. (Re)Articulating Writing Assessment for Teaching and Learning. Logan: Utah State UP, 2002. Print.
Kelly-Reilly, Diane, and Peggy O’Neil, eds. Journal of Writing Assessment. Web.
O’Neill, Peggy, Cindy Moore, and Brian Huot. A Guide to College Writing Assessment. Logan: Utah State UP, 2009. Print.
Sommers, Nancy. Responding to Student Writers. Macmillan Higher Education, 2013.
White, Edward M., and Cassie A. Wright. Assigning, Responding, Evaluating: A Writing Teacher’s Guide. 5th ed. Bedford/St. Martin’s, 2015. Print.