• Home
  • Search
  • Assignment And Quality Control Of Peer Reviewers
  • Cite Icon8
  • https://doi.org/10.18260/1-2--8941Copy DOI Icon

Assignment And Quality Control Of Peer Reviewers

  • Sep 3, 2020
  • Edward Gehringer
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Abstract NOTE: The first page of text has been automatically extracted and included below in lieu of an abstract Session 3230 Assignment and Quality Control of Peer Reviewers Edward F. Gehringer North Carolina State University efg@ncsu.edu Abstract Much work has been performed on assessing the validity and usefulness of peer assessment in the classroom. Much less effort has been invested in enumerating and classifying strategies for assigning reviewers, encouraging good feedback, and preventing clustering of grades. This study reviews the different approaches that have been taken to those problems. Several of these strategies are employed in PG, our Web-based application for peer review and peer grading. Usually, students are assigned randomly to review other students’ work. Often, students work in teams, with each member of the team reviewing the other members. Or, students or teams may choose from a list of topics to work on. In this case, it is helpful to assign students to review others who have chosen the same topic. To encourage students to provide adequate feedback to their reviewees, several approaches can be taken. Students can be denied credit for the assignment unless they do the required reviews. Or, they can be prevented from seeing feedback on their work until they provide feedback to others. Multiple review periods may be employed, with students required to give some feedback in each period. A formula may be devised to allow reviewers to share in good grades received by their reviewees. Or students may be assigned to review each other’s reviews. To improve the accuracy of grading, students can be required to pass a pre-certification test before being allowed to serve as peer graders. The instructor can supply a set of grading criteria, and discuss it with the students, either in advance or after the students complete their first round of review. Reviewer mappings can be constrained to assure that each student will review one paper from each quartile (etc.) of the class. 1. Introduction Peer review in the classroom is a technique that is becoming increasingly popular, with over 100 papers published on the topic in the past ten years. Much work has been performed on assessing usefulness of the technique (students generally like it, and learn well from it) and its validity (students do in general rate better work more highly, though some effort needs to be invested in the assessment procedure to assure this). However, very few published reports discuss appropriate strategies for matching reviewers with reviewees, how students can be induced to give good feedback, or how student-assigned grades can be prevented from clustering closely around the mean. These topics are the focus of this review paper. 2. Strategies for assigning reviewers In his 1998 survey paper [Topp 98], Topping says, “How peer assessors and assessees should best be matched ... is discussed surprisingly little in the literature.” In most cases, he says, a Proceedings of the 2001 American Society for Engineering Education Annual Conference & Exposition Copyright  2001, American Society for Engineering Education

Similar Papers
  • Conference Article
  • Citations19

Assessment Of Lab Work: A Three Domain Model; Cognitive, Affective, And Psychomotor

  • Sep 03, 2020
  • A R Zaghloul
  • Conference Article
  • Citations5

Engineering Design As A Learning Process

  • Sep 03, 2020
  • Jerald Vogel +1
  • Conference Article
  • Citations4

Longitudinal Study Of Learning Communities In Agricultural And Biosystems Engineering

  • Sep 03, 2020
  • Steven Mickelson
  • Conference Article

The Effect Of The Texas A&M University System Amp On The Success Of Minority Undergraduates In Engineering: A Multiple Outcome Analysis

  • Sep 03, 2020
  • Rita Caso +2
  • Conference Article

Teaching Vs. Research: Perspectives From A Fourth Year Assistant Professor

  • Sep 03, 2020
  • Jason Keith
  • Conference Article
  • Citations38

Assessing Readiness For Self Directed Learning

  • Sep 03, 2020
  • Sang Ha Lee +3
  • Conference Article
  • Citations2

Lab@Home: An Internet Based Real Laboratory For Distance Control Education

  • Sep 03, 2020
  • Nariman Sepehri
  • Research Article

Teacher education for instrumentation — A report from the ASEE

  • Apr 01, 1966
  • IEEE Transactions on Industrial Electronics and Control Instrumentation
  • J E Casey
  • Front Matter
  • Citations9

Peer Review: The Best of the Blemished?

  • Mar 29, 2007
  • The American Journal of Medicine
  • Joseph S Alpert
  • Conference Article

A pilot study: Documenting engineering school systems that support high student retention

  • Oct 01, 2013
  • Brian L Yoder
  • Conference Article

ASEE TELPhE Division as a Community of Transformation

  • Oct 01, 2018
  • Mani Mina +1
  • Research Article

American Society for Engineering Education -Transforming Engineering Education

  • Jan 01, 2008
  • Journal of JSEE
  • Sarah A Rajala
  • Research Article
  • Citations2

Naming peer reviewers in JRSM

  • Oct 01, 2009
  • Journal of the Royal Society of Medicine
  • Kamran Abbasi
  • Research Article

Critical Mutuality in Engineering Education: A Report on the Liberal Education/Engineering & Society Division Annual Meeting from the American Society for Engineering Education, Montreal, June 22–25, 2025

  • Apr 21, 2026
  • Engineering Studies
  • Kari Zacharias +2
  • Single Report
  • Citations1

American Society for Engineering Education 1994 Navy-ASEE Summer Faculty Research Program. Navy-ASEE Sabbatical Leave Program, 1994.

  • Jan 01, 1995
  • W T Cluverius
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.