A complete description of the literature search, including the criteria used for the inclusion of reports after they have been located, used in a research synthesis or meta-analysis is critical if subsequent researchers are to accurately evaluate and reproduce a synthesis' methods and results. Based on previous guidelines and new suggestions, we present a set of focused and detailed standards for reporting the methods used in a literature search. The guidelines cover five search strategies: reference database searches, journal and bibliography searches, searches of the reference lists of reports, citation searches, and direct contact searches. First, we bring together all the unique recommendations made in existing guidelines for research synthesis. Second, we identify gaps in reporting standards for search strategies. Third, we address these gaps by providing new reporting recommendations. Our hope is to facilitate successful evaluation and replication of research synthesis results.

The "assessment for learning" movement in education has increased attention to self-grading and peer-grading practices in primary and secondary schools. This research synthesis examined several questions pertaining to the use of self-grading and peer-grading in conjunction with criterion-referenced testing in 3rd-through 12th-grade-level classrooms. We investigated (a) the effects of students' participation in grading on subsequent test performance, (b) the difference between grades when assigned by students or teachers, and (c) the correlation between grades assigned by students and teachers. Students who engaged in self-grading performed better (g ϭ .34) on subsequent tests than did students who did not. Moderator analyses suggested that the benefits of self-grading were estimated to be greater when the study controlled for group differences through random assignment. Students who engaged in peergrading performed better on subsequent tests than did students who did not (g ϭ .29). On average, students did not grade themselves or peers significantly differently than teachers (self-grades, g ϭ .04; peer-grades, g ϭ .04) and showed moderate correlation (self-grading, r ϭ .67; peer-grading, r ϭ .68) with teacher grades. Further, other moderator analyses and examination of studies suggested that self-and peer-grading practices can be implemented to positive effect in primary and secondary schools with the use of rubrics and training for students in a formative assessment environment. However, because of a limited number of studies, these mediating variables need more research to allow more conclusive findings.

No abstract

With the increase in large college classes and online education, student grading of their own work and that of peers is also increasing in frequency. This meta-analysis of 36 studies and 103 effect sizes examined several questions regarding the relationship between grades assigned by college students (either to themselves or peers) and those assigned by their instructors on the same assessment. On average, students graded themselves .41 standard deviations higher than their instructors. The grade distribution correlation between the two types of graders averaged r=.71. Inter-judge reliability estimates suggested that a range of 2-4 peer-graders are needed in order to attain the same level of reliability achieved by the instructor. Little research was found on the effect of student grading on subsequent student performance. Moderator analyses revealed that differences between graders appeared to be minimized when (a) students are grading a peer’s work rather then their own, (b) they are in their freshman versus sophomore, junior or senior year, (c) some form of training is given, (d) assessment has lower stakes, (e) more objective tests are given, and (f) course content is English, social science, or professional versus science or engineering. These results have implications for what contexts best facilitate the use of students as graders, and bring to light areas where future research is needed.