New NEPC Review: Manhattan Institute Website Grades Schools Based on Mirage of Poorly Linked Computations
Boulder, CO (PRWEB) March 10, 2016 -- The Manhattan Institute for Policy Research released in the fall of 2015 a website, SchoolGrades.org, which claims to use an international standard of excellence to grade how well America’s schools prepare students in core subjects. Grading projects of this sort are only as useful as the transparency and merits of the underlying data and calculations. In this case, an NEPC review finds the site to be rife with technical and logical shortcomings.
Jaime L. Del Razo, a Principal Associate at the Annenberg Institute for School Reform at Brown University and Adjunct Assistant Professor at Brown University’s Department of Education, reviewed the website SchoolGrades.org for the Think Twice Think Tank Review Project at the National Education Policy Center, housed at the University of Colorado Boulder’s School of Education.
SchoolGrades.org evaluates and assigns grades, using reading and math test scores, to U.S. schools, comparing schools across their respective states and to other countries. The site’s creators never fully explain their approach, but it apparently uses a four-step process: (1) average two state test scores; (2) “norm” these results to the NAEP exam; (3) make an adjustment to this nationally normed measure using free and reduced price lunch data to account at least partially for differences in socioeconomic status; and (4) “norm” these results to the international PISA exam.
The website alleges that this process allows a parent to compare a local school to schools in other countries, yet the unsubstantiated norming chain is too tenuous and the results are overly extrapolated to be of any useful value. It fails to explain how international scores are equated to the national standard they developed, how letter grades were determined, and how free and reduced price lunch counts were used to make socioeconomic adjustments. The challenge facing the creators of this project was to equate scores on the various tests, yet none of the field’s abundant equating research is even cited.
Professor Del Razo concludes that the website’s reliance on aggregated test scores is far too narrow a base to serve as a useful evaluation of schools. He also points out that it perpetuates the misuse of testing as the best way to assess a school’s worth despite ample research to the contrary. Thus, its approach to evaluating schools fails on technical grounds and, just as importantly, it fails to understand and consider the broader purposes of education in a democratic society.
Find Professor Del Razo’s review at:
http://nepc.colorado.edu/thinktank/review-school-grades
Find SchoolGrades.org, with researchers Jacob L. Vigdor and Josh B. McGee, a product of the Manhattan Institute for Policy Research, at:
http://schoolgrades.org
The National Education Policy Center (NEPC) Think Twice Think Tank Review Project (http://thinktankreview.org) provides the public, policymakers, and the press with timely, academically sound reviews of selected publications. The project is made possible in part by support provided by the Great Lakes Center for Education Research and Practice: http://www.greatlakescenter.org/
The National Education Policy Center (NEPC), housed at the University of Colorado Boulder School of Education, produces and disseminates high-quality, peer-reviewed research to inform education policy discussions. Visit us at: http://nepc.colorado.edu/
Find Documents:
Press release: http://tinyurl.com/grrj7b2
Review: http://nepc.colorado.edu/thinktank/review-school-grades
William J. Mathis, National Education Policy Center, http://nepc.colorado.edu, +1 (802) 383-0058, [email protected]
Share this article