State VAMS don't reflect content, quality of teachers' instruction

May 13, 2014

New research published online today in Educational Evaluation and Policy Analysis (EEPA), a peer-reviewed journal of the American Educational Research Association, finds weak to nonexistent relationships between state-administered value-added model (VAM) measures of teacher performance and the content or quality of teachers' instruction. Based on their results, the authors question whether VAM data will be useful in evaluating teacher performance and shaping classroom instruction.

"Instructional Alignment as a Measure of Teaching Quality," by Morgan S. Polikoff at the University of Southern California and Andrew C. Porter at the University of Pennsylvania, also finds no association between multiple-measure teaching effectiveness ratings—which combine value-added measures with survey and observational ratings of teacher quality—and the content of ' instruction in the classroom.

"While value-added measures do provide some useful information, our findings show that they are not picking up the things we think of as being good teaching," said Polikoff. "Given the growing extent to which states are using these measures for a wide array of decisions, our findings are troubling."

Polikoff and Porter's study is the first large-scale analysis of the relationship of instructional alignment (i.e., the degree to which the content of is aligned with state standards and assessments, such as the Common Core standards) and teaching effectiveness with teacher VAM scores and a composite measure of teacher effectiveness.

The video will load shortly
Co-author Morgan S. Polikoff discusses key findings.

The authors investigated these relations based on a subsample of 327 fourth- and eighth-grade mathematics and English language arts teachers across all six school districts included in the Measures of Effective Teaching (MET) study, including New York City, Dallas, Denver, Charlotte-Mecklenburg, Memphis, and Hillsborough County, Florida.

"We expected to see that instruction aligned with state standards and assessments would strongly predict value-added performance measures on those assessments, but that wasn't the case," said Polikoff.

Recent policy initiatives such as the Race to the Top Fund and No Child Left Behind waivers have created a push to improve the methods by which teachers are evaluated. Many of these methods focus on teachers' contributions to student learning, often measured by value-added models and multiple-measure evaluation systems.

With the rollout of Common Core State Standards, according to Polikoff, the development of a deeper understanding of the ways effective teachers implement the standards in the classroom is imperative.

"Our results suggest that it's going to be difficult to use these systems to improve ," said Polikoff.

Their findings, the authors noted, lead to a disconcerting question: "If VAMs are not meaningfully associated with either the content or quality of instruction, what are they measuring?"

Explore further: New approach urged for 'abysmal' K-12 writing instruction

More information:

Related Stories

Researchers add insights for teacher evaluations

February 3, 2014

New research led by the University of Notre Dame's Center for Research on Educational Opportunity (CREO) points a way forward to improve certain teacher performance evaluation systems.

Recommended for you

Experts uncover hidden layers of Jesus' tomb site

October 27, 2016

In the innermost chamber of the site said to be the tomb of Jesus, a restoration team has peeled away a marble layer for the first time in centuries in an effort to reach what it believes is the original rock surface where ...

Important ancient papyrus seized from looters in Israel

October 27, 2016

(—Eitan Klein, a representative of the Israel Antiquities Authority, has announced that an important papyrus document dated to 2,700 years ago has been seized from a group of Palestinian looters who reportedly ...

Ancient parrot fossil found in Siberia

October 26, 2016

(—A Russian paleontologist has discovered a parrot fossil uncovered in Siberia several years ago—the first evidence of parrots living in Asia. In his paper published in Biology Letters, Nikita Zelenkov describes ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.