State VAMS don't reflect content, quality of teachers' instruction

May 13, 2014

New research published online today in Educational Evaluation and Policy Analysis (EEPA), a peer-reviewed journal of the American Educational Research Association, finds weak to nonexistent relationships between state-administered value-added model (VAM) measures of teacher performance and the content or quality of teachers' instruction. Based on their results, the authors question whether VAM data will be useful in evaluating teacher performance and shaping classroom instruction.

"Instructional Alignment as a Measure of Teaching Quality," by Morgan S. Polikoff at the University of Southern California and Andrew C. Porter at the University of Pennsylvania, also finds no association between multiple-measure teaching effectiveness ratings—which combine value-added measures with survey and observational ratings of teacher quality—and the content of ' instruction in the classroom.

"While value-added measures do provide some useful information, our findings show that they are not picking up the things we think of as being good teaching," said Polikoff. "Given the growing extent to which states are using these measures for a wide array of decisions, our findings are troubling."

Polikoff and Porter's study is the first large-scale analysis of the relationship of instructional alignment (i.e., the degree to which the content of is aligned with state standards and assessments, such as the Common Core standards) and teaching effectiveness with teacher VAM scores and a composite measure of teacher effectiveness.

This video is not supported by your browser at this time.
Co-author Morgan S. Polikoff discusses key findings.

The authors investigated these relations based on a subsample of 327 fourth- and eighth-grade mathematics and English language arts teachers across all six school districts included in the Measures of Effective Teaching (MET) study, including New York City, Dallas, Denver, Charlotte-Mecklenburg, Memphis, and Hillsborough County, Florida.

"We expected to see that instruction aligned with state standards and assessments would strongly predict value-added performance measures on those assessments, but that wasn't the case," said Polikoff.

Recent policy initiatives such as the Race to the Top Fund and No Child Left Behind waivers have created a push to improve the methods by which teachers are evaluated. Many of these methods focus on teachers' contributions to student learning, often measured by value-added models and multiple-measure evaluation systems.

With the rollout of Common Core State Standards, according to Polikoff, the development of a deeper understanding of the ways effective teachers implement the standards in the classroom is imperative.

"Our results suggest that it's going to be difficult to use these systems to improve ," said Polikoff.

Their findings, the authors noted, lead to a disconcerting question: "If VAMs are not meaningfully associated with either the content or quality of instruction, what are they measuring?"

Explore further: New approach urged for 'abysmal' K-12 writing instruction

More information:… ortalid=38&mid=29200

Provided by American Educational Research Association

1 /5 (1 vote)
add to favorites email to friend print save as pdf

Related Stories

Researchers add insights for teacher evaluations

Feb 03, 2014

New research led by the University of Notre Dame's Center for Research on Educational Opportunity (CREO) points a way forward to improve certain teacher performance evaluation systems.

Recommended for you

Election surprises tend to erode trust in government

15 hours ago

When asked who is going to win an election, people tend to predict their own candidate will come out on top. When that doesn't happen, according to a new study from the University of Georgia, these "surprised losers" often ...

Awarded a Pell Grant? Better double-check

Jul 23, 2014

(AP)—Potentially tens of thousands of students awarded a Pell Grant or other need-based federal aid for the coming school year could find it taken away because of a mistake in filling out the form.

Perthites wanted for study on the Aussie lingo

Jul 23, 2014

We all know that Australians speak English differently from the way it's spoken in the UK or the US, and many of us are aware that Perth people have a slightly different version of the language from, say, Melbournians - but ...

User comments : 0