'Vital signs' of teaching captured by quick, reliable in-class evaluation

Jun 17, 2014

A 20-minute classroom assessment that is less subjective than traditional in-class evaluations by principals can reliably measure classroom instruction and predict student standardized test scores, a team of researchers researchers reported.

The assessment also provides immediate and meaningful feedback making it an important new tool for understanding and improving instructional quality, according to psychologists from the University of Rochester and the University of North Carolina at Chapel Hill.

"Education researchers broadly agree that teachers matter," explained co-author Edward Deci, the Gowen Professor in the Social Sciences at the University of Rochester. "But there is less consensus about precisely what defines effective instruction and how to measure it. This assessment is able to capture the vital signs of teaching. It's a bit like a doctor taking your blood pressure and pulse for a quick picture of your health," said Deci.

Deci, Diane Early, a scientist at the University of North Carolina at Chapel Hill, and Ronald Rogge, an associate professor of psychology at the University of Rochester, reported their results in the Summer 2014 issue of the High School Journal.

In this study, the researchers asked trained observers to rate the classroom instruction of 58 math and English teachers in four high schools in Arizona using a tool developed by the Institute for Research and Reform in Education, a non-profit that uses evidence-based practices to help struggling schools. The 15-item tool focuses on three aspects of instruction: the engagement of students, how closely schoolwork aligns with state and local standards, and whether coursework is appropriately challenging. Called the EAR Protocol—short for Engagement, Alignment, and Rigor—the assessment already has been used in more than 100 schools, but this current study is the first to test the its objectivity and ability to predict student learning as measured by .

The protocol is based on educational research showing that when students' basic psychological needs are met, learning outcomes improve, explained Deci. For example, when teachers are excited about their subjects and supportive, students are more likely to be engaged. When instructors present challenging schoolwork along with structured supports for mastering those assignments, students build a genuine sense of competence and confidence. "It's like learning how to play tennis. You improve when you play with someone who is just a bit better than you are," he said.

The researchers found that higher classroom ratings for engagement, alignment, and rigor were correlated with better student outcomes on standardized tests, after controlling for prior year .

"The assessment captures surprisingly complex and fundamental qualities of teaching," said Early. "It's easy to use and 20 minutes is short enough for administrators to fit into the confines of their busy workday. And it's adaptable for all grades and subjects, from math and English to art and physical education."

The study also showed that observers can use the tool reliably. "Different observers of the same classroom came to the same conclusions," explained Early.

By highlighting areas where teachers need improvement, the assessments can help identify what kinds of professional development may be most helpful, the authors wrote. Follow-up assessments can then test to see if additional training enhances . "It's hard to know whether you are improving if there is no objective feedback measure," explained Early.

The assessment also helps teachers and administrators focus on the same key indicators of teaching quality: engagement, alignment, and rigor. "If adopted widely, the evaluations could provide a common language for talking about the vital signs of high-quality teaching," said Early.

Explore further: State VAMS don't reflect content, quality of teachers' instruction

More information: Engagement, Alignment, and Rigor as Vital Signs of High-Quality Instruction: A Classroom Visit Protocol for Instructional Improvement and Research, paper.

add to favorites email to friend print save as pdf

Related Stories

Company aims to transform reading instruction

Jun 16, 2014

Just as students receive report cards at the end of each school year, so too does the United States – and the country's most recent report card paints a bleak picture of the current state of reading instruction. According ...

Recommended for you

Precarious work schedules common among younger workers

Aug 29, 2014

One wish many workers may have this Labor Day is for more control and predictability of their work schedules. A new report finds that unpredictability is widespread in many workers' schedules—one reason ...

Girls got game

Aug 29, 2014

Debi Taylor has worked in everything from construction development to IT, and is well and truly socialised into male-dominated workplaces. So when she found herself the only female in her game development ...

Computer games give a boost to English

Aug 28, 2014

If you want to make a mark in the world of computer games you had better have a good English vocabulary. It has now also been scientifically proven that someone who is good at computer games has a larger ...

Saddam Hussein—a sincere dictator?

Aug 28, 2014

Are political speeches manipulative and strategic? They could be – when politicians say one thing in public, and privately believe something else, political scientists say. Saddam Hussein's legacy of recording private discussions ...

User comments : 0