'Language tests being misused': new study

Jun 23, 2011

A seminal article on language testing, co-authored by Dr Glenn Fulcher, a Reader in Education at the University of Leicester, argues that some agencies are using unsuitable language tests to achieve policy ends.

Dr Fulcher, and Professor Fred Davidson of the University of Illinois Department of Linguistics, argue that generic tests are being used for multiple purposes because some policy makers go for "cheap and simple solutions" to complex problems, such as immigration.

Their article, entitled Test architecture, test retrofit, which has won this year's Best Paper Award from the International Language Testing Association (ILTA), uses architectural references to illustrate how language tests are being misused.

The researchers will be presented with a cheque and a plaque at the Language Testing Research Colloquium, being held at the University of Michigan from June 23-25, 2011.

Dr Fulcher, from the University of Leicester School of Education, said: "The use of language tests as instruments of public policy has spread exponentially over the last ten years. Most recently, for example, the UK Border Agency has introduced the use of language testing to reduce the number of students entering the United Kingdom; and a policy of restricting immigration rights to the non-EU spouses of UK citizens who do not speak English is now in place.

"In the world of professional certification language testing is also becoming increasingly important. The press has recently been full of stories about the horrors of allowing professionals to practice without the necessary language and communication skills to function safely. These have ranged from calls to introduce language testing for all medical staff who trained in non-English environments to the standardization of language testing for and pilots.

"These are all cases of "high stakes" test use situations, where the consequences of poor decision making are serious."

Dr Fulcher cited the example of tests of academic English that are used for spouses: "The barriers to immigration may be set too high, and test use therefore may be a form of discrimination. Similarly, it is hard to draw inferences about a pilot's ability to communicate with air traffic control, or a doctor with a patient, both contexts which require specialist vocabulary and terminology, on the basis of a test designed for first year university students."

Dr Fulcher added that testing is a lucrative industry - but it is expensive to research and to develop new tests that are fit for purpose.

"Some testing companies encourage the use of a single product for as many uses as they can. Our article explicitly draws attention to the tension between prioritising test purpose and score interpretability on the one hand, and commercial pressures to increase test volumes, on the other.

"We need to show policy makers and testing agencies that the consequences of their decisions are potentially very serious. It is possible for someone to be certified on the basis of a generic test and then fail in their real world tasks - like an air disaster because the controller could not communicate clearly enough to keep two aircraft apart in an emergency. Many such language related instances are on record."

Explore further: Local education politics 'far from dead'

add to favorites email to friend print save as pdf

Related Stories

International research tests language tests

Jun 04, 2009

Unique Queen's University research will shed light on how motivation and anxiety affects language test scores, and on the relationship between the test scores and the social and educational contexts of the tests.

Bilinguals find it easier to learn a third language

Feb 01, 2011

The study also found that Russian speakers had a better grasp of Hebrew than Hebrew speakers themselves. "Learning a mother tongue and preserving it does not compromise the ability to learn an additional language. The opposite ...

Practice tests improve memory, researchers say

Oct 14, 2010

Although most people assume that tests are a way to evaluate learning, a wealth of research has shown that testing can actually improve learning, according to two researchers from Kent State University. Dr. Katherine Rawson, ...

Bilinguals get the blues

Mar 15, 2011

(PhysOrg.com) -- Learning a foreign language literally changes the way we see the world, according to new research.

Recommended for you

Local education politics 'far from dead'

5 hours ago

Teach for America, known for recruiting teachers, is also setting its sights on capturing school board seats across the nation. Surprisingly, however, political candidates from the program aren't just pushing ...

First grade reading suffers in segregated schools

5 hours ago

A groundbreaking study from the Frank Porter Graham Child Development Institute (FPG) has found that African-American students in first grade experience smaller gains in reading when they attend segregated schools—but the ...

Why aren't consumers buying remanufactured products?

7 hours ago

Firms looking to increase market share of remanufactured consumer products will have to overcome a big barrier to do so, according to a recent study from the Penn State Smeal College of Business. Findings from faculty members ...

Expecting to teach enhances learning, recall

7 hours ago

People learn better and recall more when given the impression that they will soon have to teach newly acquired material to someone else, suggests new research from Washington University in St. Louis.

Understanding the economics of human trafficking

Jul 28, 2014

Although Europe is one of the strictest regions in the world when it comes to guaranteeing the respect of human rights, the number of people trafficked to or within the EU still amounts to several hundred ...

User comments : 0