'Language tests being misused': new study

Jun 23, 2011

A seminal article on language testing, co-authored by Dr Glenn Fulcher, a Reader in Education at the University of Leicester, argues that some agencies are using unsuitable language tests to achieve policy ends.

Dr Fulcher, and Professor Fred Davidson of the University of Illinois Department of Linguistics, argue that generic tests are being used for multiple purposes because some policy makers go for "cheap and simple solutions" to complex problems, such as immigration.

Their article, entitled Test architecture, test retrofit, which has won this year's Best Paper Award from the International Language Testing Association (ILTA), uses architectural references to illustrate how language tests are being misused.

The researchers will be presented with a cheque and a plaque at the Language Testing Research Colloquium, being held at the University of Michigan from June 23-25, 2011.

Dr Fulcher, from the University of Leicester School of Education, said: "The use of language tests as instruments of public policy has spread exponentially over the last ten years. Most recently, for example, the UK Border Agency has introduced the use of language testing to reduce the number of students entering the United Kingdom; and a policy of restricting immigration rights to the non-EU spouses of UK citizens who do not speak English is now in place.

"In the world of professional certification language testing is also becoming increasingly important. The press has recently been full of stories about the horrors of allowing professionals to practice without the necessary language and communication skills to function safely. These have ranged from calls to introduce language testing for all medical staff who trained in non-English environments to the standardization of language testing for and pilots.

"These are all cases of "high stakes" test use situations, where the consequences of poor decision making are serious."

Dr Fulcher cited the example of tests of academic English that are used for spouses: "The barriers to immigration may be set too high, and test use therefore may be a form of discrimination. Similarly, it is hard to draw inferences about a pilot's ability to communicate with air traffic control, or a doctor with a patient, both contexts which require specialist vocabulary and terminology, on the basis of a test designed for first year university students."

Dr Fulcher added that testing is a lucrative industry - but it is expensive to research and to develop new tests that are fit for purpose.

"Some testing companies encourage the use of a single product for as many uses as they can. Our article explicitly draws attention to the tension between prioritising test purpose and score interpretability on the one hand, and commercial pressures to increase test volumes, on the other.

"We need to show policy makers and testing agencies that the consequences of their decisions are potentially very serious. It is possible for someone to be certified on the basis of a generic test and then fail in their real world tasks - like an air disaster because the controller could not communicate clearly enough to keep two aircraft apart in an emergency. Many such language related instances are on record."

Explore further: Genes play a key part in the recipe for a happy country

add to favorites email to friend print save as pdf

Related Stories

International research tests language tests

Jun 04, 2009

Unique Queen's University research will shed light on how motivation and anxiety affects language test scores, and on the relationship between the test scores and the social and educational contexts of the tests.

Bilinguals find it easier to learn a third language

Feb 01, 2011

The study also found that Russian speakers had a better grasp of Hebrew than Hebrew speakers themselves. "Learning a mother tongue and preserving it does not compromise the ability to learn an additional language. The opposite ...

Practice tests improve memory, researchers say

Oct 14, 2010

Although most people assume that tests are a way to evaluate learning, a wealth of research has shown that testing can actually improve learning, according to two researchers from Kent State University. Dr. Katherine Rawson, ...

Bilinguals get the blues

Mar 15, 2011

(PhysOrg.com) -- Learning a foreign language literally changes the way we see the world, according to new research.

Recommended for you

Genes play a key part in the recipe for a happy country

14 hours ago

Why are the Danes naturally more cheerful than the Brits, and why are we in turn more upbeat than the French? Research presented as part of this year's ESRC Festival of Social Sciences shows us that the recipe behind a happy ...

Black Republicans put most faith in US government

Oct 29, 2014

Black Republicans trust the United States government more than other political groups, finds a new study from the University of British Columbia, ahead of the mid-term U.S. elections to be held on November ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.