Grit better than GRE at predicting success in STEM fields

June 12, 2014

Selecting graduate students in the fields of science and engineering based on an assessment of their character instead of relying almost entirely on their scores on a standardized test would significantly improve the quality of the students that are admitted and, at the same time, boost the participation of women and minorities in these key disciplines.

That is the argument made in the essay "A test that fails" published in the June 12 issue of the journal Nature. The authors are Associate Professor of Physics Casey Miller of the University of South Florida and Keivan Stassun, professor of physics and astronomy at Vanderbilt University and Fisk University, who are both involved in successful bridge programs designed to improve PhD completion rates among all students and to boost women and underrepresented minority participation in the fields of science, technology, engineering and math (STEM).

According to the authors, the primary reason that half of all American PhD students fail to graduate, and the primary barrier holding back women and minority students is American academia's over-reliance on the GRE, the graduate record examination, a standardized test introduced in 1949 that most US graduate schools require for admission. The problem is that the exam's quantitative score – the part measuring math ability – is not a good predictor of a student's ultimate success, particularly in the STEM fields. Women, on average, score 80 points on average lower in the physical sciences than men and African Americans score 200 points below whites. At the same time, studies performed by ETS, the company that administers the test, have found that the test's predictive ability is limited to first-year graduate course grades and even that is questionable in STEM fields.

"In simple terms, the GRE is a better indicator of sex and skin color than of ability and ultimate success," the article states.

Despite its demonstrable demographic bias, graduate-admissions committees routinely use minimum GRE scores to filter applications. A typical procedure is to reject the application of any candidate scoring less than 700 on the 800-point quantitative section, despite the fact that this practice violates ETS guidelines.

"The misuse of GRE scores to select applicants may be a strong driver of the continuing under-representation of women and minorities in graduate school. Indeed, women earn hardly 20 percent of US physical sciences PhDs and underrepresented minorities – who account for 33 percent of US university-age population – earn just 6 percent. These percentages are striking in their similarity to the percentage of students who score above 700 on the GRE Quantitative Measure," the article points out.

Miller and Stassun propose an alternative approach to the selection process, which has proven successful in the bridge programs with which they are involved: Using a 30 minute face-to-face interview that examines an individual's college and research experiences, key relationships, leadership experience, service to the community, and life goals. This provides committee members with a good indication not only of the person's academic training and aptitude but also of the other competencies that point to a likelihood of success in graduate school and a STEM career.

The validation for this approach is the track record of the students in their programs. At the Fisk-Vanderbilt bridge program, for example, 85 percent of the students would have been eliminated by the 700-point GRE cutoff. However, 81 percent of the 67 students who have entered the program – including 56 underrepresented minorities and 35 women – have earned, or are making good progress toward their PhDs and all the students who have received their doctorates have found employment in the STEM workforce, as post doctoral students, university faculty members or staff scientists in national labs or industry. This 81 percent success rate is significantly better than the 50 percent national average, which most policy makers agree is an enormous waste of precious human resources.

Miller and Stassun make it clear that they are not advocating the admission of unqualified minorities in the name of social good. Instead, they argue that the nation can swell the ranks of its STEM workforce – a goal that is broadly agreed upon by policy makers to improve the nation's international competitiveness – by adopting a more accurate graduate school admission process that improves the quality of admitted PhD students and that doesn't eliminate large numbers of talented minority and women who have the right stuff to succeed in these challenging careers.

Explore further: Impact of affirmative action bans in graduate fields of study

Related Stories

Impact of affirmative action bans in graduate fields of study

January 24, 2013

Important findings on the impact of banning affirmative action in higher education were just published in the American Educational Research Journal (AERJ) in Online First. Affirmative action in university admissions has long ...

Predicting long-term success in college

July 16, 2013

(Phys.org) —Long-term success in college may be better predicted with Advanced Placement (AP) exams and personality traits in combination with standard admission practices, according to new research from the Georgia Institute ...

Study explores where high number of women earn STEM degrees

May 28, 2014

(Phys.org) —There have been concerted efforts in recent years to determine how more women can be involved in science, technology, engineering and mathematics—the so-called STEM fields. Research from the University of ...

Recommended for you

Earliest evidence of reproduction in a complex organism

August 3, 2015

Researchers led by the University of Cambridge have found the earliest example of reproduction in a complex organism. Their new study has found that some organisms known as rangeomorphs, which lived 565 million years ago, ...

Model shows how surge in wealth inequality may be reversed

July 30, 2015

(Phys.org)—For many Americans, the single biggest problem facing the country is the growing wealth inequality. Based on income tax data, wealth inequality in the US has steadily increased since the mid-1980s, with the top ...

French teen finds 560,000 year-old tooth (Update)

July 28, 2015

A 16-year-old French volunteer archaeologist has found an adult tooth dating back around 560,000 years in southwestern France, in what researchers hailed as a "major discovery" Tuesday.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

zaxxon451
2 / 5 (1) Jun 13, 2014
"Instead, they argue that the nation can swell the ranks of its STEM workforce – a goal that is broadly agreed upon by policy makers to improve the nation's international competitiveness"

"Improving the nation's international competitiveness" -- sounds better than their actual goal of driving down the wages of tech workers by flooding the market with STEM graduates.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.