Grit better than GRE at predicting success in STEM fields

Jun 12, 2014

Selecting graduate students in the fields of science and engineering based on an assessment of their character instead of relying almost entirely on their scores on a standardized test would significantly improve the quality of the students that are admitted and, at the same time, boost the participation of women and minorities in these key disciplines.

That is the argument made in the essay "A test that fails" published in the June 12 issue of the journal Nature. The authors are Associate Professor of Physics Casey Miller of the University of South Florida and Keivan Stassun, professor of physics and astronomy at Vanderbilt University and Fisk University, who are both involved in successful bridge programs designed to improve PhD completion rates among all students and to boost women and underrepresented minority participation in the fields of science, technology, engineering and math (STEM).

According to the authors, the primary reason that half of all American PhD students fail to graduate, and the primary barrier holding back women and minority students is American academia's over-reliance on the GRE, the graduate record examination, a standardized test introduced in 1949 that most US graduate schools require for admission. The problem is that the exam's quantitative score – the part measuring math ability – is not a good predictor of a student's ultimate success, particularly in the STEM fields. Women, on average, score 80 points on average lower in the physical sciences than men and African Americans score 200 points below whites. At the same time, studies performed by ETS, the company that administers the test, have found that the test's predictive ability is limited to first-year graduate course grades and even that is questionable in STEM fields.

"In simple terms, the GRE is a better indicator of sex and skin color than of ability and ultimate success," the article states.

Despite its demonstrable demographic bias, graduate-admissions committees routinely use minimum GRE scores to filter applications. A typical procedure is to reject the application of any candidate scoring less than 700 on the 800-point quantitative section, despite the fact that this practice violates ETS guidelines.

"The misuse of GRE scores to select applicants may be a strong driver of the continuing under-representation of women and minorities in graduate school. Indeed, women earn hardly 20 percent of US physical sciences PhDs and underrepresented minorities – who account for 33 percent of US university-age population – earn just 6 percent. These percentages are striking in their similarity to the percentage of students who score above 700 on the GRE Quantitative Measure," the article points out.

Miller and Stassun propose an alternative approach to the selection process, which has proven successful in the bridge programs with which they are involved: Using a 30 minute face-to-face interview that examines an individual's college and research experiences, key relationships, leadership experience, service to the community, and life goals. This provides committee members with a good indication not only of the person's academic training and aptitude but also of the other competencies that point to a likelihood of success in graduate school and a STEM career.

The validation for this approach is the track record of the students in their programs. At the Fisk-Vanderbilt bridge program, for example, 85 percent of the students would have been eliminated by the 700-point GRE cutoff. However, 81 percent of the 67 students who have entered the program – including 56 underrepresented minorities and 35 women – have earned, or are making good progress toward their PhDs and all the students who have received their doctorates have found employment in the STEM workforce, as post doctoral students, university faculty members or staff scientists in national labs or industry. This 81 percent success rate is significantly better than the 50 percent national average, which most policy makers agree is an enormous waste of precious human resources.

Miller and Stassun make it clear that they are not advocating the admission of unqualified minorities in the name of social good. Instead, they argue that the nation can swell the ranks of its STEM workforce – a goal that is broadly agreed upon by policy makers to improve the nation's international competitiveness – by adopting a more accurate graduate school admission process that improves the quality of admitted PhD students and that doesn't eliminate large numbers of talented minority and women who have the right stuff to succeed in these challenging careers.

Explore further: Study explores where high number of women earn STEM degrees

add to favorites email to friend print save as pdf

Related Stories

Study explores where high number of women earn STEM degrees

May 28, 2014

(Phys.org) —There have been concerted efforts in recent years to determine how more women can be involved in science, technology, engineering and mathematics—the so-called STEM fields. Research from the University of ...

Impact of affirmative action bans in graduate fields of study

Jan 24, 2013

Important findings on the impact of banning affirmative action in higher education were just published in the American Educational Research Journal (AERJ) in Online First. Affirmative action in university admissions has long been ...

Predicting long-term success in college

Jul 16, 2013

(Phys.org) —Long-term success in college may be better predicted with Advanced Placement (AP) exams and personality traits in combination with standard admission practices, according to new research from the Georgia Institute ...

Recommended for you

Congressional rift over environment influences public

21 hours ago

American citizens are increasingly divided over the issue of environmental protection and seem to be taking their cue primarily from Congress, finds new research led by a Michigan State University scholar.

Decoding ethnic labels

Jul 30, 2014

If you are of Latin American descent, do you call yourself Chicano? Latino? Hispanic?

Local education politics 'far from dead'

Jul 29, 2014

Teach for America, known for recruiting teachers, is also setting its sights on capturing school board seats across the nation. Surprisingly, however, political candidates from the program aren't just pushing ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

zaxxon451
2 / 5 (1) Jun 13, 2014
"Instead, they argue that the nation can swell the ranks of its STEM workforce – a goal that is broadly agreed upon by policy makers to improve the nation's international competitiveness"

"Improving the nation's international competitiveness" -- sounds better than their actual goal of driving down the wages of tech workers by flooding the market with STEM graduates.