Credit: Pixabay/CC0 Public Domain

In academia, how often one's work is cited is one of the most important factors impacting who receives promotions, awards, and grants. It purports to be a nonbiased metric of the significance of a scholar's research and contributions to the field. But what if it's not that straightforward?

A new study from the Addiction, Health, & Adolescence (AHA!) Lab at the Annenberg School for Communication found that men are overcited and are undercited in the field of communication. The researchers' findings indicate that this problem is most persistent in papers authored by men.

"Despite known limitations in their use as proxies for research quality, we often turn to citations as a way to measure the impact of someone's research," says David Lydon-Staley, assistant professor of communication. "So it matters for individual researchers if one group is being consistently undercited relative to another group. But it also matters for the field in the sense that if people are not citing women as much as men, then we're building the field on the work of men and not the work of women. Our field should be representative of all of the excellent research that is being undertaken, and not just that of one group."

Many scholars have previously asserted that women are undercited in academia. In order to test this hypothesis in the field of communication, the researchers analyzed authorship data from 14 journals from 1995 to 2018. Using name databases, they assigned "man" or "woman" to each author cited (removing names that could not be assigned with at least 70% probability) and then calculated the number of women authors cited in comparison with men authors cited in more than 8,000 articles.

Their analysis showed that papers by men were overcited and papers by women were undercited relative to the you would expect if references were drawn randomly and gender was not affecting citation practices. Further, this problem occurred more frequently in papers authored by men than in papers authored by women.

"One big takeaway from this study is that this is really a problem that men need to contend with," says Lydon-Staley, "because our findings show that this citation imbalance is being mostly driven by the citation practices of men, not women."

There is some good news, however. The first is that the gender imbalance in citation does seem to be lessening ever so slightly over time, though the researchers are concerned that the documented struggles of women academics during the COVID-19 pandemic will end any gains that have been made. The second is that there are tools to help academics evaluate their citation practices. Co-author Dale Zhou, a in co-author Professor Danielle Bassett's laboratory at Penn Engineering, has created an online tool that allows you to estimate the gender of the authors you cite. Jennifer Stiso, a co-author and research engineer in Bassett's laboratory, has created a browser extension that estimates the gender of paper authors when using Google scholar.

"These tools, like our study, can be a catalyst for ending the imbalance along gender lines," says Annenberg doctoral student and first author Xinyi Wang. "But real change is going to require academics, especially men, to do the hard work of searching the field for literature they may not be familiar with and promoting the work of women researchers."

The study, entitled "Gendered Citation Practices in the Field of Communication," was published today in Annals of the International Communication Association.

More information: X. Wang et al, Gendered citation practices in the field of communication, Annals of the International Communication Association (2021). DOI: 10.1080/23808985.2021.1960180