Researchers develop new method to address deep-seated biases in science, starting with birds

October 16, 2018, University of Maryland Baltimore County
An Eastern Bluebird, Rose’s study organism, sits on a fence. Photo by Dolan Trout, used under CC 2.0.

New UMBC research is helping dismantle gender and publication biases in science. A team of researchers working across disciplines has developed a new statistical technique to understand similarity, rather than difference, in the natural world. With this new technique, they've determined that among Eastern Bluebirds the structure of songs female birds sing is statistically indistinguishable from songs males sing.

Awareness of female birdsong is growing worldwide, thanks in part to a breakthrough paper by Karan Odom, Ph.D. '16, biological sciences, but it's still understood as a trait found primarily in tropical birds. Evangeline Rose, a current Ph.D. student in the same lab and first author on a new paper in Animal Behavior, wanted to look at song in a temperate species.

During Rose's fieldwork, "I was finding that the females were singing, to me, what sounded just like male songs," she says. "So we started thinking about equality, and equivalence, and how to test for it." On the advice of her advisor, Kevin Omland, professor of , she reached out to Thomas Mathew, professor of statistics, who has expertise in statistical equivalence.

Challenging a paradigm

Working together, the team modified a statistical method used in generic drug testing to meet their needs for ecology and animal behavior studies. The existing test helps determine whether generic and brand name drugs are "statistically equivalent," meaning they are similar enough to be prescribed safely for the same purpose. The new modification will allow scientists in other fields to test for equivalence. Before, researchers could only report they did not find a significant difference—a very different statement than saying two things are conclusively equivalent.

"We're really hoping this new method is going to address some issues with what kinds of data get published," Rose says. "The most important thing about being a good scientist is to be unbiased. And the whole tradition of testing for difference really leads to incredible biases in scientists," Omland says. He adds, "There's a whole realm of things in nature that we find interesting and important because of their similarity."

For example, in addition to similarities in songs between the sexes in birds, researchers could use the new test to ask if two species use the same type of habitat, respond the same way to predators, or consume the same food sources. Answers to those questions could fill long-standing knowledge gaps, or even inform conservation efforts.

"This test is really broadly applicable," says Rose, "and we're hoping to introduce it more to the ecology and evolution field."

A new approach

One advantage of the new method is it accounts for unequal sample sizes. In a medical study, researchers can carefully control the size of treatment and control groups. In other fields, from ecology, to engineering, to agriculture, that's often not possible. The also allows researchers to determine the equivalence of several traits simultaneously, Mathew explains. For example, in this study, the authors found that the male and female birds' songs were statistically equivalent across five different characteristics, such as duration of each song and the range of pitches the birds produced.

Rather than testing whether two things are exactly equal, the team was looking for a way to determine if two things were "close enough," given a defined allowable margin of difference. Because of that added layer, "There are additional challenges here," Mathew says.

"Even though this methodology is out there, it hasn't been applied—even in statistics—with this kind of data. That's why I was very excited when they brought this project to me," Mathew says. Rose adds, "It ended up being a really great partnership to look at these questions that hadn't been asked before for female , and we also ended up modifying this test in a really cool, new way."

Changing science

As research on similarities grows, there is also a growing drive to remove the bias against publishing studies that do not find a significant difference, often termed a "negative result." This paper "is part of an amazing drumbeat that's building up in the scientific community," Omland says. "There's a broader problem with the scientific method that's being increasingly acknowledged, and the we've developed can at least play a small role, and I hope a big role, in addressing it."

Rose, who plans to next investigate the function of female bluebird songs, says she will carry these new techniques with her as she moves through her research career. "I think in the future, I'll be thinking about how equivalence can change the questions we're asking, and I'll always keep in mind that we have extra tools in the toolkit."

Explore further: Scientists remind their peers: Female birds sing, too

More information: Evangeline M. Rose et al, A new statistical method to test equivalence: an application in male and female eastern bluebird song, Animal Behaviour (2018). DOI: 10.1016/j.anbehav.2018.09.004

Related Stories

Scientists remind their peers: Female birds sing, too

March 14, 2018

When North American ornithologists hear a bird singing, they're likely to assume it's a male. But in many species, the females sing too—and a new commentary in The Auk: Ornithological Advances argues that a better understanding ...

Researchers reveal acoustic complexity of chickadee songs

November 5, 2015

Songbirds join humans in the select few animal groups that are "vocal learners"—that is, they must learn from adults of their own species to develop a normal ability to speak (or sing, as the case may be). Because the brain ...

Warbling wrens don't just tweet, they sing duets

November 3, 2011

(AP) -- They may not be Sonny and Cher, but certain South American birds sing duets, taking turns as the tune goes along. "Calling it a love song is probably too strong a word," says researcher Eric S. Fortune of Johns Hopkins ...

Birds have time-honored traditions, too

June 20, 2018

What makes human cultural traditions unique? One common answer is that we are better copycats than other species, which allows us to pass our habits and ways of life down through the generations without losing or forgetting ...

Recommended for you

Coffee-based colloids for direct solar absorption

March 22, 2019

Solar energy is one of the most promising resources to help reduce fossil fuel consumption and mitigate greenhouse gas emissions to power a sustainable future. Devices presently in use to convert solar energy into thermal ...

NASA instruments image fireball over Bering Sea

March 22, 2019

On Dec. 18, 2018, a large "fireball—the term used for exceptionally bright meteors that are visible over a wide area—exploded about 16 miles (26 kilometers) above the Bering Sea. The explosion unleashed an estimated 173 ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.