AI tool quantifies power imbalance between female and male characters in Hollywood movies

November 13, 2017 by Jennifer Langston, University of Washington
AI tool quantifies power imbalance between female and male characters in Hollywood movies
In the movie Frozen, only the princess Elsa is portrayed with high power and positive agency, according to a new analysis of gender bias in movies. Her sister, Anna, is portrayed with similarly low levels of agency and power as Cinderella, a movie character that debuted in 1950. Credit: University of Washington

At first glance, the movie "Frozen" might seem to have two strong female protagonists—Elsa, the elder princess with unruly powers over snow and ice, and her sister, Anna, who spends much of the film on a quest to save their kingdom.

But the two princesses actually exert very different levels of and control over their own destinies, according to new research from University of Washington computer scientists.

The team used machine-learning-based tools to analyze the language in nearly 800 movie scripts, quantifying how much power and agency those scripts give to individual characters. In their study, recently presented in Denmark at the 2017 Conference on Empirical Methods in Natural Language Processing, the researchers found subtle but widespread gender bias in the way male and female characters are portrayed.

"'Frozen' is an interesting example because Elsa really does make her own decisions and is able to drive her own destiny forward, while Anna consistently fails in trying to rescue her sister and often needs the help of a man," said lead author and Paul G. Allen School of Computer Science & Engineering doctoral student Maarten Sap, whose team also applied the tool to Wikipedia plot summaries of several classic Disney princess movies.

"Anna is actually portrayed with the same low levels of power and agency as Cinderella, which is a movie that came out more than 60 years ago. That's a pretty sad finding," Sap said.

The team also created a searchable online database showing the subtle gender biases in hundreds of Hollywood movie scripts, which range from late 80s cult classics like "Heathers" to romantic comedies like "500 Days of Summer" to war films like "Apocalypse Now."

In their analysis, the researchers found that women were consistently portrayed in ways that reinforce gender stereotypes, such as in more submissive positions and with less agency than men. For example, male characters spoke more in imperative sentences ("Bring me my horse") while female characters tended to hedge their statements ("Maybe I am wrong"). However, the bias is not just in the words these characters speak, but also in the way they are portrayed through narratives.

AI tool quantifies power imbalance between female and male characters in Hollywood movies
In the 2010 movie Black Swan, male characters (blue bars) were written with more control over their own destiny than their female counterparts, specifically in stage directions (left chart). However, the verbs used in dialogue (right chart) gave more power to female characters (red bars). Credit: University of Washington

To study the nuanced biases in narratives, the UW researchers expanded prior work presented in 2016 on "connotation frames" that give insights into how different verbs can empower or weaken different characters through their connotative meanings. The study evaluated the power and agency implicit in 2,000 commonly used verbs, where the connotative meanings were obtained from Amazon Mechanical Turk crowdsourcing experiments.

The power dimension denotes whether a character has authority over another character, while the agency dimension denotes whether a character has control over his or her own life or storyline. For each verb, turkers were asked to rank the implied level of power differentials and agency on a scale of 1 to 3.

"For example, if a female character 'implores' her husband, that implies the husband has a stance where he can say no. If she 'instructs' her husband, that implies she has more power," said co-author Ari Holtzman, an Allen School doctoral student. "What we found was that men systematically have more power and agency in the film script universe."

Verbs that imply low power or agency include words like ask, experience, happen, wait, relax, need or apologize. Verbs that confer high power or agency include words like finish, prepare, betray, construct, destroy, assign or compose.

Using the movie scripts, the researchers automatically identified genders of 21,000 characters based on names and descriptions. Using tools, which employ machine learning, they looked at which characters appeared as a verb's subject and object. They then computed how much agency and power were ascribed to these characters, using their crowdsourced connotation frames. The researchers also accounted for the fact that male actors spent more time on screen than female actors and also spoke more, accounting for 71.8 percent of the words spoken across all movies.

The team calculated separate power and agency scores for male and female characters in each movie. They also created scores based on words that the characters spoke in dialogue and on words that were used in narration or stage direction to describe those characters—exposing subtle differences and biases.

In 2010's "Black Swan," a movie centered around a female lead—a perfectionist ballerina who slowly loses grip on reality—the movie's dialogue gives more agency to female characters. But the language used to describe the characters in stage direction and narration gave male characters more power and agency in that film.

Across nearly 800 movie scripts of different genres, male characters were on average more empowered and described with higher levels of agency than female characters. Men were more likely to use forceful, imperative statements, while women were more likely to hedge their opinions. Credit: University of Washington

In the 2007 movie "Juno," about an offbeat young woman who unexpectedly gets pregnant, male characters' scene descriptions and narratives also consistently score higher in power and agency, though the two genders come closer in their dialogue.

The UW team's tool yields a much more nuanced analysis of gender bias in fictional works than the Bechdel Test, which only evaluates whether at least two female characters have a conversation about something other than a man.

The tendency for male characters to score higher on both power and agency dimensions held true throughout all genres: comedy, drama, horror, sci-fi, thrillers. Interestingly, the team found the same gender bias even for movies with female casting directors or script writers.

"We controlled for this. Even when women play a significant role in shaping a film, implicit gender biases are still there in the script," said co-author and Allen School doctoral student Hannah Rashkin.

Next steps for the team include broadening the tool to not only identify in texts but also to correct for it by offering rephrasing suggestions or ways to make language more equal across characters of different genders. The methodology isn't limited to , but could be applied to books, plays or any other texts.

"We developed this tool to help people understand how they may be perpetuating these subtle but prevalent biases that are deeply integrated in our language," said senior author Yejin Choi, an associate professor in the Allen School. "We believe it will help to have this diagnostic tool that can tell writers how much power they are implicitly giving to women versus men."

Explore further: How central are female characters to a movie?

More information: … p2017connotation.pdf

Related Stories

How central are female characters to a movie?

July 31, 2017

A new study from the USC Viterbi School of Engineering's Signal Analysis and Interpretation Lab (SAIL)—which creates automatic tools for signal analysis and linguistic assessment —uncovers how media communicates about ...

Women remain underrepresented in Hollywood, study shows

September 18, 2017

Women are making only modest gains on screen and behind the scenes in television according to a new study released by Martha Lauzen, executive director of the Center for the Study of Women in Television and Film at San Diego ...

Male-biased tweeting

April 23, 2014

Today women take an active part in public life. Without a doubt, they also converse with other women. In fact, they even talk to each other about other things besides men. As banal as it sounds, this is far from being the ...

Tough girl or sidechick?

April 21, 2010

These have the potential to influence a young viewing audience and their ideas about gender and violence. Her study is published in Springer's journal Sex Roles.

Recommended for you

Permanent, wireless self-charging system using NIR band

October 8, 2018

As wearable devices are emerging, there are numerous studies on wireless charging systems. Here, a KAIST research team has developed a permanent, wireless self-charging platform for low-power wearable electronics by converting ...

Facebook launches AI video-calling device 'Portal'

October 8, 2018

Facebook on Monday launched a range of AI-powered video-calling devices, a strategic revolution for the social network giant which is aiming for a slice of the smart speaker market that is currently dominated by Amazon and ...


Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Nov 13, 2017
This is fascinating. An interesting use of machine learning in a place where that kind of rigorous approach to texts succeeds. The weird thing is this is not exactly liberal arts OR STEM, is it?
2 / 5 (4) Nov 13, 2017
Blah, blah, blah.... men bad, women good.... blah, blah, blah.
not rated yet Nov 13, 2017
This is fascinating. An interesting use of machine learning in a place where that kind of rigorous approach to texts succeeds. The weird thing is this is not exactly liberal arts OR STEM, is it?
3 / 5 (4) Nov 13, 2017
I don't see anything special about it. Men and women think differently, react to and solve problems differently. We are not equal in the ways we function despite all the women in the world that think we are. From what I've seen, most women actually think that's a load of horse manure. We compliment each other in relationships and whether people want to admit it or not, most of those relationships really do have the man in the position of authority in the relationship. Sure there are all kinds of exceptions but that is the general rule of things. That is not to say women don't get what they want. They just tend to go about it differently than men do.
2.3 / 5 (3) Nov 14, 2017
I am troubled that they did not bother to compare movie scrips with real world usage? How often do women vs. men exercise power and agency in the real world compared to movies?
They note a discrepency from men to women but offer no reference frame as to why this is, or is not, different than every day life and why that may, or may not, be a good thing. Sure there is a descrepency in the data, men and women are different. The base assumption here is that men and women are IDENTICAL, and therefore discrepencies in power and agency in movies come from gender Bias of writers. However, (to me) the premise is what's biased. Sure they have shown a difference in MvW in language usage and problem solving. What I do not see, is support for any kind of Bias anywhere other than the researchers assuming Men and Women are identical in communicaiton, suvival, and thinking, strategies. Men and women are not identical we are complementry and each is designed to work synergisticaly with the other.
5 / 5 (1) Nov 14, 2017
Evolution doesn't "design" anything. Whatever is successful works best... and arbitrary distinctions based on cultural traditions aren't generally very effective.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.