Rating systems may discriminate against Uber drivers

December 16, 2016 by Leslie Morris, Cornell University

Many new "sharing economy" companies, like Uber and Airbnb, use consumer-sourced ratings to evaluate their workers – but these systems can be fraught with difficulties, including bias based on race or gender.

In their paper, "Discriminating Tastes: Customer Ratings as Vehicles for Bias," researchers examine how creeps into evaluations of Uber drivers from their customers. Researchers Karen Levy and Solon Barocas, assistant professors in the Department of Information Science, Alex Rosenblat of the Data and Society Research Institute, and Tim Hwang of Google, show that through Uber's rating system consumers can directly assert their preferences and biases in ways that companies are prohibited from doing through federal law.

"The study collaborators are interested in ways bias can enter into algorithmic systems while not being prohibited by anti-discrimination law," Levy said.

Ratings are especially important to Uber drivers because they risk getting kicked off the platform if their average score falls below a certain level.

"The algorithms impact if these drivers get terminated or advanced," Levy said. "We know that people tend to have that affect how they evaluate people from different groups. It would be illegal for an employer to discriminate directly, but this creates the possibility for backdoor bias creeping in from customers. These new technologies challenge the traditional way law prevents discrimination in the workplace."

The paper concludes that consumer-sourced ratings are highly likely to be influenced by bias on the basis of factors like race or ethnicity. To help solve this issue, the authors suggest 10 proposed interventions, such as data-quality measures, better design elements in the rating system or human evaluators, to validate ratings.

"Ratings are really subjective and mean different things to different people. Because they're so general, there's a lot of potential for bias to enter into them," Levy said. "There have already been situations in which companies in the sharing economy are dealing with discrimination between their users. The law has not caught up with how to protect people in these new environments."

Explore further: Researchers find racial, gender bias in online freelance marketplaces

More information: Rosenblat, Alex and Levy, Karen EC and Barocas, Solon and Hwang, Tim, Discriminating Tastes: Customer Ratings as Vehicles for Bias (October 19, 2016). Available at SSRN: ssrn.com/abstract=2858946

Related Stories

Airbnb takes new steps to fight discrimination

September 8, 2016

Global home-sharing giant Airbnb announced Thursday it is implementing new policies aimed at curbing racial discrimination by hosts and creating a permanent team aimed at fighting bias.

Recommended for you

How social networking sites may discriminate against women

April 20, 2018

Social media and the sharing economy have created new opportunities by leveraging online networks to build trust and remove marketplace barriers. But a growing body of research suggests that old gender and racial biases persist, ...

Virtually modelling the human brain in a computer

April 19, 2018

Neurons that remain active even after the triggering stimulus has been silenced form the basis of short-term memory. The brain uses rhythmically active neurons to combine larger groups of neurons into functional units. Until ...

'Poker face' stripped away by new-age tech

April 14, 2018

Dolby Laboratories chief scientist Poppy Crum tells of a fast-coming time when technology will see right through people no matter how hard they try to hide their feelings.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.