Computer scientists develop technique to improve helpfulness of user-generated online reviews

Dec 18, 2009

(PhysOrg.com) -- Irish computer scientists have developed a system to improve the helpfulness of online customer reviews. In recognition of the quality of their work, the group received a distinguished paper award at the British Computer Society’s annual Artificial Intelligence Conference.

“Our technique automatically analyses online user-generated reviews based on four key factors - reputation, social, sentiment and content - and determines how helpful the reviews are likely to be to customers before presenting the most helpful first - including both positive and negative reviews,” says UCD Professor Barry Smyth, Director of CLARITY, one of the researchers involved in the work.

User-generated reviews have become increasingly important when it comes to users making buying decisions. While online product or service reviews have become more common, they tend to vary greatly in their quality and helpfulness.

“Some online user-generated reviews can be biased or poorly written, while others can be balanced and insightful,” says Professor Smyth. “That is why we worked to develop an automated technique of accurately identifying helpful product or service reviews for the user.”

“Some online services are already trying to do this by allowing users to rate the helpfulness of a review, but this type of feedback tends to be sparse and varied. In fact, if the online reviews received enough helpfulness feedback from users there would be little need for our work in this area.”

According to the UCD , after sampling 225,000 reviews by 45,000 distinct reviewers on 70,000 hotels on TripAdvisor, they discovered that about 65% of reviews did not receive sufficient feedback to allow for a straightforward determination of their helpfulness.”

“The infrequent helpfulness ratings that we identified would not give users a lot of confidence in the reviews,” explains Dr Michael O’Mahony, another of the UCD researchers involved in the work. “It’s about identifying which reviews are the most informative about the product or service. After all TripAdvisor currently hosts over 30 million user-generated reviews, so there is an amazing amount of latent value in existing online reviews.”

The system devised by the researchers applies machine learning techniques to discover the factors that make for a helpful review. It analyses reviews that have received feedback, and then applies the resulting models to evaluate the helpfulness of the majority of reviews that have little or no feedback.

The technique applies four key attributes to predict the helpfulness of a review: reputation, social, sentiment, and content. When added together, these elements offer a greatly improved helpfulness classification for online reviews.

Reputation captures a reviewer’s as regards all previous reviews written by the same author. Social takes account of the fact that when a user writes their own reviews they also tend to be more likely to respond to existing reviews and thereby improving the quality of their own review. Sentiment considers that the score attributed to a product in the review is an indicator of review helpfulness, as users tend to respond more to positive reviews. Content accounts for how well the review is written, by way of form and length - poorly authored reviews are considered less favourable by users.

"One interesting result that we noticed is that users tend to be drawn more towards positive reviews and often ignore negative reviews," says Dr O'Mahony, "even though the negative reviews can be very revealing and informative. Thus one of the benefits of our system is that it can be used to promote helpful negative reviews that might otherwise be hidden within a mass of review content."

“Ultimately the user benefits by having access to more helpful reviews. And websites like TripAdvisor will benefit from a more satisfied user-base, and even the service providers (the hotel owners in this case) will benefit because the good services or products will have a better chance of attracting customers, while the poorer ones will have to be improved in order to attract better reviews.”

Explore further: Earthquake simulation tops one quadrillion flops

Provided by Univeristy College Dublin

not rated yet
add to favorites email to friend print save as pdf

Related Stories

Yelp to let businesses comment publicly on reviews

Apr 09, 2009

(AP) -- The review Web site Yelp, which has garnered some criticism from the businesses put under its microscope, will soon let those businesses and others respond publicly to customers' critiques.

TripAdvisor warns of hotels posting fake reviews

Jul 16, 2009

(AP) -- The hotel review may sound too good - citing obscure details like the type of faucets - or perhaps one stands out as the only negative rating of an otherwise popular location.

Recommended for you

Dish Network denies wrongdoing in $2M settlement

9 hours ago

The state attorney general's office says Dish Network Corp. will reimburse Washington state customers about $2 million for what it calls a deceptive surcharge, but the satellite TV provider denies any wrongdoing.

Yahoo sees signs of growth in 'core' (Update)

9 hours ago

Yahoo reported a stronger-than-expected first-quarter profit Tuesday, results hailed by chief executive Marissa Mayer as showing growth in the Web giant's "core" business.

Intel reports lower 1Q net income, higher revenue

9 hours ago

Intel's earnings fell in the first three months of the year amid a continued slump in the worldwide PC market, but revenue grew slightly because of solid demand for tablet processors and its data center services.

Earthquake simulation tops one quadrillion flops

11 hours ago

A team of computer scientists, mathematicians and geophysicists at Technische Universitaet Muenchen (TUM) and Ludwig-Maximillians Universitaet Muenchen (LMU) have – with the support of the Leibniz Supercomputing ...

Twitter buys data analytics partner Gnip

12 hours ago

Twitter says it has bought its data partner Gnip, which provides analysis of the more than 500 million tweets its users share each day—to advertisers, academic institutions, politicians and other customers.

User comments : 0

More news stories

Intel reports lower 1Q net income, higher revenue

Intel's earnings fell in the first three months of the year amid a continued slump in the worldwide PC market, but revenue grew slightly because of solid demand for tablet processors and its data center services.

Low Vitamin D may not be a culprit in menopause symptoms

A new study from the Women's Health Initiative (WHI) shows no significant connection between vitamin D levels and menopause symptoms. The study was published online today in Menopause, the journal of The North American Menopa ...

Astronomers: 'Tilt-a-worlds' could harbor life

A fluctuating tilt in a planet's orbit does not preclude the possibility of life, according to new research by astronomers at the University of Washington, Utah's Weber State University and NASA. In fact, ...