Smarter AI—machine learning without negative data

November 26, 2018, RIKEN
Smarter AI: machine learning without negative data
Schematic showing positive data (apples) and a lack of negative data (bananas), with an illustration of the confidence of the apple data. Credit: RIKEN

A research team from the RIKEN Center for Advanced Intelligence Project (AIP) has successfully developed a new method for machine learning that allows an AI to make classifications without what is known as "negative data," a finding which could lead to wider application to a variety of classification tasks.

Classifying things is critical for our daily lives. For example, we have to detect spam mail, fake political news, as well as more mundane things such as objects or faces. When using AI, such tasks are based on " technology" in —having the computer learn using the boundary separating positive and negative data. For example, "positive" data would be photos including a happy face, and "negative" data photos that include a sad face. Once a classification boundary is learned, the computer can determine whether a certain data is positive or negative. The difficulty with this technology is that it requires both positive and negative data for the learning process, and negative data are not available in many cases (for instance, it is hard to find photos with the label, "this photo includes a sad face," since most people smile in front of a camera.)

In terms of real-life programs, when a retailer is trying to predict who will make a purchase, it can easily find data on customers who purchased from them (positive data), but it is basically impossible to obtain data on customers who did not purchase from them (negative data), since they do not have access to their competitors' data. Another example is a common task for app developers: they need to predict which users will continue using the app (positive) or stop (negative). However, when a user unsubscribes, the developers lose the user's data because they have to completely delete data regarding that user in accordance with the privacy policy to protect personal information.

According to lead author Takashi Ishida from RIKEN AIP, "Previous classification methods could not cope with the situation where negative data were not available, but we have made it possible for computers to learn with only positive data, as long as we have a confidence score for our positive data, constructed from information such as buying intention or the active rate of app . Using our new , we can let computers learn a classifier only from positive data equipped with confidence."

Ishida proposed, together with researcher Gang Niu from his group and team leader Masashi Sugiyama, that they let computers learn well by adding the confidence score, which mathematically corresponds to the probability whether the data belongs to a positive class or not. They succeeded in developing a method that can let computers learn a classification boundary only from positive data and information on its confidence (positive reliability) against classification problems of machine learning that divide data positively and negatively.

To see how well the system functioned, they used it on a set of photos that contains various labels of fashion items. For example, they chose "T-shirt," as the positive class and one other item, e.g., "sandal", as the negative class. Then they attached a confidence score to the "T-shirt" photos. They found that without accessing the negative data (e.g., "sandal" photos), in some cases, their method was just as good as a method that involves using positive and negative data.

According to Ishida, "This discovery could expand the range of applications where classification technology can be used. Even in fields where machine learning has been actively used, our classification technology could be used in new situations where only positive data can be gathered due to data regulation or business constraints. In the near future, we hope to put our technology to use in various research fields, such as natural language processing, vision, robotics, and bioinformatics."

Explore further: "Wide learning" AI technology enables highly precise learning even from imbalanced data sets

More information: Binary Classification from Positive-Confidence Data. Neural Information Processing Systems (NeurIPS 2018). papers.nips.cc/paper/7832-bina … tive-confidence-data

Related Stories

Artificial intelligence may put private data at risk

August 3, 2018

Machine learning – a form of artificial intelligence in which computers use data to learn on their own – is rapidly growing and poised to transform the world. But current models are vulnerable to privacy leaks and other ...

New AI method keeps data private

December 20, 2017

Modern AI is based on machine learning which creates models by learning from data. Data used in many applications such as health and human behaviour is private and needs protection. New privacy-aware machine learning methods ...

How old does your computer think you are?

September 27, 2017

Computerised face recognition is an important part of initiatives to develop security systems, in building social networks, in curating photographs, and many other applications. Systems that allow a computer to estimate with ...

A positive boost to the immune system

September 15, 2014

(Medical Xpress)—A positive attitude can improve your immune system and may help you live longer, according to a University of Queensland study.

How accurate is your AI?

March 14, 2018

As AI's role in society continues to expand, J B Brown of the Graduate School of Medicine reports on a new evaluation method for the type of AI that predicts yes/positive/true or no/negative/false answers.

Recommended for you

Meteorite source in asteroid belt not a single debris field

February 17, 2019

A new study published online in Meteoritics and Planetary Science finds that our most common meteorites, those known as L chondrites, come from at least two different debris fields in the asteroid belt. The belt contains ...

Diagnosing 'art acne' in Georgia O'Keeffe's paintings

February 17, 2019

Even Georgia O'Keeffe noticed the pin-sized blisters bubbling on the surface of her paintings. For decades, conservationists and scholars assumed these tiny protrusions were grains of sand, kicked up from the New Mexico desert ...

Archaeologists discover Incan tomb in Peru

February 16, 2019

Peruvian archaeologists discovered an Incan tomb in the north of the country where an elite member of the pre-Columbian empire was buried, one of the investigators announced Friday.

Where is the universe hiding its missing mass?

February 15, 2019

Astronomers have spent decades looking for something that sounds like it would be hard to miss: about a third of the "normal" matter in the Universe. New results from NASA's Chandra X-ray Observatory may have helped them ...

What rising seas mean for local economies

February 15, 2019

Impacts from climate change are not always easy to see. But for many local businesses in coastal communities across the United States, the evidence is right outside their doors—or in their parking lots.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.