Cornell CIS and Adobe collaboration creates artificial intelligence photo tool

May 8, 2017, Cornell University
New research from Computing and Information Science and Adobe may add another creative option to image editing software. Credit: Cornell University

There may a new cool tool for image editing software in the future. If you're a fan of making your photo into a Monet or Warhol, there's now a way to make changes to a photograph by transferring the style and other elements from another photograph.

Computer science professor Kavita Bala, doctoral student Fujun Luan, and Adobe collaborators Sylvian Paris and Eli Shechtman have released a paper detailing their new Deep Photo Style Transfer. The paper explains how the researchers have augmented transfer, transposing the look of one photo onto another using to make sure the details of the original image are preserved. The researchers will present their paper at the Conference on Computer Vision and Pattern Recognition in July.

"There has been a lot of interest in the idea of stylizing photographs," said Bala. "What motivated us is the idea that style could be imprinted on a but it is still intrinsically the same photo. This turned out to be incredibly hard. The key insight finally was about preserving boundaries and edges while still transferring the style."

The researchers used deep machine learning to add a neural network layer that pays close attention to edges within the image, like the border between a tree and a lake.

"The method we came up with is surprisingly very effective. It was a tough nut to crack, so when we got it working after many attempts at a solution, it was a big breakthough," said Bala. "The response has been outstanding. It has definitely captured people's imaginations as a way to stylize photos in a more dramatic way."

Explore further: Monet's worlds translated into realistic photos in Berkeley effort

Related Stories

Where can I buy a chair like that? This app will tell you

August 23, 2016

If you think you have a knack for interior design, or just want to spruce up your own home, new technology developed by Cornell researchers may help you choose furnishings the way professionals do. And professionals may find ...

Recommended for you

Fish-inspired material changes color using nanocolumns

March 20, 2019

Inspired by the flashing colors of the neon tetra fish, researchers have developed a technique for changing the color of a material by manipulating the orientation of nanostructured columns in the material.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.